2024-04-18T20:47:56.624 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T20:47:56.624 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --verbose --owner scheduled_teuthology@teuthology --name teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444 -- /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/orig.config.yaml 2024-04-18T20:47:56.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T20:47:56.742 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662444' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: c46a99d99fa3e2dad10a5ce96141fec909e651df owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 3165 sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: c46a99d99fa3e2dad10a5ce96141fec909e651df targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0qYPOOrUF44xX+rBmVFTyR9y3ovdmVHPUcuk/5UK6o2p1oY0Xi6Cj9TlP/2P2KpH8AYO16T1lbRZiEBG945OM= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM0JjbwAgdatnTvyr8pgmAKM94sGDrZAJm83TvEH7aPqcN/zzCJ1mQ3KgSbXVSfQFv7PQdrs+JLv8B5X6hSkkUA= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfnOXOEIS0QOp6fMobkyXVSkwCBo232moJgT5+lX1Kyq+fwSJNV9pnIPe41EYr9f5WDdm/9ayfd9EUwA1VCnVk= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSmRB0d68b04iPeYdg4BuXclEHUMxHSLviqVm3eqvmEBFADzFFEYMMyvqdLotHf0Zl0r5GUurxbZ3rDSSIK9pU= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_20:32:14 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T20:47:56.742 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa; will attempt to use it 2024-04-18T20:47:56.743 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa/tasks 2024-04-18T20:47:56.743 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T20:47:56.744 INFO:teuthology.task.internal:Checking packages... 2024-04-18T20:47:56.774 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5be49cd9e6fca1ff6a05f2473aa3b399da760600' 2024-04-18T20:47:56.775 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T20:47:56.775 INFO:teuthology.packaging:ref: None 2024-04-18T20:47:56.775 INFO:teuthology.packaging:tag: None 2024-04-18T20:47:56.775 INFO:teuthology.packaging:branch: main 2024-04-18T20:47:56.775 INFO:teuthology.packaging:sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:47:56.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-04-18T20:47:57.004 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:47:57.005 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T20:47:57.011 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T20:47:57.011 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T20:47:57.019 INFO:teuthology.task.internal:Saving configuration 2024-04-18T20:47:57.031 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T20:47:57.036 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T20:47:57.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:19.099982', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBTw6USYi4YMXyIjH9BY7aS4Pga4DU2BXaPDG6BeD7Sa'} 2024-04-18T20:47:57.084 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:19.097610', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKhQUHBn1ZoyQh31VTOcCdhynbdNI391KBnVIAJ4Iidl'} 2024-04-18T20:47:57.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:19.096161', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL4mlA24iGl0FhR7EWXArT0as3C5NbRT0MLRkHGO69cZ'} 2024-04-18T20:47:57.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:19.098855', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIC1QgjSaysT4NkZMCrRkZvVIR8+Fu+0B/cKjzuo6NWEF'} 2024-04-18T20:47:57.135 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T20:47:57.141 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-18T20:47:57.141 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['osd.0'] 2024-04-18T20:47:57.141 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['osd.1'] 2024-04-18T20:47:57.141 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['osd.2'] 2024-04-18T20:47:57.141 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T20:47:57.266 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f29dd413280>, signals=[15]) 2024-04-18T20:47:57.266 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T20:47:57.273 INFO:teuthology.task.internal:Opening connections... 2024-04-18T20:47:57.273 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T20:47:57.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:57.357 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T20:47:57.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:57.436 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T20:47:57.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:57.514 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-04-18T20:47:57.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:57.591 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T20:47:57.597 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-04-18T20:47:57.603 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-04-18T20:47:57.603 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-18T20:47:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-04-18T20:47:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-04-18T20:47:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:57.651 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-04-18T20:47:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-04-18T20:47:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:57.652 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:57.652 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-18T20:47:57.668 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-04-18T20:47:57.674 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-04-18T20:47:57.674 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:57.721 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:57.722 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:57.722 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:57.722 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-18T20:47:57.743 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-18T20:47:57.748 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-18T20:47:57.748 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:57.798 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:57.798 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-18T20:47:57.817 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-04-18T20:47:57.823 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-04-18T20:47:57.823 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-04-18T20:47:57.869 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:57.869 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2024-04-18T20:47:57.869 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="22.04" 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:57.870 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:57.870 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-04-18T20:47:57.884 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T20:47:57.893 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T20:47:57.900 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T20:47:57.901 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:57.904 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:57.906 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:57.908 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:57.917 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T20:47:57.922 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T20:47:57.922 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:57.948 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:57.958 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:57.960 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:57.982 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T20:47:58.061 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T20:47:58.074 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-18T20:47:58.074 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-18T20:47:58.074 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:58.075 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:58.075 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:58.075 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:58.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:58.080 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-18T20:47:58.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:58.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:58.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:58.082 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-04-18T20:47:58.083 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-18T20:47:58.083 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-18T20:47:58.129 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-56-generic 2024-04-18T20:47:58.130 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.15.0-56-generic 2024-04-18T20:47:58.130 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-04-18T20:47:58.131 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2024-04-18T20:47:58.132 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-56-generic 2024-04-18T20:47:58.132 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.15.0-56-generic 2024-04-18T20:47:58.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-18T20:47:58.132 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.15.0-56-generic 2024-04-18T20:47:58.132 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-04-18T20:47:58.133 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-04-18T20:47:58.133 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-04-18T20:47:58.133 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-18T20:47:58.265 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-18T20:47:58.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T20:47:58.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-18T20:47:58.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-04-18T20:47:58.414 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:58.446 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:58.446 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:58.446 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:58.510 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:58.575 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:58.575 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:58.578 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:58.578 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:58.592 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:58.596 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:58.612 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:58.624 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:58.658 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:58.724 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:58.810 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:58.947 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:58.954 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:58.972 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:58.972 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:58.979 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:58.988 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:59.004 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:59.055 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:59.087 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:59.119 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:59.149 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:59.270 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:47:59.297 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:47:59.298 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:47:59.302 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:47:59.310 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:59.322 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:59.353 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:59.354 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:59.354 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:59.356 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:59.361 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:59.381 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:59.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:59.399 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:59.400 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:59.414 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:59.416 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:59.418 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:59.426 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:59.426 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:59.428 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:59.428 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:59.435 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:47:59.438 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:47:59.451 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:47:59.451 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:47:59.452 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:47:59.453 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:59.453 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:47:59.503 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:47:59.518 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:59.519 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:59.526 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:59.527 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:59.527 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:47:59.530 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:59.531 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:59.533 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:47:59.538 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:59.539 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:59.539 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:59.540 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:59.541 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:59.542 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:47:59.543 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:47:59.543 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:59.545 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:47:59.545 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:47:59.546 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:47:59.547 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:47:59.548 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:47:59.550 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:47:59.550 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:47:59.560 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:59.562 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:59.562 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:59.567 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:59.567 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:59.571 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:47:59.572 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:47:59.573 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:47:59.574 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:47:59.585 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:59.607 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:59.624 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:59.651 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:47:59.658 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:47:59.659 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:47:59.659 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:47:59.660 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:47:59.661 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:47:59.667 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:47:59.676 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:47:59.676 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:47:59.677 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:47:59.679 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:47:59.680 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:47:59.703 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:47:59.737 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:47:59.771 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:48:00.147 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:48:00.153 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:48:00.154 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:48:00.167 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:48:00.171 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:48:00.178 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:48:00.184 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:48:00.198 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:48:00.198 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:48:00.201 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:48:00.287 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:48:00.399 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:48:00.419 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:48:00.420 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:48:00.421 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:48:00.423 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:48:00.424 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:48:00.424 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:48:00.429 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:48:00.433 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:48:00.600 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:48:00.684 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:48:00.769 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:48:00.850 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:48:00.884 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:48:01.224 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:48:01.607 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:48:01.751 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:48:01.776 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:48:02.209 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:48:02.225 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:48:02.360 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:48:04.004 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:48:04.397 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:48:04.566 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:48:04.864 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 12.9 MB in 2s (5,748 kB/s) 2024-04-18T20:48:05.144 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 12.9 MB in 3s (5,047 kB/s) 2024-04-18T20:48:05.208 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:48:05.245 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:48:05.259 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:48:05.259 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:48:05.260 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:48:05.262 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:48:05.263 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:48:05.263 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:48:05.265 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:48:05.294 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:48:05.458 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:48:05.508 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:48:05.540 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:48:05.551 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:48:05.641 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:48:05.678 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en 2024-04-18T20:48:05.702 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:48:05.732 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:48:05.842 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:48:05.843 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:48:06.226 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T20:48:06.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:06.295 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T20:48:06.390 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:48:06.464 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:48:06.471 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T20:48:06.471 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T20:48:06.476 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:48:06.477 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:48:06.478 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:48:06.480 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:48:06.481 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:48:06.481 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:48:06.484 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:48:06.565 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-18T20:48:06.583 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:48:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:06.628 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T20:48:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:48:06.628 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-18T20:48:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-04-18T20:48:06.650 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:48:06.670 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T20:48:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:48:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:06.672 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-18T20:48:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:48:06.679 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-18T20:48:06.734 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:48:06.735 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:48:06.765 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:06.765 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-04-18T20:48:06.765 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:48:06.765 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:48:06.826 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:48:06.864 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:48:06.870 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-18T20:48:06.871 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-18T20:48:06.902 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:48:06.902 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:48:07.024 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:48:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-04-18T20:48:07.025 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:07.026 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-18T20:48:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:48:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:07.028 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-18T20:48:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:48:07.028 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-04-18T20:48:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2024-04-18T20:48:07.079 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-18T20:48:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:48:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:07.081 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-04-18T20:48:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:48:07.203 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:07.203 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 113 MB of archives. 2024-04-18T20:48:07.203 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:48:07.203 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:48:08.789 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:48:09.234 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:48:09.470 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:48:10.028 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:48:10.034 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 12.9 MB in 7s (1,750 kB/s) 2024-04-18T20:48:11.430 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-18T20:48:11.446 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:11.507 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-18T20:48:11.510 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 12.9 MB in 9s (1,454 kB/s) 2024-04-18T20:48:11.706 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-04-18T20:48:11.707 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-04-18T20:48:11.880 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:11.881 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:11.881 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:11.881 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:11.881 INFO:teuthology.orchestra.run.smithi194.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:48:11.881 INFO:teuthology.orchestra.run.smithi194.stdout: python2.7-minimal 2024-04-18T20:48:11.882 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:11.882 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-04-18T20:48:11.882 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:11.882 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:48:11.883 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:11.884 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-04-18T20:48:11.884 INFO:teuthology.orchestra.run.smithi194.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:48:11.884 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-04-18T20:48:11.884 INFO:teuthology.orchestra.run.smithi194.stdout: thermald 2024-04-18T20:48:11.928 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-04-18T20:48:11.928 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:11.928 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:48:11.929 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:11.930 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages will be upgraded: 2024-04-18T20:48:11.930 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:48:12.060 INFO:teuthology.orchestra.run.smithi194.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:12.060 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 113 MB of archives. 2024-04-18T20:48:12.060 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:48:12.060 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:48:12.843 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T20:48:12.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:12.916 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T20:48:13.094 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-18T20:48:13.095 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-18T20:48:13.250 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:13.250 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:13.250 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:13.251 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:13.251 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:48:13.251 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-04-18T20:48:13.251 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:13.252 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-18T20:48:13.252 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:13.252 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:48:13.252 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:13.253 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-18T20:48:13.254 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:48:13.254 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-18T20:48:13.254 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2024-04-18T20:48:13.296 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-18T20:48:13.296 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:48:13.296 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:48:13.296 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:48:13.297 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-18T20:48:13.298 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:48:13.442 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:13.442 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 113 MB of archives. 2024-04-18T20:48:13.442 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:48:13.442 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:48:13.574 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:48:13.574 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:48:13.574 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:48:14.961 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:48:15.376 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:48:15.682 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:48:15.780 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 9s (13.0 MB/s) 2024-04-18T20:48:15.988 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:48:16.036 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:48:16.036 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:48:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:48:16.128 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:48:16.605 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:48:16.627 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:48:17.058 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:48:17.264 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:48:17.645 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 113 MB in 10s (11.1 MB/s) 2024-04-18T20:48:17.814 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:48:17.939 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:48:17.943 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:18.010 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:19.814 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:48:19.818 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:19.954 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:48:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:48:20.104 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:48:20.254 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:48:20.276 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:20.544 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:48:20.586 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:20.627 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:48:20.762 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:48:20.762 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:48:20.762 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:48:21.008 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:48:21.016 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 113 MB in 7s (15.5 MB/s) 2024-04-18T20:48:21.028 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:21.057 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:21.072 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:48:21.192 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:48:21.240 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:48:21.644 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 113 MB in 9s (12.2 MB/s) 2024-04-18T20:48:21.855 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:48:22.139 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:48:22.160 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:22.246 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:22.767 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:48:22.788 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:22.825 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:23.114 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:48:23.120 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:23.180 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:23.800 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:48:23.804 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:23.910 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:25.264 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:48:25.285 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:25.364 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:25.833 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:48:25.854 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:25.891 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:26.061 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:48:26.082 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:26.177 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:26.630 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:48:26.650 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:26.688 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:27.604 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:27.712 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:28.045 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:28.274 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:28.586 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:48:28.608 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:48:28.652 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:29.793 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:29.945 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:30.253 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:30.349 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:30.669 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:48:30.692 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:48:30.735 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:32.632 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:32.759 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:33.027 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:33.100 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:33.154 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:33.204 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:33.482 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:48:33.504 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:48:33.521 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:33.548 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:33.635 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:34.163 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:48:34.186 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:48:34.604 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:34.641 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:34.659 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:34.678 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:37.618 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:37.654 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:37.684 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:37.774 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:37.897 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:38.221 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:38.360 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:38.486 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:38.614 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:39.747 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:39.784 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:39.822 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:39.937 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:39.937 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:39.937 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:39.937 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:40.083 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:41.243 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:41.282 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:41.288 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:41.326 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:41.413 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:41.771 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:41.893 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:42.018 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:42.019 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:42.156 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:42.656 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:42.777 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:43.135 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:43.248 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:43.374 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:43.419 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:43.496 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:43.496 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:43.496 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:43.497 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:43.502 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:43.536 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:43.650 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:43.654 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:43.715 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:43.716 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:44.097 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:44.219 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:44.577 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:44.690 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:44.816 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:44.969 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:45.051 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:45.241 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:45.241 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:45.241 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:45.241 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:45.513 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:46.453 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:46.579 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:46.695 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:46.695 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:46.695 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:46.695 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:46.706 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:46.768 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:46.768 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:46.915 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:46.946 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:48.300 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:48.330 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:48.426 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:48.552 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:48.613 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:48.613 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:49.784 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:49.909 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:50.036 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:50.098 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:50.098 INFO:teuthology.orchestra.run.smithi194.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:57.875 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:48:57.876 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:48:57.888 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:57.903 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-04-18T20:48:58.280 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:58.311 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:58.667 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:58.673 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:58.739 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:58.744 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:58.907 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:58.907 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:58.907 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:58.955 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-04-18T20:48:59.428 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-18T20:48:59.449 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-18T20:48:59.449 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-18T20:48:59.449 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:59.450 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-18T20:48:59.451 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:48:59.451 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:48:59.451 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:48:59.451 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-18T20:48:59.451 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:48:59.451 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-18T20:48:59.612 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T20:48:59.760 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:48:59.760 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:48:59.780 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:48:59.864 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:49:01.117 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T20:49:01.133 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:49:01.133 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:49:01.136 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:49:01.171 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:49:01.187 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T20:49:01.192 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2024-04-18T20:49:01.363 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T20:49:01.364 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T20:49:01.495 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:49:01.508 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:49:01.518 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:49:01.518 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:49:01.518 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:49:01.518 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:49:01.518 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:49:01.519 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:49:01.519 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:49:01.519 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:49:01.555 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:49:01.557 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-18T20:49:01.617 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-18T20:49:01.617 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-18T20:49:01.617 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-18T20:49:01.617 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.102.99 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:49:01.618 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-18T20:49:01.619 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T20:49:01.666 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.9ftH0MFSMk 2024-04-18T20:49:01.666 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9ftH0MFSMk 2024-04-18T20:49:01.721 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.9ftH0MFSMk 2024-04-18T20:49:01.834 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:49:01.839 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:49:01.845 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.9ftH0MFSMk is 10KB 2024-04-18T20:49:01.857 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.9ftH0MFSMk 2024-04-18T20:49:01.862 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:01.910 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:49:01.916 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:49:01.917 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T20:49:01.917 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:49:01.917 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:01.985 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:49:01.986 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-04-18T20:49:02.077 INFO:teuthology.orchestra.run.smithi111.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:49:02.077 INFO:teuthology.orchestra.run.smithi111.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:49:02.077 INFO:teuthology.orchestra.run.smithi111.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:49:02.120 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-04-18T20:49:02.448 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:49:02.448 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:49:02.458 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:49:02.475 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2024-04-18T20:49:02.583 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-04-18T20:49:02.603 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-04-18T20:49:02.603 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-04-18T20:49:02.603 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-04-18T20:49:02.603 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.102.99 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:49:02.604 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-04-18T20:49:02.604 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:49:02.605 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:49:02.605 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:49:02.605 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-18T20:49:02.605 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:49:02.605 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-04-18T20:49:02.750 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-18T20:49:02.818 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:49:02.839 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:49:02.887 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:49:03.001 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:49:03.098 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:49:03.163 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:49:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:49:03.180 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:49:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:49:03.209 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:49:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-04-18T20:49:03.250 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:49:03.256 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:49:03.428 INFO:teuthology.orchestra.run.smithi134.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:49:03.429 INFO:teuthology.orchestra.run.smithi134.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:49:03.429 INFO:teuthology.orchestra.run.smithi134.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:49:03.459 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:49:03.465 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:49:03.480 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-04-18T20:49:03.816 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:49:03.821 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:49:03.864 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:49:03.869 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:49:03.951 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-18T20:49:03.993 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:49:03.993 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:49:03.993 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:49:04.009 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-04-18T20:49:04.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-04-18T20:49:04.016 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-18T20:49:04.016 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-18T20:49:04.016 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-18T20:49:04.016 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-18T20:49:04.016 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.102.99 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:49:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-18T20:49:04.017 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:49:04.018 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:49:04.018 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:49:04.018 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-18T20:49:04.018 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:49:04.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-18T20:49:04.042 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:49:04.042 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:49:04.055 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:49:04.075 INFO:teuthology.orchestra.run.smithi194.stdout:Generating grub configuration file ... 2024-04-18T20:49:04.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-18T20:49:04.271 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-18T20:49:04.287 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:49:04.326 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:49:04.349 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:49:04.349 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:49:04.350 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-18T20:49:04.352 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:49:04.364 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:49:04.385 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:49:04.550 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-18T20:49:04.551 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-18T20:49:04.670 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:49:04.675 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:49:04.728 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:49:04.728 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:49:04.728 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:49:04.728 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:49:04.728 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:49:04.729 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:49:04.729 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:49:04.729 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:49:04.746 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:49:04.751 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:49:04.770 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:49:04.772 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-04-18T20:49:04.784 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-04-18T20:49:04.785 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-04-18T20:49:04.785 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-04-18T20:49:04.785 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-04-18T20:49:04.785 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-04-18T20:49:04.785 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:49:04.785 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-04-18T20:49:04.785 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-04-18T20:49:04.786 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.102.99 2024-04-18T20:49:04.786 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:49:04.786 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:49:04.786 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-04-18T20:49:04.786 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-04-18T20:49:04.786 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:49:04.787 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-04-18T20:49:04.787 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-18T20:49:04.836 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.l2DAsHfhYH 2024-04-18T20:49:04.836 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.l2DAsHfhYH 2024-04-18T20:49:04.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.l2DAsHfhYH 2024-04-18T20:49:04.914 INFO:teuthology.orchestra.run.smithi194.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:49:04.914 INFO:teuthology.orchestra.run.smithi194.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:49:04.914 INFO:teuthology.orchestra.run.smithi194.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:49:04.958 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-04-18T20:49:05.013 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.l2DAsHfhYH is 10KB 2024-04-18T20:49:05.025 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.l2DAsHfhYH 2024-04-18T20:49:05.030 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:05.084 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T20:49:05.084 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:49:05.084 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:05.185 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:49:05.185 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2024-04-18T20:49:05.458 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-04-18T20:49:05.538 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-04-18T20:49:05.538 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.102.99 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:49:05.539 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-04-18T20:49:05.539 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:49:05.540 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:49:05.540 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:49:05.540 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-18T20:49:05.540 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:49:05.540 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-04-18T20:49:05.710 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T20:49:05.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:49:05.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-04-18T20:49:05.790 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T20:49:05.917 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:49:05.928 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:49:05.948 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:49:05.977 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-18T20:49:05.978 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-18T20:49:06.034 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:49:06.132 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:49:06.132 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:49:06.132 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:49:06.132 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:49:06.132 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:49:06.133 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:49:06.133 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:49:06.133 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:49:06.172 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:49:06.174 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-18T20:49:06.189 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-18T20:49:06.190 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.102.99 2024-04-18T20:49:06.190 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:49:06.190 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:49:06.190 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-18T20:49:06.190 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-18T20:49:06.190 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:49:06.190 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-18T20:49:06.190 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-18T20:49:06.235 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.UTmWPpqYq8 2024-04-18T20:49:06.236 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.UTmWPpqYq8 2024-04-18T20:49:06.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.UTmWPpqYq8 2024-04-18T20:49:06.392 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:49:06.394 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:49:06.396 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-04-18T20:49:06.405 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.UTmWPpqYq8 is 10KB 2024-04-18T20:49:06.417 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.UTmWPpqYq8 2024-04-18T20:49:06.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:06.475 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T20:49:06.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:49:06.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:06.540 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:49:06.540 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2024-04-18T20:49:06.569 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:49:06.576 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:49:06.841 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:49:06.846 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:49:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:49:06.892 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:49:06.993 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:49:06.993 INFO:teuthology.orchestra.run.smithi111.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:49:06.993 INFO:teuthology.orchestra.run.smithi111.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:49:07.009 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-04-18T20:49:07.011 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-04-18T20:49:07.318 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-18T20:49:07.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:49:07.389 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-18T20:49:07.576 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-04-18T20:49:07.576 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-04-18T20:49:07.735 INFO:teuthology.orchestra.run.smithi194.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:49:07.735 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:49:07.735 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:49:07.735 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:49:07.735 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:49:07.735 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:49:07.736 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:49:07.736 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:49:07.774 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:49:07.776 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-04-18T20:49:07.823 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:49:07.824 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:49:07.831 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-04-18T20:49:07.833 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-04-18T20:49:07.833 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-04-18T20:49:07.833 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-04-18T20:49:07.833 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.102.99 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:49:07.834 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-04-18T20:49:07.834 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-04-18T20:49:07.879 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.9otLs4SJ1c 2024-04-18T20:49:07.879 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9otLs4SJ1c 2024-04-18T20:49:07.948 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.9otLs4SJ1c 2024-04-18T20:49:07.983 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:49:07.989 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:49:08.058 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.9otLs4SJ1c is 10KB 2024-04-18T20:49:08.071 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.9otLs4SJ1c 2024-04-18T20:49:08.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:08.130 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T20:49:08.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:49:08.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:49:08.196 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:49:08.197 DEBUG:teuthology.orchestra.run.smithi194:> sudo update-grub 2024-04-18T20:49:08.271 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:49:08.276 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:49:08.320 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:49:08.325 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:49:08.456 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:49:08.456 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:49:08.456 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:49:08.472 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-04-18T20:49:08.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-04-18T20:49:09.586 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:49:09.587 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:49:09.591 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-04-18T20:49:09.783 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:49:09.788 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:49:10.052 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:49:10.057 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:49:10.095 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:49:10.100 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:49:10.209 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:49:10.209 INFO:teuthology.orchestra.run.smithi194.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:49:10.209 INFO:teuthology.orchestra.run.smithi194.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:49:10.219 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-04-18T20:49:10.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-04-18T20:49:34.035 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T20:49:34.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T20:49:34.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:37.014 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-18T20:49:37.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:49:37.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:38.485 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-18T20:49:38.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:49:38.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:40.234 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-18T20:49:40.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-18T20:49:40.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:52.418 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T20:49:55.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T20:49:57.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-18T20:49:58.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-18T20:50:01.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T20:50:01.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:04.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T20:50:04.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:50:04.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:06.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:50:06.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:07.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T20:50:07.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-18T20:50:07.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:09.086 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-18T20:50:10.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-18T20:50:16.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T20:50:16.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:19.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:50:19.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:21.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:50:21.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:22.623 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T20:50:22.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-18T20:50:22.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:24.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-18T20:50:34.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T20:50:37.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:50:37.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:39.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:50:39.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:41.058 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-18T20:50:42.241 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-18T20:50:49.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T20:50:49.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:50.774 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-18T20:50:51.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T20:50:51.412 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T20:50:51.413 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-18T20:50:51.458 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-102-generic 2024-04-18T20:50:51.459 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:50:51.459 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:50:51.459 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:50:52.461 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-18T20:50:52.462 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:50:52.545 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-04-18T20:50:52.576 DEBUG:teuthology.parallel:result is None 2024-04-18T20:50:56.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-18T20:50:56.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:56.162 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T20:50:56.501 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-04-18T20:50:57.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-18T20:50:57.074 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-102-generic"... 2024-04-18T20:50:57.074 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-04-18T20:50:57.120 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-102-generic 2024-04-18T20:50:57.121 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:50:57.121 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:50:57.121 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:50:58.122 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-18T20:50:58.123 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:50:58.211 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-04-18T20:50:58.226 DEBUG:teuthology.parallel:result is None 2024-04-18T20:51:00.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:51:00.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:51:00.448 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-18T20:51:01.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:51:01.146 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-102-generic"... 2024-04-18T20:51:01.147 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-18T20:51:01.194 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-102-generic 2024-04-18T20:51:01.194 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:51:01.194 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:51:01.194 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:51:02.196 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-18T20:51:02.197 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:51:02.542 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-04-18T20:51:02.576 DEBUG:teuthology.parallel:result is None 2024-04-18T20:51:14.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:51:14.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:51:14.541 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-18T20:51:15.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:51:15.156 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-102-generic"... 2024-04-18T20:51:15.157 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-18T20:51:15.204 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-102-generic 2024-04-18T20:51:15.204 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:51:15.204 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:51:15.204 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:51:16.205 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-18T20:51:16.206 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:51:16.542 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-04-18T20:51:16.586 DEBUG:teuthology.parallel:result is None 2024-04-18T20:51:16.586 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-18T20:51:16.607 INFO:teuthology.task.internal:Creating test directory... 2024-04-18T20:51:16.607 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:16.627 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:16.640 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:16.659 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:16.673 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-18T20:51:16.701 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-18T20:51:16.709 INFO:teuthology.task.internal:Creating archive directory... 2024-04-18T20:51:16.710 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:16.716 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:16.718 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:16.722 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:17.021 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-18T20:51:17.028 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-18T20:51:17.029 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:17.032 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:17.036 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:17.044 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:17.061 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.062 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.062 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.068 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.069 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.070 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.071 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.077 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:17.078 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-18T20:51:17.086 INFO:teuthology.task.internal:Configuring sudo... 2024-04-18T20:51:17.086 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:17.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:17.118 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:17.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:17.134 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-18T20:51:17.143 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-18T20:51:17.143 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:17.171 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:17.181 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:17.185 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:17.192 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:17.231 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:17.279 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T20:51:17.279 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:17.342 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:17.347 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:17.396 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T20:51:17.396 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:17.468 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:17.474 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:17.526 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T20:51:17.526 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:17.596 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:17.602 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:17.650 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T20:51:17.650 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:17.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-04-18T20:51:17.719 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-04-18T20:51:17.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-18T20:51:17.723 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-04-18T20:51:17.791 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-18T20:51:17.798 INFO:teuthology.task.internal:Starting timer... 2024-04-18T20:51:17.799 INFO:teuthology.run_tasks:Running task pcp... 2024-04-18T20:51:17.823 INFO:teuthology.run_tasks:Running task selinux... 2024-04-18T20:51:17.877 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:17.877 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:17.877 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:17.877 DEBUG:teuthology.task.selinux:Excluding smithi194: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:17.877 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-18T20:51:17.877 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-18T20:51:17.877 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-18T20:51:17.877 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-18T20:51:17.899 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-18T20:51:17.974 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-18T20:51:17.975 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi111.front.sepia.ceph.com,smithi134.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-18T20:59:20.860 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-04-18T20:59:20.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T20:59:20.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:20.941 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-18T20:59:21.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T20:59:21.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:59:21.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:21.101 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-18T20:59:21.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T20:59:21.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:59:21.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:21.256 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-18T20:59:21.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T20:59:21.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-18T20:59:21.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:21.414 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-04-18T20:59:21.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-18T20:59:21.491 INFO:teuthology.run_tasks:Running task clock... 2024-04-18T20:59:21.500 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-18T20:59:21.500 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:21.501 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:21.503 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:21.504 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:21.506 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:21.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:21.508 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:21.509 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:21.530 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:21.531 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Command line: ntpd -gq 2024-04-18T20:59:21.531 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: ---------------------------------------------------- 2024-04-18T20:59:21.531 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:21.531 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:21.531 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:21.531 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: available at https://www.nwtime.org/support 2024-04-18T20:59:21.531 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: ---------------------------------------------------- 2024-04-18T20:59:21.532 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: proto: precision = 0.061 usec (-24) 2024-04-18T20:59:21.532 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: basedate set to 2022-02-04 2024-04-18T20:59:21.532 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:21.532 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.532 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.532 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.533 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.533 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-04-18T20:59:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-04-18T20:59:21.534 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:21 ntpd[17179]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:21.535 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:21.535 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Command line: ntpd -gq 2024-04-18T20:59:21.535 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: ---------------------------------------------------- 2024-04-18T20:59:21.535 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:21.535 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:21.535 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: available at https://www.nwtime.org/support 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: ---------------------------------------------------- 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: proto: precision = 0.051 usec (-24) 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: basedate set to 2022-02-04 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.537 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.537 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:21.538 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:21.538 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:21.538 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-04-18T20:59:21.538 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:21.538 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-04-18T20:59:21.538 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:21 ntpd[17190]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:21.539 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Command line: ntpd -gq 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: ---------------------------------------------------- 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: available at https://www.nwtime.org/support 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: ---------------------------------------------------- 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: proto: precision = 0.045 usec (-24) 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: basedate set to 2022-02-04 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.540 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.541 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.541 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.541 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:21.542 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:21.542 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:21.542 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-04-18T20:59:21.542 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:21.542 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-04-18T20:59:21.542 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:21 ntpd[17188]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:21.560 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:21.560 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Command line: ntpd -gq 2024-04-18T20:59:21.560 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: ---------------------------------------------------- 2024-04-18T20:59:21.561 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:21.561 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:21.561 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:21.561 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: available at https://www.nwtime.org/support 2024-04-18T20:59:21.561 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: ---------------------------------------------------- 2024-04-18T20:59:21.561 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: proto: precision = 0.043 usec (-24) 2024-04-18T20:59:21.562 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: basedate set to 2022-02-04 2024-04-18T20:59:21.562 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:21.562 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.562 INFO:teuthology.orchestra.run.smithi194.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:21.562 INFO:teuthology.orchestra.run.smithi194.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.563 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:21.563 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:21.563 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:21.563 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:21.563 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Listen normally on 3 enp3s0f1 172.21.15.194:123 2024-04-18T20:59:21.563 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:21.563 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea5%5]:123 2024-04-18T20:59:21.564 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:21 ntpd[17264]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:22 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:22 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:22 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:22.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:22.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:22.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:22 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:22.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:22.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:22 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:24 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:24 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:24 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:24 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:24 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:24 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:24.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:24.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:24 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:24.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:24.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:24 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:25 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:25 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:25 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:25 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:25 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:25 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:25.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:25.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:25 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:25.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:25.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:25 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:25.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:25 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:25.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:25 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:25.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:25 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:25.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:25 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:25.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:25 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:25.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:25 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:25.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:25 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:25.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:25 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:26 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:26 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.539 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.539 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.539 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.539 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.539 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:26 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:26.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:26.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:26.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:26 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:27.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:27 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:27.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:27 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:27.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:27 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:27.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:27 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:27.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:27 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:27.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:27 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:27.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:27.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:27 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:27.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:27.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:27 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:27.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:27 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:27.533 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:27 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:27.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:27 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:27.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:27 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:27.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:27 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:27.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:27 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:27.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:27 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:27.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:27 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:28 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:28.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:28 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.537 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:28.538 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 20:59:28 ntpd[17188]: ntpd: time slew -0.001032 s 2024-04-18T20:59:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.001032s 2024-04-18T20:59:28.539 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:28.539 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 20:59:28 ntpd[17188]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:28.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.561 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi194.stdout:18 Apr 20:59:28 ntpd[17264]: ntpd: time slew -0.000590 s 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi194.stdout:ntpd: time slew -0.000590s 2024-04-18T20:59:28.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:28.563 INFO:teuthology.orchestra.run.smithi194.stderr:18 Apr 20:59:28 ntpd[17264]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:28.589 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-18T20:59:28.590 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:28.590 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:28.590 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:28.590 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:28.618 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:28.618 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-04-18T20:59:28.618 INFO:teuthology.orchestra.run.smithi194.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:28.618 INFO:teuthology.orchestra.run.smithi194.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:28.618 INFO:teuthology.orchestra.run.smithi194.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:28.618 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:29 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:29 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:29 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:29 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:29 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:29 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:29.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:29.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:29 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:29 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:29 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:29 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:30.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:30.533 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:30 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stdout:18 Apr 20:59:30 ntpd[17190]: ntpd: time slew -0.001298 s 2024-04-18T20:59:30.534 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew -0.001298s 2024-04-18T20:59:30.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:30.535 INFO:teuthology.orchestra.run.smithi111.stderr:18 Apr 20:59:30 ntpd[17190]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:30.580 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-04-18T20:59:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:31.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:31.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:31.531 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:31.532 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 20:59:31 ntpd[17179]: ntpd: time slew -0.000817 s 2024-04-18T20:59:31.532 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.000817s 2024-04-18T20:59:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 20:59:31 ntpd[17179]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:31.587 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:31.587 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-18T20:59:31.587 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:31.588 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:31.588 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:31.588 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:31.588 INFO:teuthology.run_tasks:Running task install... 2024-04-18T20:59:31.597 DEBUG:teuthology.task.install:project ceph 2024-04-18T20:59:31.597 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}} 2024-04-18T20:59:31.597 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'} 2024-04-18T20:59:31.597 INFO:teuthology.task.install:Using flavor: default 2024-04-18T20:59:31.603 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T20:59:31.603 INFO:teuthology.task.install:extra packages: [] 2024-04-18T20:59:31.604 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-04-18T20:59:31.604 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2024-04-18T20:59:31.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-04-18T20:59:31.605 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-key list | grep Ceph 2024-04-18T20:59:31.668 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:31.668 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:31.669 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:31.696 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:31.696 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:31.697 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:31.697 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:31.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:31.701 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:31.701 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:31.701 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:31.702 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:31.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:31.717 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:31.717 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:31.718 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:31.718 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:31.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:31.746 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:31.746 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:31.746 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:31.746 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:31.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:31.854 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:31.855 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:31.862 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:31.862 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:31.885 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:31.885 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:31.905 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:31.905 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:32.201 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T20:59:32.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:32.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-18T20:59:32.230 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T20:59:32.230 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:32.235 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T20:59:32.235 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:32.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-04-18T20:59:32.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T20:59:32.275 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T20:59:32.275 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:32.289 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-18T20:59:32.388 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:32.400 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:32.415 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:32.420 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:32.420 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:32.434 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:32.454 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:32.461 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:32.475 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:32.497 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:32.502 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:32.529 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:32.537 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:32.576 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:32.611 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:32.673 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:32.693 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:32.706 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:32.721 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:32.742 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:32.749 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:32.796 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:32.801 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:32.826 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:32.834 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:32.875 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:32.889 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:32.901 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:32.927 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:32.951 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:32.984 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:32.986 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:33.035 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:33.039 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:33.099 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:33.129 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 29.2 kB in 1s (45.0 kB/s) 2024-04-18T20:59:33.144 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:33.144 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 29.2 kB in 1s (40.7 kB/s) 2024-04-18T20:59:33.189 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 29.2 kB in 1s (37.5 kB/s) 2024-04-18T20:59:33.231 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 29.2 kB in 1s (36.8 kB/s) 2024-04-18T20:59:34.052 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-18T20:59:34.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:34.112 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-18T20:59:34.126 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:34.134 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-18T20:59:34.188 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-18T20:59:34.189 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T20:59:34.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:34.241 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T20:59:34.257 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:34.266 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T20:59:34.320 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T20:59:34.341 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-04-18T20:59:34.341 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-04-18T20:59:34.387 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-18T20:59:34.387 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-18T20:59:34.476 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-18T20:59:34.476 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-18T20:59:34.520 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T20:59:34.521 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T20:59:34.536 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:34.537 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:34.538 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-04-18T20:59:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet zip 2024-04-18T20:59:34.541 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-04-18T20:59:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: btrfs-tools 2024-04-18T20:59:34.569 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:34.569 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:34.569 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:34.569 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:34.569 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:34.570 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:34.570 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:34.570 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-18T20:59:34.570 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:34.571 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:34.571 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:34.571 INFO:teuthology.orchestra.run.smithi111.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:34.571 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:34.571 INFO:teuthology.orchestra.run.smithi111.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:34.572 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet zip 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:34.573 INFO:teuthology.orchestra.run.smithi111.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:34.574 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:34.574 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:34.574 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-04-18T20:59:34.574 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2024-04-18T20:59:34.642 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-04-18T20:59:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:34.673 INFO:teuthology.orchestra.run.smithi111.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:34.674 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:34.675 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:34.675 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:34.675 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:34.675 INFO:teuthology.orchestra.run.smithi111.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:34.680 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:34.682 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:34.685 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-18T20:59:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet zip 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-18T20:59:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-04-18T20:59:34.710 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:34.711 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:34.711 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:34.711 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:34.715 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:34.716 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:34.717 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T20:59:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet zip 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T20:59:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-18T20:59:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-04-18T20:59:34.749 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:34.749 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:34.749 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:34.749 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:34.786 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.787 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:34.788 INFO:teuthology.orchestra.run.smithi134.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:34.820 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T20:59:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:34.824 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:34.829 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:34.848 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:34.871 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:34.875 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:34.890 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:34.890 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:34.890 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:34.890 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:34.898 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:34.927 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:34.932 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:34.946 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:34.950 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:34.951 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:34.952 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:34.961 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:34.963 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:34.966 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:34.967 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:34.972 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:34.972 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:34.972 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:34.972 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:34.977 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:34.979 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:34.982 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:34.982 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:34.984 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:34.986 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:34.987 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:34.995 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:35.000 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:35.000 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:35.003 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:35.004 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:35.004 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:35.004 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:35.004 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:35.004 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:35.010 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:35.013 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:35.015 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:35.015 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:35.016 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:35.020 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:35.021 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:35.021 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:35.022 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:35.024 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:35.025 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:35.025 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:35.026 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:35.028 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:35.029 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:35.041 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:35.041 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:35.043 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:35.043 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:35.045 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:35.047 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:35.047 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:35.047 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:35.048 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:35.049 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:35.049 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:35.049 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:35.050 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:35.061 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:35.062 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:35.063 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:35.068 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:35.068 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:35.069 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:35.069 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:35.069 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:35.081 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:35.082 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:35.083 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:35.085 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:35.086 INFO:teuthology.orchestra.run.smithi194.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:35.088 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:35.088 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:35.089 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:35.089 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:35.102 INFO:teuthology.orchestra.run.smithi194.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:35.102 INFO:teuthology.orchestra.run.smithi194.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:35.105 INFO:teuthology.orchestra.run.smithi194.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:35.106 INFO:teuthology.orchestra.run.smithi194.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:35.107 INFO:teuthology.orchestra.run.smithi194.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:35.110 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:35.111 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:35.111 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:35.116 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:35.121 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:35.125 INFO:teuthology.orchestra.run.smithi194.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:35.134 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:35.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:35.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:35.139 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:35.151 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:35.151 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:35.151 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:35.151 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:35.153 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:35.154 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:35.156 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:35.158 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:35.160 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:35.167 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:35.170 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:35.174 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:35.188 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:35.189 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:35.189 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:35.193 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:35.196 INFO:teuthology.orchestra.run.smithi194.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:35.197 INFO:teuthology.orchestra.run.smithi194.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:35.198 INFO:teuthology.orchestra.run.smithi194.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:35.199 INFO:teuthology.orchestra.run.smithi194.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:35.200 INFO:teuthology.orchestra.run.smithi194.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:35.207 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:35.212 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:35.216 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:35.220 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:35.221 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:35.222 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:35.224 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:35.224 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:35.225 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:35.228 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:35.228 INFO:teuthology.orchestra.run.smithi194.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:35.229 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:35.231 INFO:teuthology.orchestra.run.smithi194.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:35.232 INFO:teuthology.orchestra.run.smithi194.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:35.234 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:35.272 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:35.276 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:35.277 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:35.277 INFO:teuthology.orchestra.run.smithi194.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:35.277 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:35.278 INFO:teuthology.orchestra.run.smithi194.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:35.282 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:35.283 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:35.284 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:35.285 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:35.287 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:35.298 INFO:teuthology.orchestra.run.smithi194.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:35.298 INFO:teuthology.orchestra.run.smithi194.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:35.299 INFO:teuthology.orchestra.run.smithi194.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:35.300 INFO:teuthology.orchestra.run.smithi194.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:35.301 INFO:teuthology.orchestra.run.smithi194.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:35.301 INFO:teuthology.orchestra.run.smithi194.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:35.306 INFO:teuthology.orchestra.run.smithi194.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:35.310 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:35.314 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:35.314 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:35.316 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:35.316 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:35.317 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:35.323 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:35.325 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:35.327 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:35.327 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:35.336 INFO:teuthology.orchestra.run.smithi194.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:35.338 INFO:teuthology.orchestra.run.smithi194.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:35.338 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:35.338 INFO:teuthology.orchestra.run.smithi194.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:35.339 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:35.340 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:35.341 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:35.347 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:35.350 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:35.351 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:35.351 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:35.357 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:35.369 INFO:teuthology.orchestra.run.smithi194.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:35.373 INFO:teuthology.orchestra.run.smithi194.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:35.375 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:35.375 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:35.375 INFO:teuthology.orchestra.run.smithi194.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:35.376 INFO:teuthology.orchestra.run.smithi194.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:35.380 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:35.382 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:35.384 INFO:teuthology.orchestra.run.smithi194.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:35.384 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:35.385 INFO:teuthology.orchestra.run.smithi194.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:35.386 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:35.391 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:35.391 INFO:teuthology.orchestra.run.smithi194.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:35.392 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:35.393 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:35.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:35.396 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:35.396 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:35.397 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:35.397 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:35.398 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:35.398 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:35.403 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:35.417 INFO:teuthology.orchestra.run.smithi194.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:35.419 INFO:teuthology.orchestra.run.smithi194.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:35.419 INFO:teuthology.orchestra.run.smithi194.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:35.428 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:35.430 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:35.431 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:35.445 INFO:teuthology.orchestra.run.smithi194.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:35.446 INFO:teuthology.orchestra.run.smithi194.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:35.461 INFO:teuthology.orchestra.run.smithi194.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:35.462 INFO:teuthology.orchestra.run.smithi194.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:35.463 INFO:teuthology.orchestra.run.smithi194.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:35.467 INFO:teuthology.orchestra.run.smithi194.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:35.469 INFO:teuthology.orchestra.run.smithi194.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:35.472 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:35.473 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:35.478 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:35.480 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:35.481 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:35.487 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:35.489 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:35.489 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:35.491 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:35.492 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:35.493 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:35.499 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:35.518 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:35.521 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:35.522 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:35.522 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:35.523 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:35.524 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:35.542 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:35.542 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:35.543 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:35.543 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:35.549 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:35.550 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:35.550 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:35.551 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:35.551 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:35.552 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:35.558 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:35.559 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:35.559 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:35.564 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:35.565 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:35.577 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:35.579 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:35.582 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:35.582 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:35.598 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:35.601 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:35.602 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:35.602 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:35.607 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:35.608 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:35.621 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:35.621 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:35.621 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:35.621 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:35.640 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:35.641 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:35.648 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:35.649 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:35.649 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:35.651 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:35.661 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:35.950 INFO:teuthology.orchestra.run.smithi194.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:35.962 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:36.374 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:36.408 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:36.410 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:36.490 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:36.541 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:36.563 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:36.568 INFO:teuthology.orchestra.run.smithi194.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:36.570 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:36.571 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:36.582 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:36.583 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:36.657 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:36.697 INFO:teuthology.orchestra.run.smithi194.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:36.749 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:36.758 INFO:teuthology.orchestra.run.smithi194.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:36.761 INFO:teuthology.orchestra.run.smithi194.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:36.776 INFO:teuthology.orchestra.run.smithi194.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:36.825 INFO:teuthology.orchestra.run.smithi194.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:36.832 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:36.845 INFO:teuthology.orchestra.run.smithi194.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:36.860 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:36.877 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:36.922 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:37.132 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:37.147 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:37.155 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:37.160 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:37.181 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:37.184 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:37.350 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:37.680 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:37.719 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:37.732 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:37.819 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:37.939 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:37.946 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:37.951 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:37.966 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:37.987 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:37.993 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:38.168 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:38.171 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:38.329 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:38.332 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:38.332 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:38.426 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:38.477 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:38.481 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:38.534 INFO:teuthology.orchestra.run.smithi194.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:38.604 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:38.617 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:38.635 INFO:teuthology.orchestra.run.smithi194.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:38.635 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:38.637 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:38.702 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:38.707 INFO:teuthology.orchestra.run.smithi194.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T20:59:38.990 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:38.992 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:38.995 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:38.996 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:38.998 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:39.224 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:39.660 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:39.666 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:39.956 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:39.957 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:39.959 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:39.961 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:39.962 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:39.964 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:39.965 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:39.967 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:40.083 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:40.148 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:40.487 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:40.554 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:40.601 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:40.620 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:40.720 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:40.731 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:40.732 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:40.772 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:40.783 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:40.788 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:40.826 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:40.835 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:40.838 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:40.860 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:40.913 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:41.024 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:41.098 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:41.287 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:41.306 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:41.457 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:41.486 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:41.643 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:41.645 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:41.647 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:41.670 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:41.793 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:41.865 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:42.003 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:42.101 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T20:59:47.318 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:48.409 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:48.890 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:48.956 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:48.979 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:49.175 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:49.196 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:49.264 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:49.688 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:49.809 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T20:59:58.025 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:58.269 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:59.400 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T21:00:01.333 INFO:teuthology.orchestra.run.smithi194.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T21:00:01.894 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T21:00:05.956 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:06.194 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:06.277 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:07.190 INFO:teuthology.orchestra.run.smithi194.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:07.406 INFO:teuthology.orchestra.run.smithi194.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:07.541 INFO:teuthology.orchestra.run.smithi194.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:09.359 INFO:teuthology.orchestra.run.smithi194.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:12.991 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:18.681 INFO:teuthology.orchestra.run.smithi194.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:32.624 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T21:00:34.744 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:00:34.745 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:00:35.564 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:00:36.332 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T21:00:38.833 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:39.099 INFO:teuthology.orchestra.run.smithi111.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:39.228 INFO:teuthology.orchestra.run.smithi111.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:40.217 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:00:40.218 INFO:teuthology.orchestra.run.smithi194.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:00:40.219 INFO:teuthology.orchestra.run.smithi194.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:00:40.776 INFO:teuthology.orchestra.run.smithi194.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:00:40.785 INFO:teuthology.orchestra.run.smithi111.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:41.316 INFO:teuthology.orchestra.run.smithi134.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:00:41.512 INFO:teuthology.orchestra.run.smithi134.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:00:42.681 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:42.935 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:42.990 INFO:teuthology.orchestra.run.smithi194.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:00:43.084 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:43.919 INFO:teuthology.orchestra.run.smithi194.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:00:44.011 INFO:teuthology.orchestra.run.smithi134.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:00:44.115 INFO:teuthology.orchestra.run.smithi194.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:00:44.853 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:47.010 INFO:teuthology.orchestra.run.smithi194.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:00:50.565 INFO:teuthology.orchestra.run.smithi111.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:54.834 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:56.107 INFO:teuthology.orchestra.run.smithi134.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:00:56.113 INFO:teuthology.orchestra.run.smithi134.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:00:56.850 INFO:teuthology.orchestra.run.smithi194.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:00:56.883 INFO:teuthology.orchestra.run.smithi194.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:01:26.940 INFO:teuthology.orchestra.run.smithi111.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:01:26.941 INFO:teuthology.orchestra.run.smithi111.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:01:27.710 INFO:teuthology.orchestra.run.smithi111.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:01:30.043 INFO:teuthology.orchestra.run.smithi111.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:01:30.718 INFO:teuthology.orchestra.run.smithi111.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:01:30.838 INFO:teuthology.orchestra.run.smithi111.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:01:33.038 INFO:teuthology.orchestra.run.smithi111.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:01:39.101 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:01:39.133 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:01:39.869 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:01:41.134 INFO:teuthology.orchestra.run.smithi134.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:01:41.261 INFO:teuthology.orchestra.run.smithi134.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:01:41.291 INFO:teuthology.orchestra.run.smithi134.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:01:42.018 INFO:teuthology.orchestra.run.smithi111.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:01:42.023 INFO:teuthology.orchestra.run.smithi111.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:01:42.146 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:01:42.883 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:01:43.006 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:01:45.593 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:01:55.186 INFO:teuthology.orchestra.run.smithi134.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 181 MB in 2min 20s (1,289 kB/s) 2024-04-18T21:01:55.960 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:01:56.055 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:01:56.060 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:01:56.133 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:01:56.420 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:01:56.447 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:01:56.487 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:01:56.831 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:01:56.858 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:01:56.898 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:01:57.343 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:01:57.370 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:01:57.418 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:01:57.805 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:01:57.831 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:01:57.871 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:01:58.053 INFO:teuthology.orchestra.run.smithi096.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:01:58.072 INFO:teuthology.orchestra.run.smithi096.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:01:58.216 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:01:58.242 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:01:58.282 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:01:58.538 INFO:teuthology.orchestra.run.smithi194.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:01:58.635 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:01:58.661 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:01:58.683 INFO:teuthology.orchestra.run.smithi194.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:01:58.702 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:01:58.721 INFO:teuthology.orchestra.run.smithi194.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:01:58.997 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-04-18T21:01:59.023 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:01:59.063 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:01:59.524 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:01:59.550 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:01:59.591 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:00.044 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:00.110 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:00.371 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:02:00.386 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:00.740 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:02:00.767 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:00.807 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:01.068 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:01.083 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:01.126 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:01.397 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:01.413 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:01.447 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:01.758 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:01.785 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:02.505 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:02.532 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:02.572 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:02.875 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:02.890 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:02.924 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:03.194 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:03.221 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:03.260 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:03.580 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:03.596 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:03.646 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:03.983 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:04.009 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:04.049 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:04.369 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:04.395 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:04.436 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:04.671 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:04.687 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:05.462 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:05.488 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:05.528 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:05.928 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:05.954 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:05.994 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:06.546 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:06.561 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:06.604 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:06.783 INFO:teuthology.orchestra.run.smithi194.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:02:06.908 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:06.934 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:06.966 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:07.269 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:07.295 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:07.335 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:07.342 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 181 MB in 2min 32s (1,190 kB/s) 2024-04-18T21:02:07.472 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:02:07.570 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:02:07.576 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:02:07.646 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:02:07.764 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:07.790 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:07.830 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:07.958 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:02:07.984 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:02:08.024 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:08.360 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:02:08.386 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:08.426 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:08.830 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:02:08.856 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:08.897 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:09.253 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:09.302 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:09.408 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:02:09.434 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:09.475 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:09.828 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:02:09.854 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:09.864 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:09.891 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:09.894 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:09.931 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:10.205 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:02:10.231 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:02:10.234 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:10.260 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:10.272 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:02:10.300 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:10.533 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librados2. 2024-04-18T21:02:10.559 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:10.599 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:10.653 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:10.680 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:10.720 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:11.023 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:11.044 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:02:11.049 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:11.089 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:11.111 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:11.555 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:02:11.581 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:11.592 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:11.619 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:11.621 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:11.650 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:11.891 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:02:11.917 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:11.919 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:11.946 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:11.949 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:11.986 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:12.252 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:02:12.272 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:02:12.278 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:12.299 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:02:12.347 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:02:12.351 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:12.621 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:12.647 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:12.658 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:02:12.685 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:02:12.687 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:12.725 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:02:12.973 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:12.986 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:02:12.999 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:13.013 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:02:13.031 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:13.044 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:02:13.326 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:13.352 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:13.373 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:02:13.393 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:13.400 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:02:13.439 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:02:13.704 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:13.717 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:02:13.730 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:13.733 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:02:13.767 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:02:13.770 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:14.006 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:14.011 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:02:14.021 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:14.027 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:02:14.064 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:14.070 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:14.373 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:02:14.400 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:02:14.409 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:14.435 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:14.439 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:02:14.476 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:14.753 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:14.759 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:02:14.768 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:14.786 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:02:14.811 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:14.826 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:02:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:02:15.123 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:15.138 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:02:15.149 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:15.178 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:02:15.189 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:15.423 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:02:15.501 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:15.528 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:15.568 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:02:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:02:15.887 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:15.902 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:15.911 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:15.945 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:16.214 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:16.220 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:02:16.240 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:16.247 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:02:16.281 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:16.286 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:16.559 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:16.585 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:16.590 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:02:16.617 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:02:16.625 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:16.656 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:02:16.984 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:02:17.000 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:02:17.021 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:17.042 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:17.047 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:17.088 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:17.345 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:02:17.372 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:02:17.412 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:02:17.504 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:17.530 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:17.570 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:17.698 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:02:17.725 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:02:17.765 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:02:18.001 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:02:18.028 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:02:18.059 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:02:18.106 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:18.132 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:18.172 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:18.380 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:02:18.407 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:02:18.447 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:18.475 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:18.501 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:18.542 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:18.775 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:02:18.802 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:02:18.841 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:02:18.853 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:18.879 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:18.919 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:19.211 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:02:19.238 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:02:19.277 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:02:19.339 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:19.366 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:19.406 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:19.589 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:02:19.616 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:02:19.655 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:02:19.942 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:02:19.969 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:02:20.008 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:02:20.303 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:02:20.330 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:20.369 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:20.716 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:02:20.743 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:20.769 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:20.782 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:20.795 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:20.845 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:21.077 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:02:21.104 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:02:21.143 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:21.423 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:21.446 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:02:21.450 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:21.473 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:02:21.490 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:21.512 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:02:21.784 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:21.811 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:21.851 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:21.974 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:02:22.001 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:22.040 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:22.162 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:22.189 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:22.229 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:22.394 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:02:22.420 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:22.485 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:22.548 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:22.575 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:22.615 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:22.926 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:22.952 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:22.993 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:23.146 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:23.287 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:23.314 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:23.354 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:23.657 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:02:23.683 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:02:23.723 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:02:24.001 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:02:24.028 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:02:24.059 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-04-18T21:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:24.224 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:24.362 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:02:24.389 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:02:24.428 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:02:24.477 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:24.535 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:24.782 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:02:24.808 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:02:24.848 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:02:24.913 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:02:24.940 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:24.980 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:25.162 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:02:25.188 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:02:25.228 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:02:25.391 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:02:25.418 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:25.458 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:25.531 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:02:25.557 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:02:25.597 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:25.727 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:02:25.743 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:02:25.802 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:02:25.917 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:02:25.943 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:02:25.983 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:02:26.121 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:02:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:26.188 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:26.312 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:02:26.338 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:02:26.378 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:02:26.656 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:02:26.682 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:02:26.714 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:02:27.000 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:02:27.026 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:02:27.066 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:02:27.251 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:02:27.278 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:27.317 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:27.428 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:02:27.454 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:02:27.498 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:02:27.655 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:02:27.695 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:02:27.839 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:02:27.865 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:02:27.905 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:02:28.033 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:28.073 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:28.208 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:02:28.234 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:02:28.274 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:02:28.343 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:02:28.370 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:02:28.409 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:02:28.586 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:02:28.613 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:02:28.653 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:02:28.739 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:02:28.915 INFO:teuthology.orchestra.run.smithi111.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:02:28.917 INFO:teuthology.orchestra.run.smithi111.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:02:28.919 INFO:teuthology.orchestra.run.smithi111.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:02:28.955 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:02:28.982 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:02:29.022 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:02:29.141 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:02:29.168 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:29.207 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:29.292 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:02:29.318 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:02:29.349 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:02:29.653 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:02:29.679 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:02:29.719 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:02:30.082 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:02:30.109 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:02:30.148 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:30.404 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:02:30.420 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:02:30.454 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:02:30.468 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:02:30.495 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:02:30.534 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:02:30.846 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:02:30.873 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:02:30.912 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:02:30.949 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:02:30.976 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:02:31.015 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:02:31.240 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:02:31.267 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:02:31.307 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:02:31.369 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:02:31.396 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:02:31.435 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:02:31.609 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:02:31.636 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:02:31.667 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:02:31.746 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:02:31.774 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:02:31.954 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:02:31.981 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:32.020 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:32.400 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:02:32.427 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:32.466 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:32.471 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:02:32.499 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:32.631 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:32.803 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:02:32.830 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:02:32.869 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:33.130 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:02:33.145 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:02:33.180 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:02:33.508 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:02:33.535 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:33.560 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:02:33.574 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:33.588 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:02:33.626 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:02:33.929 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:02:33.957 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:02:33.994 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:02:33.996 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:02:34.021 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:34.061 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:34.358 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:02:34.385 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:02:34.432 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:02:34.656 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:02:34.683 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:34.722 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:34.785 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:02:34.813 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:02:34.860 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:02:35.239 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:02:35.266 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:02:35.313 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:02:35.667 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:02:35.694 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:02:35.750 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph. 2024-04-18T21:02:35.777 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:35.817 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.062 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:02:36.089 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:02:36.128 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:02:36.136 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:02:36.163 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:36.203 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.287 INFO:teuthology.orchestra.run.smithi111.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:02:36.440 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:02:36.467 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:02:36.514 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:02:36.572 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:02:36.599 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:36.639 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.750 INFO:teuthology.orchestra.run.smithi096.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:02:36.833 INFO:teuthology.orchestra.run.smithi096.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:02:36.870 INFO:teuthology.orchestra.run.smithi096.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:02:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:02:37.027 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:37.058 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:37.080 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 181 MB in 3min 2s (996 kB/s) 2024-04-18T21:02:37.195 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:02:37.211 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:37.244 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:02:37.253 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:37.344 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:02:37.350 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:02:37.369 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:02:37.396 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:02:37.434 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:02:37.436 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:02:37.531 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:02:37.558 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:02:37.589 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:02:37.747 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:02:37.773 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:37.779 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:02:37.806 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:02:37.813 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:37.846 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:37.894 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:02:37.921 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:02:37.960 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:02:38.174 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:02:38.200 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:38.230 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-04-18T21:02:38.240 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:38.257 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:02:38.296 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:02:38.524 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-04-18T21:02:38.540 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:02:38.574 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:02:38.628 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:02:38.654 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:38.694 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:38.801 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:02:38.829 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:38.867 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:38.869 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:02:38.885 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:02:38.927 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:02:39.097 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:02:39.123 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:39.164 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:39.221 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:02:39.248 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:02:39.287 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:02:39.315 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:02:39.342 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:39.381 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:39.450 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:02:39.476 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:39.516 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:39.648 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:02:39.676 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:39.715 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:39.887 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:02:39.913 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:02:40.060 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:02:40.087 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:02:40.126 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:02:40.248 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2. 2024-04-18T21:02:40.273 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:40.314 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:40.671 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:02:40.697 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:02:40.738 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:02:40.758 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:02:40.784 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:40.817 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:41.057 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:02:41.084 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:41.123 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:41.237 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:02:41.262 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:41.303 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:41.580 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:02:41.595 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:41.603 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:02:41.628 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:41.638 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:41.669 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:41.956 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:02:41.958 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:02:41.972 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:41.984 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:42.024 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:42.268 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:42.270 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:02:42.283 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:42.285 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:02:42.301 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:02:42.320 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:02:42.327 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:42.328 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:02:42.367 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:02:42.605 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:42.631 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:42.671 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:42.688 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:02:42.704 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:02:42.738 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:02:42.807 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:02:42.833 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:02:42.869 INFO:teuthology.orchestra.run.smithi096.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:02:42.873 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:02:42.986 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:43.009 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:43.049 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:43.117 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:02:43.145 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:43.184 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:02:43.276 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:02:43.303 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:02:43.342 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:02:43.368 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:43.394 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:43.431 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 181 MB in 3min 8s (963 kB/s) 2024-04-18T21:02:43.435 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:43.573 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:02:43.606 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:02:43.633 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:02:43.645 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:02:43.667 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:02:43.672 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:02:43.673 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:02:43.673 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:02:43.688 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:43.703 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:43.711 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:02:43.746 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:43.755 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:02:43.917 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:02:43.933 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:02:43.967 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:02:44.057 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:44.083 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:02:44.083 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:44.110 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:02:44.115 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:44.150 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:44.360 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:44.428 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:02:44.456 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:44.470 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:02:44.511 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:02:44.538 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:44.578 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:44.580 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:44.721 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:44.731 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:02:44.736 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:44.758 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:02:44.779 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:44.789 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:02:45.006 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:02:45.032 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:45.080 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:45.101 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:02:45.124 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:45.128 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:02:45.150 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:45.167 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:02:45.190 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:45.451 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:02:45.460 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:45.475 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:45.477 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:45.479 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:02:45.506 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:02:45.509 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:45.510 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:45.533 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:02:45.545 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:02:45.560 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:02:45.599 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:02:45.771 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:45.794 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:45.837 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:45.862 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:02:45.869 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:02:45.884 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:02:45.888 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:45.898 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:02:45.926 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:02:45.927 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:02:45.929 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:45.965 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:02:46.157 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:46.184 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:46.224 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:46.247 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:02:46.275 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:02:46.276 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:02:46.281 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:02:46.304 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:02:46.308 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:02:46.314 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:02:46.343 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:02:46.348 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:02:46.578 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:46.604 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:46.625 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:02:46.634 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-04-18T21:02:46.644 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:46.649 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:46.652 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:02:46.684 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:46.691 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:02:46.814 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:02:46.841 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:02:46.880 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:02:46.977 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:46.995 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:02:47.003 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:47.019 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:02:47.043 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:47.061 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:02:47.137 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:02:47.158 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:02:47.163 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:47.186 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:02:47.203 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:47.216 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:02:47.356 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:02:47.384 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:02:47.422 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:02:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:02:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:02:47.596 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:02:47.622 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:47.648 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:02:47.662 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:47.674 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:47.715 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:47.734 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:02:47.761 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:02:47.800 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:02:47.939 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:02:47.967 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:02:47.997 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:02:47.998 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:48.000 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:02:48.025 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:48.026 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:48.065 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:48.067 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.137 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:02:48.165 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:02:48.203 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:02:48.225 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:02:48.241 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:02:48.275 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:02:48.326 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:48.352 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:48.384 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.545 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:02:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.796 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:48.823 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:48.834 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:02:48.850 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:48.863 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.864 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:48.890 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:48.892 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.930 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:49.054 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:02:49.083 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:49.129 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:49.228 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:02:49.250 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:49.255 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:02:49.276 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:49.294 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:02:49.316 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:49.556 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:02:49.584 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:02:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:02:49.645 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:49.671 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:49.711 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:49.866 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package jq. 2024-04-18T21:02:49.882 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:02:49.882 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:02:49.898 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:49.916 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:02:49.940 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:50.014 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:50.040 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:50.080 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:50.160 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package socat. 2024-04-18T21:02:50.176 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:02:50.218 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:02:50.220 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:02:50.366 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:50.381 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:50.409 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:50.424 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:50.436 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:50.470 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:50.486 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:50.522 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:02:50.538 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:02:50.580 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:02:50.596 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:02:50.778 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:50.803 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:50.844 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:50.863 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:02:50.942 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:02:50.958 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:51.000 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:51.064 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:51.090 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:51.096 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:51.112 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:51.130 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:51.146 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:51.166 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:02:51.433 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:51.449 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:51.459 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:51.464 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:51.499 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:51.499 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:51.603 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:02:51.673 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:51.827 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:51.844 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:51.853 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:51.870 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:51.894 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:51.911 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:52.130 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:52.132 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-04-18T21:02:52.145 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:52.189 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:52.222 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:52.248 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:52.255 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:52.289 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:52.491 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:52.516 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:52.517 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:52.531 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:52.558 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:52.566 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:52.723 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:52.852 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:52.860 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:52.868 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:52.887 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:52.911 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:52.927 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:52.982 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:02:53.108 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:02:53.214 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:02:53.246 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:02:53.255 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:02:53.282 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:53.298 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:53.321 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:53.324 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:53.364 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:02:53.524 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:02:53.551 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:02:53.591 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:02:53.616 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:02:53.619 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:53.633 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:53.666 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:53.745 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:02:53.897 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:53.910 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:02:53.923 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:53.937 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:02:53.952 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:02:53.963 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:53.977 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:02:53.980 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:02:54.019 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:02:54.047 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:02:54.289 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:02:54.315 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:02:54.348 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:02:54.355 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:02:54.376 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:02:54.407 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:02:54.414 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:02:54.524 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:54.551 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:54.591 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:54.650 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:02:54.667 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:02:54.693 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:02:54.733 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:02:54.810 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:02:54.838 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:54.876 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:02:54.910 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:54.937 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:54.977 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:55.036 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:02:55.062 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:02:55.102 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:55.137 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:55.257 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:02:55.284 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:02:55.323 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:02:55.330 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:55.355 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:02:55.356 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:55.371 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:02:55.396 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:55.405 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:02:55.413 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:02:55.534 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:02:55.549 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:02:55.584 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:02:55.664 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:02:55.700 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:02:55.727 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:02:55.759 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:02:55.825 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:55.851 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:55.891 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:55.948 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:55.979 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:02:56.006 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:02:56.036 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:02:56.053 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:02:56.079 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:02:56.119 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:02:56.339 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:02:56.341 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:02:56.367 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:02:56.406 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:02:56.422 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:02:56.448 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:02:56.483 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:02:56.489 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:02:56.610 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:56.719 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:56.726 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:02:56.753 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:02:56.792 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:02:56.842 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:02:56.868 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:02:56.911 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:56.953 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:57.112 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:02:57.139 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:02:57.178 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:02:57.203 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:02:57.218 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:02:57.221 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:57.248 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:57.253 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:57.298 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:57.324 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:02:57.360 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:02:57.423 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:57.506 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:02:57.522 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:02:57.524 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:02:57.533 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:02:57.572 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:02:57.867 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:57.884 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:57.892 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:02:57.893 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:57.900 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:02:57.915 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:02:57.920 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:02:57.934 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:57.950 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:57.958 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:02:58.001 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:02:58.236 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:02:58.237 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:58.253 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:02:58.262 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:02:58.263 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:58.303 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:02:58.303 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:58.463 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:02:58.491 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:02:58.521 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:02:58.529 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:02:58.606 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:02:58.631 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:58.632 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:02:58.657 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:58.672 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:02:58.698 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:58.814 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:02:58.840 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:02:58.867 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:02:58.906 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:02:58.933 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:02:59.000 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:02:59.017 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:59.026 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:02:59.043 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:59.067 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:02:59.084 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:59.184 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:02:59.212 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:02:59.250 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:02:59.395 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:59.398 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:02:59.414 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:02:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:59.448 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:59.461 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:59.604 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:02:59.608 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:59.632 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:02:59.670 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:02:59.735 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:02:59.739 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:59.761 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:02:59.765 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:59.801 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:02:59.805 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:59.867 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:59.931 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:02:59.947 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:02:59.989 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:00.002 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:00.050 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:03:00.065 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:03:00.108 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:03:00.112 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:03:00.128 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:03:00.139 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:03:00.179 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:00.411 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:03:00.420 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:00.437 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:03:00.478 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:00.499 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:03:00.525 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:03:00.565 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:00.693 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:03:00.721 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:00.759 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:00.780 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:03:00.807 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:03:00.822 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:00.847 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:00.877 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:03:00.903 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:03:00.943 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:01.065 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:01.184 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:03:01.210 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:03:01.230 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:03:01.250 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:03:01.256 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:01.296 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:01.449 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:01.540 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:03:01.545 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:03:01.567 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:01.571 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:03:01.611 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:03:01.622 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:01.643 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:03:01.669 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:01.709 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:01.742 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:01.914 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:03:01.926 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:01.941 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:03:01.981 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:03:02.029 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:03:02.055 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:03:02.077 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:02.095 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:02.177 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:03:02.284 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:03:02.310 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:03:02.328 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:02.328 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:02.358 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:03:02.450 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:03:02.479 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:02.490 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:03:02.590 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:03:02.679 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:03:02.705 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:03:02.745 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:02.776 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:03:02.781 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:02.803 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:02.834 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:02.906 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:03:03.081 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:03:03.082 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:03.108 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:03:03.156 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:03.213 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:03:03.239 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:03.279 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:03.340 INFO:teuthology.orchestra.run.smithi194.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:03:03.422 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:03.475 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:03:03.502 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:03:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:03.863 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user cephadm....done 2024-04-18T21:03:03.875 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:03:03.901 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:03.928 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:03:03.941 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:03.954 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:03:03.977 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:03:03.998 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:03:04.245 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:03:04.263 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:04.314 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:03:04.341 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:03:04.381 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:03:04.505 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:04.514 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:04.624 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:04.631 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:03:04.717 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:03:04.743 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:03:04.792 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:04.883 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:04.898 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:04.969 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2024-04-18T21:03:04.984 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:05.000 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:05.027 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:05.110 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:05.120 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:03:05.141 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:03:05.147 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:03:05.187 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:03:05.242 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:03:05.297 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:03:05.312 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:05.347 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:05.395 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:05.489 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:03:05.516 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:03:05.543 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:05.556 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:05.654 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:05.684 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:03:05.710 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:05.750 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:05.876 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:03:05.903 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:03:05.904 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:05.930 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:05.950 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:03:06.040 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:06.120 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:03:06.146 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:06.163 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:03:06.186 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:06.306 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:03:06.325 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:06.332 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:03:06.380 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:06.431 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:03:06.497 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:03:06.524 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:03:06.564 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:06.575 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:06.691 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:06.777 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:03:06.804 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:03:06.827 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:06.851 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:06.908 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:03:06.917 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:06.924 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:06.966 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:07.070 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:07.168 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:07.221 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:03:07.248 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:03:07.313 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:03:07.321 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:07.428 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:07.582 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:03:07.588 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:07.609 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:03:07.649 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:07.687 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:07.698 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:07.821 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:07.935 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:03:07.947 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:03:07.955 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:03:07.961 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:03:07.974 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:07.983 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:08.001 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:08.013 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:08.073 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:03:08.100 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:08.275 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:03:08.288 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:03:08.291 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:03:08.314 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:03:08.315 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:03:08.324 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:08.354 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:08.392 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:08.603 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:03:08.624 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:03:08.630 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:08.651 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:08.669 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:08.690 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:08.714 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:03:08.719 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:08.746 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:03:08.810 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:03:08.937 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:08.956 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:03:08.970 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:08.980 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:03:09.014 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:09.121 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:09.237 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:03:09.247 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:09.263 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:09.296 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:09.312 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:09.317 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:03:09.337 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:09.344 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:03:09.383 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:09.422 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:03:09.574 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:09.631 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:03:09.658 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:03:09.690 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:09.698 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:09.700 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:09.712 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:03:09.739 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:09.778 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:09.949 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:09.984 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:03:10.011 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:03:10.050 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:03:10.085 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:10.242 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:03:10.327 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:10.359 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:10.395 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:03:10.422 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:10.454 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:03:10.461 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:10.738 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:10.840 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:03:10.856 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:10.866 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:10.906 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:03:11.067 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:03:11.094 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:03:11.133 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:11.173 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:11.491 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:11.509 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:03:11.521 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:03:11.536 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:11.576 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:11.629 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:03:11.655 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:11.656 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:03:11.695 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:11.767 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:11.781 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:03:11.868 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:03:12.074 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:03:12.082 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:12.101 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:03:12.140 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:12.393 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:03:12.420 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:03:12.421 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:12.441 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:12.459 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:12.629 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-04-18T21:03:12.644 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:12.667 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:12.687 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:12.766 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:13.007 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:03:13.033 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:13.044 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:13.106 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.142 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:13.144 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:03:13.172 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:13.295 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.337 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:13.426 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:03:13.427 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:13.453 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:13.492 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.688 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:13.755 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:03:13.873 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.904 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:03:13.931 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:13.956 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:13.970 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.982 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.082 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.091 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:03:14.250 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:03:14.276 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:03:14.290 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:03:14.316 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:14.316 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:03:14.356 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:14.358 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:14.428 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.554 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.619 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:03:14.646 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:03:14.668 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:14.680 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:14.684 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:03:14.685 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:14.699 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:14.734 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:14.956 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.022 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:03:15.049 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:03:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.089 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:15.209 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.400 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:03:15.406 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:15.406 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:15.428 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:03:15.458 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:03:15.757 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:15.772 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:03:15.779 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:03:15.800 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:15.806 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:03:15.839 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:15.845 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.983 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:16.028 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:16.134 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:16.149 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:03:16.166 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:03:16.171 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:16.176 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:03:16.193 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:03:16.207 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:16.233 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:16.305 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:16.402 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:16.485 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:03:16.512 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:03:16.528 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:16.576 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:03:16.586 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:03:16.613 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:16.654 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:16.686 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:16.896 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:03:16.924 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:03:16.955 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:16.963 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:16.998 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:03:17.025 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:03:17.064 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:17.214 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:17.367 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:03:17.394 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:03:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:17.457 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:17.510 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.566 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:17.585 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:03:17.601 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:17.619 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.635 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.745 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.770 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:03:17.796 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:17.836 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.871 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.884 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:17.955 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:03:17.982 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:03:18.014 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:18.021 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:18.135 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:18.341 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:03:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:18.395 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:18.407 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:18.516 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-04-18T21:03:18.635 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2024-04-18T21:03:18.646 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:18.651 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:18.685 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:18.884 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-04-18T21:03:18.913 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2024-04-18T21:03:18.914 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:18.940 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:03:18.979 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:19.077 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-04-18T21:03:19.094 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:03:19.175 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:03:19.190 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:19.202 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:03:19.233 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:19.238 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:03:19.291 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:03:19.307 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:19.319 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:03:19.357 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:19.558 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:19.611 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:03:19.685 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:19.695 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:03:19.711 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:19.711 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:03:19.738 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:03:19.770 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:19.777 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:19.986 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:20.140 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:03:20.141 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:20.166 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:03:20.206 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:20.267 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:20.287 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:20.517 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:03:20.544 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:03:20.546 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:20.575 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:20.672 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:20.718 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:20.719 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:20.781 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:20.853 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:21.075 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:21.201 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:21.202 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:21.283 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:03:21.311 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:21.435 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:21.540 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:03:21.602 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:21.878 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:21.987 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:03:22.038 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:22.208 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:03:22.235 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:22.255 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:22.260 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:22.260 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:22.274 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:22.364 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:03:22.381 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:22.391 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:03:22.430 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:22.586 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:03:22.614 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:22.653 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:22.707 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:22.733 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:03:22.760 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:03:22.764 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:22.799 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:03:22.983 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:03:22.984 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:22.984 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:23.000 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:23.022 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:23.128 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:03:23.155 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:03:23.194 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:23.276 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:23.327 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:03:23.354 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:03:23.393 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:23.402 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:03:23.466 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:23.514 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:03:23.541 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:03:23.580 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:03:23.670 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:03:23.739 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:23.739 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:23.756 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:03:23.783 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:03:23.822 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:23.892 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:03:23.920 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:03:23.929 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:23.950 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:24.243 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:24.245 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:03:24.253 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:03:24.273 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:03:24.280 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:03:24.291 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:24.319 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:24.356 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:24.487 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:24.563 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:03:24.579 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:03:24.613 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:24.651 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:24.823 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:03:24.850 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:03:24.889 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:03:24.935 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:24.992 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:03:25.019 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:03:25.058 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:25.171 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.193 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:03:25.220 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:03:25.259 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:25.305 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:03:25.322 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.353 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:03:25.380 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:03:25.419 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:25.430 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.548 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.608 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.666 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:03:25.822 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:25.957 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:03:25.972 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:25.985 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.031 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.061 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:03:26.111 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.117 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:03:26.145 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:03:26.162 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:03:26.175 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:26.237 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:26.314 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:03:26.326 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:03:26.353 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:03:26.392 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:26.521 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.528 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:03:26.556 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:03:26.603 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:03:26.639 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.737 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:03:26.740 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.764 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:26.811 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:26.865 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:03:26.892 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:03:26.931 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:26.954 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:26.954 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:27.064 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-04-18T21:03:27.080 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:27.122 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:27.307 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:03:27.361 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:03:27.366 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-04-18T21:03:27.382 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:03:27.388 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:03:27.427 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:27.450 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:27.450 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:27.576 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:27.702 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:27.721 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:03:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:03:27.753 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:03:27.769 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:03:27.787 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:03:27.811 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:27.828 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:27.971 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:03:27.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:03:28.028 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T21:03:28.091 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:03:28.118 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:03:28.157 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:03:28.157 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:28.173 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:28.215 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:28.228 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-18T21:03:28.229 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-18T21:03:28.417 INFO:teuthology.orchestra.run.smithi134.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:03:28.417 INFO:teuthology.orchestra.run.smithi134.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:03:28.418 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:03:28.418 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:03:28.418 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:03:28.418 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:03:28.418 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:03:28.419 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:03:28.419 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:03:28.419 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-18T21:03:28.419 INFO:teuthology.orchestra.run.smithi134.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:03:28.421 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-18T21:03:28.421 INFO:teuthology.orchestra.run.smithi134.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:03:28.450 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-18T21:03:28.451 INFO:teuthology.orchestra.run.smithi134.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:03:28.453 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-18T21:03:28.453 INFO:teuthology.orchestra.run.smithi134.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:03:28.494 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:03:28.522 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:03:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:03:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:03:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:03:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:03:28.560 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:03:28.761 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:03:28.762 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:03:28.763 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:03:28.779 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:03:28.780 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:03:28.781 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:03:28.781 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:03:28.782 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:03:28.830 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:03:28.858 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:03:28.896 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:29.056 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:29.150 INFO:teuthology.orchestra.run.smithi134.stdout:Preconfiguring packages ... 2024-04-18T21:03:29.199 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:29.261 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 5,495 kB in 0s (15.6 MB/s) 2024-04-18T21:03:29.300 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:29.399 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package flex. 2024-04-18T21:03:29.426 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:03:29.506 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:03:29.552 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:29.576 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:03:29.604 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:29.642 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:30.095 INFO:teuthology.orchestra.run.smithi194.stdout:Adding group ceph....done 2024-04-18T21:03:30.113 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:03:30.286 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:03:30.429 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:03:30.429 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user ceph....done 2024-04-18T21:03:30.444 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:30.486 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:30.544 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:03:30.571 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:30.589 INFO:teuthology.orchestra.run.smithi194.stdout:Setting system user ceph properties....done 2024-04-18T21:03:30.602 INFO:teuthology.orchestra.run.smithi194.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:03:30.610 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:30.697 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:30.738 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:03:30.791 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:30.914 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:03:30.930 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:30.996 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:31.050 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:03:31.050 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:03:31.176 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:31.207 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:31.213 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:31.318 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:31.325 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:03:31.353 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:03:31.392 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:31.441 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:03:31.519 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:31.645 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:31.735 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:31.738 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:03:31.765 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:03:31.783 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:03:31.804 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:31.866 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:32.109 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:32.110 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:32.158 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:03:32.185 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:03:32.185 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:03:32.195 INFO:teuthology.orchestra.run.smithi111.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:03:32.225 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:32.589 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:32.621 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:03:32.649 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:03:32.675 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package bison. 2024-04-18T21:03:32.689 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:32.711 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2024-04-18T21:03:32.780 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:32.785 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:03:32.835 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:03:32.885 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:03:32.933 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:03:32.958 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:03:32.974 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:03:33.007 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:33.170 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:03:33.285 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:03:33.301 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:03:33.391 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:03:33.398 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:33.429 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:33.444 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:03:33.471 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:03:33.510 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:33.547 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:03:33.677 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:33.677 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:33.707 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:03:33.723 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:03:33.765 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:03:33.788 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:03:33.814 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:33.816 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:03:33.855 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:34.091 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:03:34.101 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:03:34.129 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:34.150 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:34.158 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:03:34.176 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:34.185 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:03:34.217 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:03:34.224 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:34.361 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:34.361 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:34.479 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:03:34.507 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:34.544 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:03:34.553 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:34.569 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:34.572 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:03:34.810 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:34.843 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:34.848 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:03:34.864 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:03:34.906 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:34.929 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:35.123 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:35.123 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:35.155 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:03:35.163 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:03:35.182 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:03:35.221 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:03:35.409 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:03:35.431 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:03:35.535 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:03:35.541 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:03:35.569 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:03:35.608 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:35.636 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:35.658 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:35.686 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:03:35.763 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:35.813 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:35.914 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:35.934 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:35.938 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:03:36.056 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:36.062 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:03:36.089 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:03:36.117 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:36.117 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:36.137 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:36.165 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:03:36.210 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:36.254 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:03:36.317 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:36.435 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:03:36.436 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:36.481 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:03:36.508 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:03:36.547 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:03:36.569 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:03:36.590 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:36.708 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:36.720 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:36.846 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:36.850 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:03:36.867 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:36.878 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:03:36.917 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:36.973 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:03:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:37.099 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:03:37.262 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:03:37.289 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:03:37.337 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:37.400 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:03:37.606 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:03:37.622 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:03:37.664 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:37.672 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:03:37.781 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:03:37.786 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:03:37.794 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:03:37.822 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:03:37.870 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:03:37.908 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:03:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:38.232 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:03:38.237 DEBUG:teuthology.parallel:result is None 2024-04-18T21:03:38.322 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:38.448 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:03:38.560 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:03:38.587 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:38.626 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:38.724 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:03:38.983 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:39.285 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:03:39.386 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:39.437 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:03:39.453 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:39.487 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:39.612 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:03:39.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:03:39.670 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-18T21:03:39.791 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:39.870 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-04-18T21:03:39.871 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-04-18T21:03:40.029 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:03:40.042 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:03:40.048 INFO:teuthology.orchestra.run.smithi194.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:03:40.049 INFO:teuthology.orchestra.run.smithi194.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:03:40.049 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:03:40.049 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:03:40.049 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:03:40.049 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:03:40.049 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:03:40.050 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:03:40.050 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:03:40.050 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-04-18T21:03:40.051 INFO:teuthology.orchestra.run.smithi194.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:03:40.052 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-04-18T21:03:40.052 INFO:teuthology.orchestra.run.smithi194.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:03:40.081 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-04-18T21:03:40.083 INFO:teuthology.orchestra.run.smithi194.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:03:40.084 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages will be upgraded: 2024-04-18T21:03:40.085 INFO:teuthology.orchestra.run.smithi194.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:03:40.143 INFO:teuthology.orchestra.run.smithi194.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:03:40.143 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:03:40.143 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:03:40.144 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:03:40.168 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:40.267 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:03:40.280 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:03:40.336 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:03:40.337 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:03:40.338 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:03:40.352 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:03:40.352 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:03:40.354 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:03:40.354 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:03:40.355 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:03:40.406 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:40.426 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:03:40.535 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:03:40.718 INFO:teuthology.orchestra.run.smithi194.stdout:Preconfiguring packages ... 2024-04-18T21:03:40.743 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:03:40.827 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:40.836 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 5,495 kB in 0s (18.8 MB/s) 2024-04-18T21:03:40.972 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package flex. 2024-04-18T21:03:41.063 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:03:41.069 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:41.121 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:03:41.179 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:41.192 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:03:41.404 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:41.413 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:41.670 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:03:41.823 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:41.835 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:03:42.003 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-04-18T21:03:42.116 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:42.151 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:03:42.237 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:42.436 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:03:42.467 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:42.687 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:42.710 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:42.811 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:42.813 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:03:43.009 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:43.015 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:43.064 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:43.104 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:43.120 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:43.307 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:03:43.408 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:03:43.414 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:43.546 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:43.677 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:43.710 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:43.995 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:03:44.054 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:44.313 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:03:44.369 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package bison. 2024-04-18T21:03:44.473 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:44.478 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:03:44.529 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:03:44.589 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:03:44.603 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:44.812 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:03:44.821 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:44.824 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:44.828 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:03:44.870 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:03:44.955 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:45.067 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:45.124 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:03:45.140 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:03:45.182 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:03:45.215 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:45.301 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:45.341 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:45.467 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:45.469 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:03:45.496 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:45.527 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:45.610 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:03:45.768 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:45.821 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:45.953 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:46.028 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:46.073 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:03:46.090 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:03:46.096 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:46.132 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:46.222 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:03:46.271 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:46.348 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:03:46.405 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:46.598 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:03:46.617 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:46.736 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:03:46.845 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:03:46.957 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:03:46.958 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:46.971 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:46.988 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:03:47.043 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:03:47.097 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:03:47.171 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:47.217 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:47.223 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:47.349 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:03:47.438 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:03:47.460 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:47.492 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:47.531 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:47.619 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:03:47.657 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:03:47.695 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:47.753 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:03:47.925 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:47.962 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:48.080 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:48.176 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:48.356 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:48.460 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:03:48.482 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:48.587 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:48.775 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:48.990 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:03:49.067 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:49.230 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:03:49.310 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:49.420 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:49.442 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:03:49.447 DEBUG:teuthology.parallel:result is None 2024-04-18T21:03:49.481 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:03:49.546 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:49.582 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:49.636 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:49.708 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:03:49.881 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:50.007 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:50.018 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:50.394 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:50.425 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:50.645 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:50.693 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:50.794 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:03:51.022 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:51.029 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:51.138 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:51.306 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:51.489 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:51.633 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:51.790 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:51.884 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:51.994 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.058 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:52.184 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:03:52.286 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:52.452 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:03:52.621 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:52.695 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:53.031 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:53.417 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:53.693 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:53.752 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:53.995 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:54.012 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:03:54.138 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:54.139 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.264 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.391 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:03:54.398 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:54.524 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:54.633 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:54.744 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.861 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.910 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:54.962 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:55.161 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:55.222 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:55.349 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:55.420 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:55.474 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:55.555 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:55.686 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:55.686 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:55.848 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:56.107 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:56.159 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:56.277 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:56.358 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:56.601 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:56.687 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:56.852 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:56.862 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:57.120 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:57.246 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:57.522 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:57.624 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:57.908 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:58.083 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:58.200 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.310 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.411 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.452 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:58.537 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.578 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:58.712 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:59.047 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:59.096 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2024-04-18T21:03:59.174 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:59.456 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2024-04-18T21:03:59.550 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:59.616 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2024-04-18T21:03:59.628 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:03:59.771 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:03:59.817 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:59.969 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:04:00.109 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:04:00.228 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:04:00.363 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:04:00.580 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:00.672 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:04:00.706 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:00.965 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:04:01.162 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:04:01.162 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:04:01.233 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:04:01.359 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:04:01.616 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:01.635 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:04:01.911 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:04:01.955 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:04:02.256 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:04:02.418 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:02.616 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:04:02.619 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:04:02.619 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:04:02.885 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:04:03.061 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.221 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:04:03.278 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:04:03.278 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:04:03.355 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.456 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.599 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:04:03.738 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.935 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.990 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:04:03.990 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:04:04.061 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:04.196 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:04:04.456 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:04.464 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:04.582 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:04.582 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:04.691 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:04.733 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:04.888 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:04:04.888 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:04:04.958 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:04:04.958 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:04:05.410 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:05.578 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:05.609 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:05.729 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:05.735 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:05.861 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:05.863 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:05.987 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:04:06.235 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:04:06.420 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:06.674 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:07.150 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:07.277 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:07.402 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:07.528 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:07.654 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:07.854 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:08.189 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-04-18T21:04:08.507 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:08.511 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:04:08.523 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-04-18T21:04:08.566 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-18T21:04:08.650 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-04-18T21:04:08.667 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:04:08.766 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-18T21:04:08.767 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-18T21:04:08.804 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:04:08.953 INFO:teuthology.orchestra.run.smithi111.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:04:08.954 INFO:teuthology.orchestra.run.smithi111.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:04:08.954 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:04:08.954 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:04:08.954 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:04:08.954 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:04:08.955 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:04:08.955 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:04:08.955 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:04:08.955 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-18T21:04:08.956 INFO:teuthology.orchestra.run.smithi111.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:04:08.957 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-18T21:04:08.957 INFO:teuthology.orchestra.run.smithi111.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:04:08.985 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-18T21:04:08.986 INFO:teuthology.orchestra.run.smithi111.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:04:08.988 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-04-18T21:04:08.988 INFO:teuthology.orchestra.run.smithi111.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:04:09.046 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:04:09.046 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:04:09.046 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:04:09.046 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:04:09.125 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:04:09.164 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:04:09.235 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:04:09.236 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:04:09.237 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:04:09.251 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:04:09.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:04:09.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:04:09.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:04:09.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:04:09.597 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:09.619 INFO:teuthology.orchestra.run.smithi111.stdout:Preconfiguring packages ... 2024-04-18T21:04:09.698 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:09.716 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 5,495 kB in 0s (18.8 MB/s) 2024-04-18T21:04:09.818 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package flex. 2024-04-18T21:04:09.906 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:04:09.914 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:09.942 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:04:10.160 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:04:10.160 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:04:10.492 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:10.642 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:10.665 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:04:10.989 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:04:11.092 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:11.469 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:11.610 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:11.616 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:11.707 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:04:11.707 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:04:11.739 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:12.137 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:12.195 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:12.381 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:12.415 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:04:12.415 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:04:12.708 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:12.905 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:13.056 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package bison. 2024-04-18T21:04:13.157 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:13.163 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:04:13.171 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:04:13.172 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:04:13.209 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:13.492 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:04:13.520 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:04:13.550 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:13.648 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:13.788 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:04:13.791 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:13.804 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:04:13.846 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:13.942 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:14.156 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:04:14.156 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:04:14.183 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:04:14.210 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:14.249 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:14.485 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:04:14.501 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:14.536 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:14.668 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:14.771 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:04:14.799 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:14.820 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:14.838 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:14.946 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:15.122 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:15.332 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:04:15.459 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:15.475 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:04:15.568 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:15.575 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:15.678 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:15.728 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:15.796 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:15.922 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:16.048 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:16.137 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:04:16.208 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:16.360 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:16.503 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:16.830 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:17.488 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:17.490 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:04:17.547 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T21:04:17.747 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T21:04:17.748 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T21:04:17.781 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:17.936 INFO:teuthology.orchestra.run.smithi096.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:04:17.936 INFO:teuthology.orchestra.run.smithi096.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:04:17.936 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:04:17.936 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:04:17.936 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:04:17.936 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:04:17.937 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:04:17.937 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:04:17.937 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:04:17.937 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T21:04:17.938 INFO:teuthology.orchestra.run.smithi096.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:04:17.939 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T21:04:17.939 INFO:teuthology.orchestra.run.smithi096.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:04:17.969 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T21:04:17.970 INFO:teuthology.orchestra.run.smithi096.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:04:17.972 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-18T21:04:17.972 INFO:teuthology.orchestra.run.smithi096.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:04:18.154 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:04:18.154 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:04:18.154 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:04:18.154 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:04:18.258 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:18.263 DEBUG:teuthology.parallel:result is None 2024-04-18T21:04:18.642 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:04:18.907 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:04:18.908 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:04:18.909 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:04:18.944 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:04:18.945 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:04:18.947 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:04:18.948 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:04:19.362 INFO:teuthology.orchestra.run.smithi096.stdout:Preconfiguring packages ... 2024-04-18T21:04:19.477 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 5,495 kB in 1s (5,259 kB/s) 2024-04-18T21:04:19.594 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package flex. 2024-04-18T21:04:19.685 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:04:19.691 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:04:20.293 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:20.449 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:04:20.894 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:21.479 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:21.484 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:21.616 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:21.992 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:22.123 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:22.460 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:22.841 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package bison. 2024-04-18T21:04:22.946 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:22.952 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:04:23.001 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:23.377 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:04:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:04:23.435 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:23.731 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:04:23.759 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:04:23.797 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:24.109 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:04:24.138 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:24.176 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:24.437 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:04:24.465 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:24.781 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:04:24.810 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:24.848 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:25.376 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:04:25.502 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:25.620 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:25.722 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:25.822 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:25.948 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:26.300 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:04:26.370 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:26.472 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:26.607 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:27.925 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:28.438 DEBUG:teuthology.parallel:result is None 2024-04-18T21:04:28.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:28.650 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:28.669 INFO:teuthology.orchestra.run.smithi096.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:28.670 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:28.670 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:28.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:28.806 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:28.825 INFO:teuthology.orchestra.run.smithi111.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:28.825 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:28.825 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:28.827 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:28.960 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:28.980 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:28.980 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:28.980 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:28.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:29.191 DEBUG:teuthology.orchestra.run.smithi194:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:29.210 INFO:teuthology.orchestra.run.smithi194.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:29.210 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:29.210 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:29.212 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-18T21:04:29.212 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:29.212 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:29.226 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:29.226 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:29.240 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:29.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:29.255 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:29.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:29.268 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-18T21:04:29.268 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:29.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:29.280 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:29.334 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:29.334 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:29.348 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:29.403 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:29.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:29.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:29.473 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:29.473 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:29.486 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:29.541 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-18T21:04:29.541 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:29.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:29.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:29.607 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:29.607 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:29.620 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:29.676 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:29.676 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:29.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:29.745 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:29.745 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:29.758 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:29.813 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-18T21:04:29.814 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:29.814 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:29.826 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:29.879 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:29.879 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:29.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:29.948 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:29.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:29.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:30.017 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:30.018 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:30.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:30.086 INFO:teuthology.run_tasks:Running task ceph... 2024-04-18T21:04:30.167 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-18T21:04:30.167 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:30.170 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:30.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:30.175 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:30.188 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-18T21:04:30.188 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:30.225 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:30.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:30.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:30.245 INFO:tasks.ceph:Creating extra log directories... 2024-04-18T21:04:30.245 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:30.277 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:30.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:30.287 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:30.311 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-18T21:04:30.311 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-18T21:04:30.312 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7662444', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'c46a99d99fa3e2dad10a5ce96141fec909e651df'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 3165, 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'c46a99d99fa3e2dad10a5ce96141fec909e651df', 'targets': {'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0qYPOOrUF44xX+rBmVFTyR9y3ovdmVHPUcuk/5UK6o2p1oY0Xi6Cj9TlP/2P2KpH8AYO16T1lbRZiEBG945OM=', 'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM0JjbwAgdatnTvyr8pgmAKM94sGDrZAJm83TvEH7aPqcN/zzCJ1mQ3KgSbXVSfQFv7PQdrs+JLv8B5X6hSkkUA=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfnOXOEIS0QOp6fMobkyXVSkwCBo232moJgT5+lX1Kyq+fwSJNV9pnIPe41EYr9f5WDdm/9ayfd9EUwA1VCnVk=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSmRB0d68b04iPeYdg4BuXclEHUMxHSLviqVm3eqvmEBFADzFFEYMMyvqdLotHf0Zl0r5GUurxbZ3rDSSIK9pU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_20:32:14', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-18T21:04:30.312 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:30.329 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:30.338 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:30.343 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:30.348 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:30.377 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:30.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:30.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:30.404 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:30.404 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T21:04:30.445 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T21:04:30.445 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-18 20:56:07.823997822 +0000 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-18 20:56:07.595999858 +0000 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-18 20:56:07.595999858 +0000 2024-04-18T21:04:30.493 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-18T21:04:30.494 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T21:04:30.547 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-18T21:04:30.547 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-18T21:04:30.547 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000409353 s, 1.3 MB/s 2024-04-18T21:04:30.548 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T21:04:30.598 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-04-18T21:04:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T21:04:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:30.645 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-04-18T21:04:30.645 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:30.645 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-18 20:56:08.311993462 +0000 2024-04-18T21:04:30.645 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-18 20:56:08.051995785 +0000 2024-04-18T21:04:30.645 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-18 20:56:08.051995785 +0000 2024-04-18T21:04:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-18T21:04:30.646 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T21:04:30.700 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-18T21:04:30.700 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-18T21:04:30.700 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000371762 s, 1.4 MB/s 2024-04-18T21:04:30.701 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T21:04:30.750 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-04-18T21:04:30.797 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T21:04:30.797 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:30.797 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-04-18T21:04:30.797 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:30.797 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-18 20:56:08.819988925 +0000 2024-04-18T21:04:30.797 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-18 20:56:08.543991390 +0000 2024-04-18T21:04:30.797 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-18 20:56:08.543991390 +0000 2024-04-18T21:04:30.798 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-18T21:04:30.798 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T21:04:30.851 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-18T21:04:30.851 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-18T21:04:30.851 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000427871 s, 1.2 MB/s 2024-04-18T21:04:30.853 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T21:04:30.902 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-18 20:56:09.327984388 +0000 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-18 20:56:09.087986531 +0000 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-18 20:56:09.087986531 +0000 2024-04-18T21:04:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-18T21:04:30.949 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T21:04:31.003 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-18T21:04:31.003 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-18T21:04:31.003 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000390564 s, 1.3 MB/s 2024-04-18T21:04:31.004 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T21:04:31.054 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:31.054 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:31.054 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T21:04:31.060 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T21:04:31.060 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-04-18T21:04:31.106 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T21:04:31.107 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:31.107 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-04-18T21:04:31.107 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:31.107 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 20:56:04.778149305 +0000 2024-04-18T21:04:31.107 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 20:56:04.522151590 +0000 2024-04-18T21:04:31.107 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 20:56:04.522151590 +0000 2024-04-18T21:04:31.107 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T21:04:31.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T21:04:31.161 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T21:04:31.161 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T21:04:31.161 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000447251 s, 1.1 MB/s 2024-04-18T21:04:31.162 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T21:04:31.212 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-04-18T21:04:31.258 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T21:04:31.258 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:31.258 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-04-18T21:04:31.258 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:31.258 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 20:56:05.318144481 +0000 2024-04-18T21:04:31.258 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 20:56:05.058146804 +0000 2024-04-18T21:04:31.258 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 20:56:05.058146804 +0000 2024-04-18T21:04:31.259 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T21:04:31.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T21:04:31.312 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T21:04:31.312 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T21:04:31.312 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00044979 s, 1.1 MB/s 2024-04-18T21:04:31.314 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T21:04:31.363 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-04-18T21:04:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T21:04:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:31.410 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-04-18T21:04:31.410 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:31.410 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 20:56:05.806140121 +0000 2024-04-18T21:04:31.410 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 20:56:05.558142337 +0000 2024-04-18T21:04:31.411 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 20:56:05.558142337 +0000 2024-04-18T21:04:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T21:04:31.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T21:04:31.465 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T21:04:31.465 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T21:04:31.465 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000427915 s, 1.2 MB/s 2024-04-18T21:04:31.466 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T21:04:31.519 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-04-18T21:04:31.566 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T21:04:31.566 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:31.566 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-04-18T21:04:31.566 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:31.566 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 20:56:06.314135584 +0000 2024-04-18T21:04:31.567 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 20:56:06.038138049 +0000 2024-04-18T21:04:31.567 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 20:56:06.038138049 +0000 2024-04-18T21:04:31.567 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T21:04:31.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T21:04:31.620 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T21:04:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T21:04:31.621 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000329294 s, 1.6 MB/s 2024-04-18T21:04:31.622 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T21:04:31.671 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:31.672 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:31.672 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T21:04:31.677 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T21:04:31.678 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-04-18T21:04:31.727 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T21:04:31.727 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:31.727 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-04-18T21:04:31.727 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:31.728 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-18 20:56:01.648493767 +0000 2024-04-18T21:04:31.728 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-18 20:56:01.392496055 +0000 2024-04-18T21:04:31.728 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-18 20:56:01.392496055 +0000 2024-04-18T21:04:31.728 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-18T21:04:31.728 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T21:04:31.781 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-18T21:04:31.781 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-18T21:04:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000438003 s, 1.2 MB/s 2024-04-18T21:04:31.783 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T21:04:31.836 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-04-18T21:04:31.882 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T21:04:31.882 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:31.882 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-04-18T21:04:31.883 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:31.883 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-18 20:56:02.140489373 +0000 2024-04-18T21:04:31.883 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-18 20:56:01.888491624 +0000 2024-04-18T21:04:31.883 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-18 20:56:01.888491624 +0000 2024-04-18T21:04:31.883 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-18T21:04:31.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T21:04:31.937 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-18T21:04:31.937 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-18T21:04:31.937 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000423261 s, 1.2 MB/s 2024-04-18T21:04:31.939 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T21:04:31.988 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-04-18T21:04:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T21:04:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:32.035 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-04-18T21:04:32.035 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:32.035 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-18 20:56:02.660484729 +0000 2024-04-18T21:04:32.035 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-18 20:56:02.380487230 +0000 2024-04-18T21:04:32.035 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-18 20:56:02.380487230 +0000 2024-04-18T21:04:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-18T21:04:32.035 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T21:04:32.089 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-18T21:04:32.089 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-18T21:04:32.089 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000393407 s, 1.3 MB/s 2024-04-18T21:04:32.091 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T21:04:32.140 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-04-18T21:04:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T21:04:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:32.186 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-04-18T21:04:32.187 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:32.187 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-18 20:56:03.168480191 +0000 2024-04-18T21:04:32.187 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-18 20:56:02.908482514 +0000 2024-04-18T21:04:32.187 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-18 20:56:02.908482514 +0000 2024-04-18T21:04:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-18T21:04:32.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T21:04:32.241 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-18T21:04:32.241 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-18T21:04:32.241 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000382986 s, 1.3 MB/s 2024-04-18T21:04:32.242 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T21:04:32.292 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:32.292 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-18T21:04:32.292 INFO:tasks.ceph:Generating config... 2024-04-18T21:04:32.293 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-18T21:04:32.293 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-18T21:04:32.293 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-18T21:04:32.293 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-18T21:04:32.293 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-18T21:04:32.293 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-18T21:04:32.293 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-04-18T21:04:32.293 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-18T21:04:32.293 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-18T21:04:32.293 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-18T21:04:32.293 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-18T21:04:32.294 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-18T21:04:32.294 INFO:tasks.ceph:Setting up mon.a... 2024-04-18T21:04:32.294 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:32.329 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2024-04-18T21:04:32.339 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-18T21:04:32.423 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:32.474 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.b', '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]'), ('mon.c', '[v2:172.21.15.96:3302,v1:172.21.15.96:6791]')] 2024-04-18T21:04:32.475 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-18T21:04:32.475 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:32.476 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T21:04:32.520 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --addv b '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]' --addv c '[v2:172.21.15.96:3302,v1:172.21.15.96:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid ce5e2bf2-36af-4d40-a378-74a7158189ef 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = quincy 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:fsid ce5e2bf2-36af-4d40-a378-74a7158189ef 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2024-04-18T21:04:32.609446+0000 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-04-18T21:04:32.609446+0000 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 17 (quincy) 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 1 2024-04-18T21:04:32.606 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2024-04-18T21:04:32.607 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] mon.b 2024-04-18T21:04:32.607 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.96:3302/0,v1:172.21.15.96:6791/0] mon.c 2024-04-18T21:04:32.607 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-18T21:04:32.608 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T21:04:32.656 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ce5e2bf2-36af-4d40-a378-74a7158189ef... 2024-04-18T21:04:32.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:32.701 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:32.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:32.706 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:32.730 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.731 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:32.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = ce5e2bf2-36af-4d40-a378-74a7158189ef 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-04-18T21:04:32.733 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug trim objects = true 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:32.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression algorithm = snappy 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-04-18T21:04:32.735 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 1/20 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 1/20 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 4/10 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: osd max markdown count = 1000 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-04-18T21:04:32.736 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:32.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-04-18T21:04:32.739 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-18T21:04:32.740 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-04-18T21:04:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-04-18T21:04:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-04-18T21:04:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = ce5e2bf2-36af-4d40-a378-74a7158189ef 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-04-18T21:04:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-04-18T21:04:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore compression algorithm = snappy 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore compression mode = aggressive 2024-04-18T21:04:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: osd max markdown count = 1000 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.746 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-04-18T21:04:32.747 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-04-18T21:04:32.749 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-04-18T21:04:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-18T21:04:32.752 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = ce5e2bf2-36af-4d40-a378-74a7158189ef 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-04-18T21:04:32.753 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-04-18T21:04:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression algorithm = snappy 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression mode = aggressive 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:32.755 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-18T21:04:32.756 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:32.757 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:32.758 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.759 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:32.760 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.761 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = ce5e2bf2-36af-4d40-a378-74a7158189ef 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.762 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-04-18T21:04:32.763 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore compression algorithm = snappy 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore compression mode = aggressive 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 1/20 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 1/20 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-04-18T21:04:32.764 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 4/10 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: osd max markdown count = 1000 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.765 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.766 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-04-18T21:04:32.767 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-04-18T21:04:32.768 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-04-18T21:04:32.768 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:32.768 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:32.768 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-04-18T21:04:32.768 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-04-18T21:04:32.768 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-04-18T21:04:32.768 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-04-18T21:04:32.770 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-18T21:04:32.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-18T21:04:32.860 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-18T21:04:32.860 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:32.860 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-18T21:04:32.865 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:32.865 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-18T21:04:32.912 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T21:04:32.912 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:32.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:32.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:32.976 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:32.976 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:33.025 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:04:33.025 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:33.025 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:33.025 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:33.048 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:33.048 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:33.093 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T21:04:33.093 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:33.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:33.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:33.114 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:33.114 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:33.162 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-04-18T21:04:33.162 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:33.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:33.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:33.183 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:33.183 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:33.230 INFO:tasks.ceph:Setting up mon nodes... 2024-04-18T21:04:33.230 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-18T21:04:33.231 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T21:04:33.273 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T21:04:33.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T21:04:33.363 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T21:04:33.365 INFO:tasks.ceph:Setting up mds nodes... 2024-04-18T21:04:33.366 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T21:04:33.446 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T21:04:33.449 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-18T21:04:33.504 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-18T21:04:33.504 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-18T21:04:33.582 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-18T21:04:33.592 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-18T21:04:33.593 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-18T21:04:33.593 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:33.606 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:33.606 INFO:tasks.ceph:role: osd.0 2024-04-18T21:04:33.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:04:33.607 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T21:04:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T21:04:33.670 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T21:04:34.128 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-18T21:04:34.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-18T21:04:34.131 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:34.227 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:34.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:04:34.238 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T21:04:34.239 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:34.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-18T21:04:34.347+0000 7f2f1ee0a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-18T21:04:34.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-18T21:04:34.351+0000 7f2f1ee0a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-18T21:04:34.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-18T21:04:34.351+0000 7f2f1ee0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T21:04:34.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-18T21:04:34.351+0000 7f2f1ee0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T21:04:34.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-18T21:04:34.351+0000 7f2f1ee0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T21:04:34.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-18T21:04:34.355+0000 7f2f1ee0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-18T21:04:37.384 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:37.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:37.411 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:37.411 INFO:tasks.ceph:role: osd.1 2024-04-18T21:04:37.411 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T21:04:37.411 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T21:04:37.474 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T21:04:37.475 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T21:04:37.475 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T21:04:37.950 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-18T21:04:37.951 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-18T21:04:37.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:38.117 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:38.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:04:38.129 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T21:04:38.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:38.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T21:04:38.237+0000 7f4023e1c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-18T21:04:38.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T21:04:38.241+0000 7f4023e1c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-18T21:04:38.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T21:04:38.241+0000 7f4023e1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T21:04:38.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T21:04:38.241+0000 7f4023e1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T21:04:38.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T21:04:38.241+0000 7f4023e1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T21:04:38.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T21:04:38.253+0000 7f4023e1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-18T21:04:41.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:41.338 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:41.352 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:41.352 INFO:tasks.ceph:role: osd.2 2024-04-18T21:04:41.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-18T21:04:41.352 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T21:04:41.414 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T21:04:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T21:04:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T21:04:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T21:04:41.414 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T21:04:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-04-18T21:04:41.415 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T21:04:41.415 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T21:04:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T21:04:41.415 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T21:04:41.887 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-04-18T21:04:41.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-04-18T21:04:41.890 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:42.039 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:42.050 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T21:04:42.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:04:42.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:42.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-18T21:04:42.169+0000 7f9fdf7867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-18T21:04:42.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-18T21:04:42.173+0000 7f9fdf7867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-18T21:04:42.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-18T21:04:42.173+0000 7f9fdf7867c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T21:04:42.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-18T21:04:42.173+0000 7f9fdf7867c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T21:04:42.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-18T21:04:42.173+0000 7f9fdf7867c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T21:04:42.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-18T21:04:42.177+0000 7f9fdf7867c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-18T21:04:45.174 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:45.188 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-18T21:04:45.188 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:45.188 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-18T21:04:45.203 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:45.203 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-18T21:04:45.256 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:45.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-18T21:04:45.312 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:45.312 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-18T21:04:45.326 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:45.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-18T21:04:45.340 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:45.340 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-18T21:04:45.353 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:04:45.353 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-18T21:04:45.360 INFO:tasks.ceph:Adding keys to all mons... 2024-04-18T21:04:45.360 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T21:04:45.414 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDhiiFm0gKAEBAAJXeVr9GliukzjoOtPS6nNQ== 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDhiiFmLM7aFRAAF6tnthRkO/Ts8cQJDT52oQ== 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDhiiFmxwbVGhAA2SlW/YfqinBR7qWuXBK4Xg== 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDiiiFmeiLuFBAA18ciBbRfacqyFhBChyqw2g== 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDmiiFmOQ6HDhAAft1HA1HxnEzOzvoAFLAbtw== 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDqiiFmaccjChAAxjQNreHu7jwiyRoW3VIZ3A== 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-18T21:04:45.415 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDhiiFmdKnqIhAAE/oMNci9H5g6QwFyB5fOCg== 2024-04-18T21:04:45.416 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T21:04:45.503 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T21:04:45.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T21:04:45.679 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T21:04:45.760 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T21:04:45.848 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T21:04:45.890 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T21:04:45.975 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-18T21:04:45.975 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-18T21:04:46.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:46.145 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-18T21:04:46.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-18T21:04:46.209 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:46.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-18T21:04:46.311 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-18T21:04:46.361 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:46.452 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-18T21:04:46.463 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:46.508 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-18T21:04:46.508 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T21:04:46.508 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T21:04:46.553 INFO:tasks.ceph.mon.a:Started 2024-04-18T21:04:46.553 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T21:04:46.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T21:04:46.555 INFO:tasks.ceph.mon.b:Started 2024-04-18T21:04:46.555 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T21:04:46.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T21:04:46.557 INFO:tasks.ceph.mon.c:Started 2024-04-18T21:04:46.557 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-18T21:04:46.557 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T21:04:46.558 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T21:04:46.560 INFO:tasks.ceph.mgr.x:Started 2024-04-18T21:04:46.560 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T21:04:46.560 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T21:04:46.563 INFO:tasks.ceph.mgr.y:Started 2024-04-18T21:04:46.563 INFO:tasks.ceph:Setting crush tunables to default 2024-04-18T21:04:46.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2024-04-18T21:04:47.041 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2024-04-18T21:04:47.061 INFO:tasks.ceph:check_enable_crimson: False 2024-04-18T21:04:47.061 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-18T21:04:47.062 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-18T21:04:47.062 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-18T21:04:47.075 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T21:04:47.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-18T21:04:47.089 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-18T21:04:47.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-18T21:04:47.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new e255a90f-ab37-44af-9793-7ea323c63959 0 2024-04-18T21:04:47.170 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:47.168+0000 7f74ed118180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T21:04:47.170 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:47.168+0000 7f505a90b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T21:04:47.375 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-04-18T21:04:47.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 2d189848-7fef-4eed-a1e7-524937587a71 1 2024-04-18T21:04:47.605 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-04-18T21:04:47.622 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 2de50865-b6ec-4639-a544-dd366b440c50 2 2024-04-18T21:04:47.649 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:47.648+0000 7f74ed118180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T21:04:47.652 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:47.652+0000 7f505a90b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T21:04:47.838 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-04-18T21:04:47.853 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:47.852+0000 7f74ed118180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T21:04:47.853 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:47.852+0000 7f505a90b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T21:04:47.855 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T21:04:47.855 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T21:04:47.858 INFO:tasks.ceph.osd.0:Started 2024-04-18T21:04:47.858 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T21:04:47.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T21:04:47.860 INFO:tasks.ceph.osd.1:Started 2024-04-18T21:04:47.860 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T21:04:47.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T21:04:47.862 INFO:tasks.ceph.osd.2:Started 2024-04-18T21:04:47.863 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:04:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:04:48.048 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:04:47.830213+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:04:48.064 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-18T21:04:48.064 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-18T21:04:48.367 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T21:04:48.434 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.432+0000 7f505a90b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:48.434 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.432+0000 7f74ed118180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:48.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:04:48.473+0000 7fb5487637c0 -1 Falling back to public interface 2024-04-18T21:04:48.472 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:04:48.473+0000 7fdbb05197c0 -1 Falling back to public interface 2024-04-18T21:04:48.486 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:04:48.487+0000 7fbc2dd687c0 -1 Falling back to public interface 2024-04-18T21:04:48.492 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.492+0000 7f74ed118180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T21:04:48.493 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.492+0000 7f505a90b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T21:04:48.548 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.548+0000 7f74ed118180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T21:04:48.548 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.548+0000 7f505a90b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T21:04:48.549 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-18T21:04:48.549 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":5,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:04:47.830213+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:04:48.569 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-18T21:04:48.629 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.628+0000 7f505a90b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T21:04:48.634 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.632+0000 7f74ed118180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T21:04:48.682 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.680+0000 7f505a90b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T21:04:48.687 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.684+0000 7f74ed118180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T21:04:48.760 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.760+0000 7f505a90b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T21:04:48.765 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.764+0000 7f74ed118180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T21:04:48.814 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.812+0000 7f505a90b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T21:04:48.818 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.816+0000 7f74ed118180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T21:04:48.968 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:48.968+0000 7f505a90b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T21:04:48.969 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:48.968+0000 7f74ed118180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T21:04:49.032 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:49.028+0000 7f505a90b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T21:04:49.032 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:49.028+0000 7f74ed118180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T21:04:49.668 INFO:tasks.ceph.mgr.y.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T21:04:49.669 INFO:tasks.ceph.mgr.y.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T21:04:49.669 INFO:tasks.ceph.mgr.y.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-04-18T21:04:49.669 INFO:tasks.ceph.mgr.x.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T21:04:49.669 INFO:tasks.ceph.mgr.x.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T21:04:49.669 INFO:tasks.ceph.mgr.x.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-04-18T21:04:49.729 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:49.728+0000 7f74ed118180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T21:04:49.733 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:49.732+0000 7f505a90b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T21:04:49.895 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:49.892+0000 7f74ed118180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:49.909 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:49.908+0000 7f505a90b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:50.062 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:50.060+0000 7f505a90b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:50.062 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:50.060+0000 7f74ed118180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:50.127 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:50.124+0000 7f505a90b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T21:04:50.129 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:50.128+0000 7f74ed118180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T21:04:50.264 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:50.264+0000 7f505a90b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:50.272 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:50.272+0000 7f74ed118180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:50.890 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:50.888+0000 7f74ed118180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T21:04:50.891 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:50.888+0000 7f505a90b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T21:04:50.967 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:50.964+0000 7f505a90b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T21:04:50.968 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:50.964+0000 7f74ed118180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T21:04:51.153 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:51.152+0000 7f74ed118180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T21:04:51.154 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:51.152+0000 7f505a90b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T21:04:51.228 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:51.228+0000 7f74ed118180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T21:04:51.229 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:51.228+0000 7f505a90b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T21:04:51.521 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:51.520+0000 7f74ed118180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T21:04:51.522 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:51.520+0000 7f505a90b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T21:04:51.584 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-18T21:04:51.584+0000 7f74ed118180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T21:04:51.584 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:51.584+0000 7f505a90b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T21:04:52.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:04:52.129+0000 7fb5487637c0 -1 osd.1 0 log_to_monitors true 2024-04-18T21:04:52.139 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:04:52.141+0000 7fdbb05197c0 -1 osd.2 0 log_to_monitors true 2024-04-18T21:04:52.146 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:04:52.147+0000 7fbc2dd687c0 -1 osd.0 0 log_to_monitors true 2024-04-18T21:04:52.623 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:52.620+0000 7f5001c51640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-18T21:04:52.623 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T21:04:52.620+0000 7f5001c51640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-18T21:04:54.466 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:04:54.467+0000 7fbc29d11640 -1 osd.0 0 waiting for initial osdmap 2024-04-18T21:04:54.483 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:04:54.485+0000 7fdbaccd4640 -1 osd.2 0 waiting for initial osdmap 2024-04-18T21:04:54.494 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:04:54.495+0000 7fbc21b45640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:04:54.511 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:04:54.513+0000 7fdba42f6640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:04:54.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:04:54.553+0000 7fb54470c640 -1 osd.1 0 waiting for initial osdmap 2024-04-18T21:04:54.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:04:54.581+0000 7fb53c540640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:04:54.872 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T21:04:55.179 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-18T21:04:55.179 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":7,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:04:53.657437+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:04:55.197 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-18T21:05:01.500 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:01.794 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-18T21:05:01.795 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":11,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:04:58.497233+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:01.811 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-18T21:05:01.811 INFO:tasks.ceph:Creating RBD pool 2024-04-18T21:05:01.811 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-18T21:05:02.531 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'rbd' created 2024-04-18T21:05:02.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-18T21:05:03.539 INFO:teuthology.orchestra.run.smithi096.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-18T21:05:03.564 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-18T21:05:03.564 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T21:05:03.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T21:05:03.567 INFO:tasks.ceph.mds.a:Started 2024-04-18T21:05:03.567 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-18T21:05:03.567 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:03.650 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-18T21:05:03.866 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:03.866 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":13,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:03.534290+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:03.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:03.883 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:04.168 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T21:05:04.185 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:04.453 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-18T21:05:04.470 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6803/2660214547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2660214547},{"type":"v1","addr":"172.21.15.96:6803","nonce":2660214547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-18T21:05:04.771 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2024-04-18T21:05:04.789 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:05.065 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":14,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:04.544316+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:05.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:05.083 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:05.362 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T21:05:05.379 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:05.666 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-18T21:05:05.683 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 2, 2024-04-18T21:05:05.963 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": "rbd" 2024-04-18T21:05:05.964 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:05.964 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-04-18T21:05:05.981 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-18T21:05:05.981 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-18T21:05:06.563 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-04-18T21:05:06.586 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-18T21:05:07.561 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-04-18T21:05:07.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-18T21:05:08.589 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 3 and data pool 4 2024-04-18T21:05:08.613 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:08.905 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:08.905 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:07.912355+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:08.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:09.221 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:09.221 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:07.912355+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:09.239 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-18T21:05:09.606 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-18T21:05:09.606 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-18T21:05:10.624 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-18T21:05:10.624 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:10.933 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:10.933 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:07.912310+0000","modified":"2024-04-18T21:05:09.941505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/2660214547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2660214547},{"type":"v1","addr":"172.21.15.96:6803","nonce":2660214547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:10.933 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-18T21:05:10.950 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:11.244 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:11.244 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:09.584166+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:11.263 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-18T21:05:11.263 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:11.559 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:11.561 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:11.575 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-18T21:05:09.605541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85712,"kb_used_data":488,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029808,"statfs":{"total":289910292480,"available":289822523392,"internally_reserved":0,"allocated":499712,"data_stored":1291175,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000839"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":214,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.551578+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:04.551578+0000","last_peered":"2024-04-18T21:05:04.551578+0000","last_clean":"2024-04-18T21:05:04.551578+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:04.551578+0000","last_undegraded":"2024-04-18T21:05:04.551578+0000","last_fullsized":"2024-04-18T21:05:04.551578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.551873+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:04.551873+0000","last_peered":"2024-04-18T21:05:04.551873+0000","last_clean":"2024-04-18T21:05:04.551873+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:04.551873+0000","last_undegraded":"2024-04-18T21:05:04.551873+0000","last_fullsized":"2024-04-18T21:05:04.551873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.551756+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:04.551756+0000","last_peered":"2024-04-18T21:05:04.551756+0000","last_clean":"2024-04-18T21:05:04.551756+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:04.551756+0000","last_undegraded":"2024-04-18T21:05:04.551756+0000","last_fullsized":"2024-04-18T21:05:04.551756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.551928+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:04.551928+0000","last_peered":"2024-04-18T21:05:04.551928+0000","last_clean":"2024-04-18T21:05:04.551928+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:04.551928+0000","last_undegraded":"2024-04-18T21:05:04.551928+0000","last_fullsized":"2024-04-18T21:05:04.551928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.552020+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:04.552020+0000","last_peered":"2024-04-18T21:05:04.552020+0000","last_clean":"2024-04-18T21:05:04.552020+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:04.552020+0000","last_undegraded":"2024-04-18T21:05:04.552020+0000","last_fullsized":"2024-04-18T21:05:04.552020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.551842+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:04.551842+0000","last_peered":"2024-04-18T21:05:04.551842+0000","last_clean":"2024-04-18T21:05:04.551842+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:04.551842+0000","last_undegraded":"2024-04-18T21:05:04.551842+0000","last_fullsized":"2024-04-18T21:05:04.551842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.551326+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:04.551326+0000","last_peered":"2024-04-18T21:05:04.551326+0000","last_clean":"2024-04-18T21:05:04.551326+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:04.551326+0000","last_undegraded":"2024-04-18T21:05:04.551326+0000","last_fullsized":"2024-04-18T21:05:04.551326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.551810+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:04.551810+0000","last_peered":"2024-04-18T21:05:04.551810+0000","last_clean":"2024-04-18T21:05:04.551810+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:04.551810+0000","last_undegraded":"2024-04-18T21:05:04.551810+0000","last_fullsized":"2024-04-18T21:05:04.551810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T21:05:04.552019+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:04.552019+0000","last_peered":"2024-04-18T21:05:04.552019+0000","last_clean":"2024-04-18T21:05:04.552019+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:04.552019+0000","last_undegraded":"2024-04-18T21:05:04.552019+0000","last_fullsized":"2024-04-18T21:05:04.552019+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:07.559603+0000","last_change":"2024-04-18T21:05:07.559603+0000","last_active":"2024-04-18T21:05:07.559603+0000","last_peered":"2024-04-18T21:05:07.559603+0000","last_clean":"2024-04-18T21:05:07.559603+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:07.559603+0000","last_undegraded":"2024-04-18T21:05:07.559603+0000","last_fullsized":"2024-04-18T21:05:07.559603+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T21:05:06.550148+0000","last_change":"2024-04-18T21:05:06.550148+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:05:06.550148+0000","last_undegraded":"2024-04-18T21:05:06.550148+0000","last_fullsized":"2024-04-18T21:05:06.550148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":188416,"data_stored":627181,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":36813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":188416,"data_stored":627181,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:11.579 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:11.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:11.917 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:11.932 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T21:05:11.605882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90044,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025476,"statfs":{"total":289910292480,"available":289818087424,"internally_reserved":0,"allocated":663552,"data_stored":1350892,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.043718"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598968+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:09.598968+0000","last_peered":"2024-04-18T21:05:09.598968+0000","last_clean":"2024-04-18T21:05:09.598968+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:09.598968+0000","last_undegraded":"2024-04-18T21:05:09.598968+0000","last_fullsized":"2024-04-18T21:05:09.598968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597992+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:09.597992+0000","last_peered":"2024-04-18T21:05:09.597992+0000","last_clean":"2024-04-18T21:05:09.597992+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:09.597992+0000","last_undegraded":"2024-04-18T21:05:09.597992+0000","last_fullsized":"2024-04-18T21:05:09.597992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598070+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:09.598070+0000","last_peered":"2024-04-18T21:05:09.598070+0000","last_clean":"2024-04-18T21:05:09.598070+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:09.598070+0000","last_undegraded":"2024-04-18T21:05:09.598070+0000","last_fullsized":"2024-04-18T21:05:09.598070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599912+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:09.599912+0000","last_peered":"2024-04-18T21:05:09.599912+0000","last_clean":"2024-04-18T21:05:09.599912+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:09.599912+0000","last_undegraded":"2024-04-18T21:05:09.599912+0000","last_fullsized":"2024-04-18T21:05:09.599912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598039+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:09.598039+0000","last_peered":"2024-04-18T21:05:09.598039+0000","last_clean":"2024-04-18T21:05:09.598039+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:09.598039+0000","last_undegraded":"2024-04-18T21:05:09.598039+0000","last_fullsized":"2024-04-18T21:05:09.598039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597637+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:09.597637+0000","last_peered":"2024-04-18T21:05:09.597637+0000","last_clean":"2024-04-18T21:05:09.597637+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:09.597637+0000","last_undegraded":"2024-04-18T21:05:09.597637+0000","last_fullsized":"2024-04-18T21:05:09.597637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598279+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:09.598279+0000","last_peered":"2024-04-18T21:05:09.598279+0000","last_clean":"2024-04-18T21:05:09.598279+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:09.598279+0000","last_undegraded":"2024-04-18T21:05:09.598279+0000","last_fullsized":"2024-04-18T21:05:09.598279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596977+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:09.596977+0000","last_peered":"2024-04-18T21:05:09.596977+0000","last_clean":"2024-04-18T21:05:09.596977+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:09.596977+0000","last_undegraded":"2024-04-18T21:05:09.596977+0000","last_fullsized":"2024-04-18T21:05:09.596977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598461+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:09.598461+0000","last_peered":"2024-04-18T21:05:09.598461+0000","last_clean":"2024-04-18T21:05:09.598461+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:09.598461+0000","last_undegraded":"2024-04-18T21:05:09.598461+0000","last_fullsized":"2024-04-18T21:05:09.598461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598421+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:09.598421+0000","last_peered":"2024-04-18T21:05:09.598421+0000","last_clean":"2024-04-18T21:05:09.598421+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:09.598421+0000","last_undegraded":"2024-04-18T21:05:09.598421+0000","last_fullsized":"2024-04-18T21:05:09.598421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598782+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:09.598782+0000","last_peered":"2024-04-18T21:05:09.598782+0000","last_clean":"2024-04-18T21:05:09.598782+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:09.598782+0000","last_undegraded":"2024-04-18T21:05:09.598782+0000","last_fullsized":"2024-04-18T21:05:09.598782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598444+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:09.598444+0000","last_peered":"2024-04-18T21:05:09.598444+0000","last_clean":"2024-04-18T21:05:09.598444+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:09.598444+0000","last_undegraded":"2024-04-18T21:05:09.598444+0000","last_fullsized":"2024-04-18T21:05:09.598444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597755+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:09.597755+0000","last_peered":"2024-04-18T21:05:09.597755+0000","last_clean":"2024-04-18T21:05:09.597755+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:09.597755+0000","last_undegraded":"2024-04-18T21:05:09.597755+0000","last_fullsized":"2024-04-18T21:05:09.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598086+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:09.598086+0000","last_peered":"2024-04-18T21:05:09.598086+0000","last_clean":"2024-04-18T21:05:09.598086+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:09.598086+0000","last_undegraded":"2024-04-18T21:05:09.598086+0000","last_fullsized":"2024-04-18T21:05:09.598086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597654+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:09.597654+0000","last_peered":"2024-04-18T21:05:09.597654+0000","last_clean":"2024-04-18T21:05:09.597654+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:09.597654+0000","last_undegraded":"2024-04-18T21:05:09.597654+0000","last_fullsized":"2024-04-18T21:05:09.597654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597079+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:09.597079+0000","last_peered":"2024-04-18T21:05:09.597079+0000","last_clean":"2024-04-18T21:05:09.597079+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:09.597079+0000","last_undegraded":"2024-04-18T21:05:09.597079+0000","last_fullsized":"2024-04-18T21:05:09.597079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599986+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:09.599986+0000","last_peered":"2024-04-18T21:05:09.599986+0000","last_clean":"2024-04-18T21:05:09.599986+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:09.599986+0000","last_undegraded":"2024-04-18T21:05:09.599986+0000","last_fullsized":"2024-04-18T21:05:09.599986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599139+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:09.599139+0000","last_peered":"2024-04-18T21:05:09.599139+0000","last_clean":"2024-04-18T21:05:09.599139+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:09.599139+0000","last_undegraded":"2024-04-18T21:05:09.599139+0000","last_fullsized":"2024-04-18T21:05:09.599139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598392+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:09.598392+0000","last_peered":"2024-04-18T21:05:09.598392+0000","last_clean":"2024-04-18T21:05:09.598392+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:09.598392+0000","last_undegraded":"2024-04-18T21:05:09.598392+0000","last_fullsized":"2024-04-18T21:05:09.598392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599335+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:09.599335+0000","last_peered":"2024-04-18T21:05:09.599335+0000","last_clean":"2024-04-18T21:05:09.599335+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:09.599335+0000","last_undegraded":"2024-04-18T21:05:09.599335+0000","last_fullsized":"2024-04-18T21:05:09.599335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599660+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:09.599660+0000","last_peered":"2024-04-18T21:05:09.599660+0000","last_clean":"2024-04-18T21:05:09.599660+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:09.599660+0000","last_undegraded":"2024-04-18T21:05:09.599660+0000","last_fullsized":"2024-04-18T21:05:09.599660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597324+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:09.597324+0000","last_peered":"2024-04-18T21:05:09.597324+0000","last_clean":"2024-04-18T21:05:09.597324+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:09.597324+0000","last_undegraded":"2024-04-18T21:05:09.597324+0000","last_fullsized":"2024-04-18T21:05:09.597324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597169+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:09.597169+0000","last_peered":"2024-04-18T21:05:09.597169+0000","last_clean":"2024-04-18T21:05:09.597169+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:09.597169+0000","last_undegraded":"2024-04-18T21:05:09.597169+0000","last_fullsized":"2024-04-18T21:05:09.597169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597772+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:09.597772+0000","last_peered":"2024-04-18T21:05:09.597772+0000","last_clean":"2024-04-18T21:05:09.597772+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:09.597772+0000","last_undegraded":"2024-04-18T21:05:09.597772+0000","last_fullsized":"2024-04-18T21:05:09.597772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598943+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:09.598943+0000","last_peered":"2024-04-18T21:05:09.598943+0000","last_clean":"2024-04-18T21:05:09.598943+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:09.598943+0000","last_undegraded":"2024-04-18T21:05:09.598943+0000","last_fullsized":"2024-04-18T21:05:09.598943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599108+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:09.599108+0000","last_peered":"2024-04-18T21:05:09.599108+0000","last_clean":"2024-04-18T21:05:09.599108+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:09.599108+0000","last_undegraded":"2024-04-18T21:05:09.599108+0000","last_fullsized":"2024-04-18T21:05:09.599108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599150+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:09.599150+0000","last_peered":"2024-04-18T21:05:09.599150+0000","last_clean":"2024-04-18T21:05:09.599150+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:09.599150+0000","last_undegraded":"2024-04-18T21:05:09.599150+0000","last_fullsized":"2024-04-18T21:05:09.599150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599471+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:09.599471+0000","last_peered":"2024-04-18T21:05:09.599471+0000","last_clean":"2024-04-18T21:05:09.599471+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:09.599471+0000","last_undegraded":"2024-04-18T21:05:09.599471+0000","last_fullsized":"2024-04-18T21:05:09.599471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598876+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:09.598876+0000","last_peered":"2024-04-18T21:05:09.598876+0000","last_clean":"2024-04-18T21:05:09.598876+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:09.598876+0000","last_undegraded":"2024-04-18T21:05:09.598876+0000","last_fullsized":"2024-04-18T21:05:09.598876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597939+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:09.597939+0000","last_peered":"2024-04-18T21:05:09.597939+0000","last_clean":"2024-04-18T21:05:09.597939+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:09.597939+0000","last_undegraded":"2024-04-18T21:05:09.597939+0000","last_fullsized":"2024-04-18T21:05:09.597939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597358+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:09.597358+0000","last_peered":"2024-04-18T21:05:09.597358+0000","last_clean":"2024-04-18T21:05:09.597358+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:09.597358+0000","last_undegraded":"2024-04-18T21:05:09.597358+0000","last_fullsized":"2024-04-18T21:05:09.597358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597398+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:09.597398+0000","last_peered":"2024-04-18T21:05:09.597398+0000","last_clean":"2024-04-18T21:05:09.597398+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:09.597398+0000","last_undegraded":"2024-04-18T21:05:09.597398+0000","last_fullsized":"2024-04-18T21:05:09.597398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598760+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:09.598760+0000","last_peered":"2024-04-18T21:05:09.598760+0000","last_clean":"2024-04-18T21:05:09.598760+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:09.598760+0000","last_undegraded":"2024-04-18T21:05:09.598760+0000","last_fullsized":"2024-04-18T21:05:09.598760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599367+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:09.599367+0000","last_peered":"2024-04-18T21:05:09.599367+0000","last_clean":"2024-04-18T21:05:09.599367+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:09.599367+0000","last_undegraded":"2024-04-18T21:05:09.599367+0000","last_fullsized":"2024-04-18T21:05:09.599367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599082+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:09.599082+0000","last_peered":"2024-04-18T21:05:09.599082+0000","last_clean":"2024-04-18T21:05:09.599082+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:09.599082+0000","last_undegraded":"2024-04-18T21:05:09.599082+0000","last_fullsized":"2024-04-18T21:05:09.599082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597915+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:09.597915+0000","last_peered":"2024-04-18T21:05:09.597915+0000","last_clean":"2024-04-18T21:05:09.597915+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:09.597915+0000","last_undegraded":"2024-04-18T21:05:09.597915+0000","last_fullsized":"2024-04-18T21:05:09.597915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600134+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:09.600134+0000","last_peered":"2024-04-18T21:05:09.600134+0000","last_clean":"2024-04-18T21:05:09.600134+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:09.600134+0000","last_undegraded":"2024-04-18T21:05:09.600134+0000","last_fullsized":"2024-04-18T21:05:09.600134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598229+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:09.598229+0000","last_peered":"2024-04-18T21:05:09.598229+0000","last_clean":"2024-04-18T21:05:09.598229+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:09.598229+0000","last_undegraded":"2024-04-18T21:05:09.598229+0000","last_fullsized":"2024-04-18T21:05:09.598229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598658+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:09.598658+0000","last_peered":"2024-04-18T21:05:09.598658+0000","last_clean":"2024-04-18T21:05:09.598658+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:09.598658+0000","last_undegraded":"2024-04-18T21:05:09.598658+0000","last_fullsized":"2024-04-18T21:05:09.598658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597388+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:09.597388+0000","last_peered":"2024-04-18T21:05:09.597388+0000","last_clean":"2024-04-18T21:05:09.597388+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:09.597388+0000","last_undegraded":"2024-04-18T21:05:09.597388+0000","last_fullsized":"2024-04-18T21:05:09.597388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596837+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:09.596837+0000","last_peered":"2024-04-18T21:05:09.596837+0000","last_clean":"2024-04-18T21:05:09.596837+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:09.596837+0000","last_undegraded":"2024-04-18T21:05:09.596837+0000","last_fullsized":"2024-04-18T21:05:09.596837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599636+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:09.599636+0000","last_peered":"2024-04-18T21:05:09.599636+0000","last_clean":"2024-04-18T21:05:09.599636+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:09.599636+0000","last_undegraded":"2024-04-18T21:05:09.599636+0000","last_fullsized":"2024-04-18T21:05:09.599636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596976+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:09.596976+0000","last_peered":"2024-04-18T21:05:09.596976+0000","last_clean":"2024-04-18T21:05:09.596976+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:09.596976+0000","last_undegraded":"2024-04-18T21:05:09.596976+0000","last_fullsized":"2024-04-18T21:05:09.596976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599727+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:09.599727+0000","last_peered":"2024-04-18T21:05:09.599727+0000","last_clean":"2024-04-18T21:05:09.599727+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:09.599727+0000","last_undegraded":"2024-04-18T21:05:09.599727+0000","last_fullsized":"2024-04-18T21:05:09.599727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598512+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:09.598512+0000","last_peered":"2024-04-18T21:05:09.598512+0000","last_clean":"2024-04-18T21:05:09.598512+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:09.598512+0000","last_undegraded":"2024-04-18T21:05:09.598512+0000","last_fullsized":"2024-04-18T21:05:09.598512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600048+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:09.600048+0000","last_peered":"2024-04-18T21:05:09.600048+0000","last_clean":"2024-04-18T21:05:09.600048+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:09.600048+0000","last_undegraded":"2024-04-18T21:05:09.600048+0000","last_fullsized":"2024-04-18T21:05:09.600048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599364+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:09.599364+0000","last_peered":"2024-04-18T21:05:09.599364+0000","last_clean":"2024-04-18T21:05:09.599364+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:09.599364+0000","last_undegraded":"2024-04-18T21:05:09.599364+0000","last_fullsized":"2024-04-18T21:05:09.599364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599469+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:09.599469+0000","last_peered":"2024-04-18T21:05:09.599469+0000","last_clean":"2024-04-18T21:05:09.599469+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:09.599469+0000","last_undegraded":"2024-04-18T21:05:09.599469+0000","last_fullsized":"2024-04-18T21:05:09.599469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599735+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:09.599735+0000","last_peered":"2024-04-18T21:05:09.599735+0000","last_clean":"2024-04-18T21:05:09.599735+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:09.599735+0000","last_undegraded":"2024-04-18T21:05:09.599735+0000","last_fullsized":"2024-04-18T21:05:09.599735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599299+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:09.599299+0000","last_peered":"2024-04-18T21:05:09.599299+0000","last_clean":"2024-04-18T21:05:09.599299+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:09.599299+0000","last_undegraded":"2024-04-18T21:05:09.599299+0000","last_fullsized":"2024-04-18T21:05:09.599299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599447+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:09.599447+0000","last_peered":"2024-04-18T21:05:09.599447+0000","last_clean":"2024-04-18T21:05:09.599447+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:09.599447+0000","last_undegraded":"2024-04-18T21:05:09.599447+0000","last_fullsized":"2024-04-18T21:05:09.599447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598762+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:09.598762+0000","last_peered":"2024-04-18T21:05:09.598762+0000","last_clean":"2024-04-18T21:05:09.598762+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:09.598762+0000","last_undegraded":"2024-04-18T21:05:09.598762+0000","last_fullsized":"2024-04-18T21:05:09.598762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599000+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:09.599000+0000","last_peered":"2024-04-18T21:05:09.599000+0000","last_clean":"2024-04-18T21:05:09.599000+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:09.599000+0000","last_undegraded":"2024-04-18T21:05:09.599000+0000","last_fullsized":"2024-04-18T21:05:09.599000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598602+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:09.598602+0000","last_peered":"2024-04-18T21:05:09.598602+0000","last_clean":"2024-04-18T21:05:09.598602+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:09.598602+0000","last_undegraded":"2024-04-18T21:05:09.598602+0000","last_fullsized":"2024-04-18T21:05:09.598602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598948+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:09.598948+0000","last_peered":"2024-04-18T21:05:09.598948+0000","last_clean":"2024-04-18T21:05:09.598948+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:09.598948+0000","last_undegraded":"2024-04-18T21:05:09.598948+0000","last_fullsized":"2024-04-18T21:05:09.598948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597968+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:09.597968+0000","last_peered":"2024-04-18T21:05:09.597968+0000","last_clean":"2024-04-18T21:05:09.597968+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:09.597968+0000","last_undegraded":"2024-04-18T21:05:09.597968+0000","last_fullsized":"2024-04-18T21:05:09.597968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599722+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:09.599722+0000","last_peered":"2024-04-18T21:05:09.599722+0000","last_clean":"2024-04-18T21:05:09.599722+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:09.599722+0000","last_undegraded":"2024-04-18T21:05:09.599722+0000","last_fullsized":"2024-04-18T21:05:09.599722+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598414+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:09.598414+0000","last_peered":"2024-04-18T21:05:09.598414+0000","last_clean":"2024-04-18T21:05:09.598414+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:09.598414+0000","last_undegraded":"2024-04-18T21:05:09.598414+0000","last_fullsized":"2024-04-18T21:05:09.598414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599554+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:09.599554+0000","last_peered":"2024-04-18T21:05:09.599554+0000","last_clean":"2024-04-18T21:05:09.599554+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:09.599554+0000","last_undegraded":"2024-04-18T21:05:09.599554+0000","last_fullsized":"2024-04-18T21:05:09.599554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597870+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:09.597870+0000","last_peered":"2024-04-18T21:05:09.597870+0000","last_clean":"2024-04-18T21:05:09.597870+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:09.597870+0000","last_undegraded":"2024-04-18T21:05:09.597870+0000","last_fullsized":"2024-04-18T21:05:09.597870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597919+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:09.597919+0000","last_peered":"2024-04-18T21:05:09.597919+0000","last_clean":"2024-04-18T21:05:09.597919+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:09.597919+0000","last_undegraded":"2024-04-18T21:05:09.597919+0000","last_fullsized":"2024-04-18T21:05:09.597919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599217+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:09.599217+0000","last_peered":"2024-04-18T21:05:09.599217+0000","last_clean":"2024-04-18T21:05:09.599217+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:09.599217+0000","last_undegraded":"2024-04-18T21:05:09.599217+0000","last_fullsized":"2024-04-18T21:05:09.599217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598327+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:09.598327+0000","last_peered":"2024-04-18T21:05:09.598327+0000","last_clean":"2024-04-18T21:05:09.598327+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:09.598327+0000","last_undegraded":"2024-04-18T21:05:09.598327+0000","last_fullsized":"2024-04-18T21:05:09.598327+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598804+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:09.598804+0000","last_peered":"2024-04-18T21:05:09.598804+0000","last_clean":"2024-04-18T21:05:09.598804+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:09.598804+0000","last_undegraded":"2024-04-18T21:05:09.598804+0000","last_fullsized":"2024-04-18T21:05:09.598804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599075+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:09.599075+0000","last_peered":"2024-04-18T21:05:09.599075+0000","last_clean":"2024-04-18T21:05:09.599075+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:09.599075+0000","last_undegraded":"2024-04-18T21:05:09.599075+0000","last_fullsized":"2024-04-18T21:05:09.599075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599404+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:09.599404+0000","last_peered":"2024-04-18T21:05:09.599404+0000","last_clean":"2024-04-18T21:05:09.599404+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:09.599404+0000","last_undegraded":"2024-04-18T21:05:09.599404+0000","last_fullsized":"2024-04-18T21:05:09.599404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599639+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:09.599639+0000","last_peered":"2024-04-18T21:05:09.599639+0000","last_clean":"2024-04-18T21:05:09.599639+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:09.599639+0000","last_undegraded":"2024-04-18T21:05:09.599639+0000","last_fullsized":"2024-04-18T21:05:09.599639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600069+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:09.600069+0000","last_peered":"2024-04-18T21:05:09.600069+0000","last_clean":"2024-04-18T21:05:09.600069+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:09.600069+0000","last_undegraded":"2024-04-18T21:05:09.600069+0000","last_fullsized":"2024-04-18T21:05:09.600069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599802+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:09.599802+0000","last_peered":"2024-04-18T21:05:09.599802+0000","last_clean":"2024-04-18T21:05:09.599802+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:09.599802+0000","last_undegraded":"2024-04-18T21:05:09.599802+0000","last_fullsized":"2024-04-18T21:05:09.599802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600141+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:09.600141+0000","last_peered":"2024-04-18T21:05:09.600141+0000","last_clean":"2024-04-18T21:05:09.600141+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:09.600141+0000","last_undegraded":"2024-04-18T21:05:09.600141+0000","last_fullsized":"2024-04-18T21:05:09.600141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597468+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:09.597468+0000","last_peered":"2024-04-18T21:05:09.597468+0000","last_clean":"2024-04-18T21:05:09.597468+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:09.597468+0000","last_undegraded":"2024-04-18T21:05:09.597468+0000","last_fullsized":"2024-04-18T21:05:09.597468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600143+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:09.600143+0000","last_peered":"2024-04-18T21:05:09.600143+0000","last_clean":"2024-04-18T21:05:09.600143+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:09.600143+0000","last_undegraded":"2024-04-18T21:05:09.600143+0000","last_fullsized":"2024-04-18T21:05:09.600143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600066+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:09.600066+0000","last_peered":"2024-04-18T21:05:09.600066+0000","last_clean":"2024-04-18T21:05:09.600066+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:09.600066+0000","last_undegraded":"2024-04-18T21:05:09.600066+0000","last_fullsized":"2024-04-18T21:05:09.600066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597586+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:09.597586+0000","last_peered":"2024-04-18T21:05:09.597586+0000","last_clean":"2024-04-18T21:05:09.597586+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:09.597586+0000","last_undegraded":"2024-04-18T21:05:09.597586+0000","last_fullsized":"2024-04-18T21:05:09.597586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599991+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:09.599991+0000","last_peered":"2024-04-18T21:05:09.599991+0000","last_clean":"2024-04-18T21:05:09.599991+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:09.599991+0000","last_undegraded":"2024-04-18T21:05:09.599991+0000","last_fullsized":"2024-04-18T21:05:09.599991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600385+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:09.600385+0000","last_peered":"2024-04-18T21:05:09.600385+0000","last_clean":"2024-04-18T21:05:09.600385+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:09.600385+0000","last_undegraded":"2024-04-18T21:05:09.600385+0000","last_fullsized":"2024-04-18T21:05:09.600385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598019+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:09.598019+0000","last_peered":"2024-04-18T21:05:09.598019+0000","last_clean":"2024-04-18T21:05:09.598019+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:09.598019+0000","last_undegraded":"2024-04-18T21:05:09.598019+0000","last_fullsized":"2024-04-18T21:05:09.598019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600388+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:09.600388+0000","last_peered":"2024-04-18T21:05:09.600388+0000","last_clean":"2024-04-18T21:05:09.600388+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:09.600388+0000","last_undegraded":"2024-04-18T21:05:09.600388+0000","last_fullsized":"2024-04-18T21:05:09.600388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597980+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:09.597980+0000","last_peered":"2024-04-18T21:05:09.597980+0000","last_clean":"2024-04-18T21:05:09.597980+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:09.597980+0000","last_undegraded":"2024-04-18T21:05:09.597980+0000","last_fullsized":"2024-04-18T21:05:09.597980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597890+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:09.597890+0000","last_peered":"2024-04-18T21:05:09.597890+0000","last_clean":"2024-04-18T21:05:09.597890+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:09.597890+0000","last_undegraded":"2024-04-18T21:05:09.597890+0000","last_fullsized":"2024-04-18T21:05:09.597890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600046+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:09.600046+0000","last_peered":"2024-04-18T21:05:09.600046+0000","last_clean":"2024-04-18T21:05:09.600046+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:09.600046+0000","last_undegraded":"2024-04-18T21:05:09.600046+0000","last_fullsized":"2024-04-18T21:05:09.600046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598801+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:09.598801+0000","last_peered":"2024-04-18T21:05:09.598801+0000","last_clean":"2024-04-18T21:05:09.598801+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:09.598801+0000","last_undegraded":"2024-04-18T21:05:09.598801+0000","last_fullsized":"2024-04-18T21:05:09.598801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599682+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:09.599682+0000","last_peered":"2024-04-18T21:05:09.599682+0000","last_clean":"2024-04-18T21:05:09.599682+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:09.599682+0000","last_undegraded":"2024-04-18T21:05:09.599682+0000","last_fullsized":"2024-04-18T21:05:09.599682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598593+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:09.598593+0000","last_peered":"2024-04-18T21:05:09.598593+0000","last_clean":"2024-04-18T21:05:09.598593+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:09.598593+0000","last_undegraded":"2024-04-18T21:05:09.598593+0000","last_fullsized":"2024-04-18T21:05:09.598593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597624+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:09.597624+0000","last_peered":"2024-04-18T21:05:09.597624+0000","last_clean":"2024-04-18T21:05:09.597624+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:09.597624+0000","last_undegraded":"2024-04-18T21:05:09.597624+0000","last_fullsized":"2024-04-18T21:05:09.597624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599784+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:09.599784+0000","last_peered":"2024-04-18T21:05:09.599784+0000","last_clean":"2024-04-18T21:05:09.599784+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:09.599784+0000","last_undegraded":"2024-04-18T21:05:09.599784+0000","last_fullsized":"2024-04-18T21:05:09.599784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597293+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:09.597293+0000","last_peered":"2024-04-18T21:05:09.597293+0000","last_clean":"2024-04-18T21:05:09.597293+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:09.597293+0000","last_undegraded":"2024-04-18T21:05:09.597293+0000","last_fullsized":"2024-04-18T21:05:09.597293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599648+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:09.599648+0000","last_peered":"2024-04-18T21:05:09.599648+0000","last_clean":"2024-04-18T21:05:09.599648+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:09.599648+0000","last_undegraded":"2024-04-18T21:05:09.599648+0000","last_fullsized":"2024-04-18T21:05:09.599648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598342+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:09.598342+0000","last_peered":"2024-04-18T21:05:09.598342+0000","last_clean":"2024-04-18T21:05:09.598342+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:09.598342+0000","last_undegraded":"2024-04-18T21:05:09.598342+0000","last_fullsized":"2024-04-18T21:05:09.598342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599489+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:09.599489+0000","last_peered":"2024-04-18T21:05:09.599489+0000","last_clean":"2024-04-18T21:05:09.599489+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:09.599489+0000","last_undegraded":"2024-04-18T21:05:09.599489+0000","last_fullsized":"2024-04-18T21:05:09.599489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598559+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:09.598559+0000","last_peered":"2024-04-18T21:05:09.598559+0000","last_clean":"2024-04-18T21:05:09.598559+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:09.598559+0000","last_undegraded":"2024-04-18T21:05:09.598559+0000","last_fullsized":"2024-04-18T21:05:09.598559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598371+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:09.598371+0000","last_peered":"2024-04-18T21:05:09.598371+0000","last_clean":"2024-04-18T21:05:09.598371+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:09.598371+0000","last_undegraded":"2024-04-18T21:05:09.598371+0000","last_fullsized":"2024-04-18T21:05:09.598371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598001+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:09.598001+0000","last_peered":"2024-04-18T21:05:09.598001+0000","last_clean":"2024-04-18T21:05:09.598001+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:09.598001+0000","last_undegraded":"2024-04-18T21:05:09.598001+0000","last_fullsized":"2024-04-18T21:05:09.598001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598312+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:09.598312+0000","last_peered":"2024-04-18T21:05:09.598312+0000","last_clean":"2024-04-18T21:05:09.598312+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:09.598312+0000","last_undegraded":"2024-04-18T21:05:09.598312+0000","last_fullsized":"2024-04-18T21:05:09.598312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598393+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:09.598393+0000","last_peered":"2024-04-18T21:05:09.598393+0000","last_clean":"2024-04-18T21:05:09.598393+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:09.598393+0000","last_undegraded":"2024-04-18T21:05:09.598393+0000","last_fullsized":"2024-04-18T21:05:09.598393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599054+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:09.599054+0000","last_peered":"2024-04-18T21:05:09.599054+0000","last_clean":"2024-04-18T21:05:09.599054+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:09.599054+0000","last_undegraded":"2024-04-18T21:05:09.599054+0000","last_fullsized":"2024-04-18T21:05:09.599054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599890+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:09.599890+0000","last_peered":"2024-04-18T21:05:09.599890+0000","last_clean":"2024-04-18T21:05:09.599890+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:09.599890+0000","last_undegraded":"2024-04-18T21:05:09.599890+0000","last_fullsized":"2024-04-18T21:05:09.599890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599262+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:09.599262+0000","last_peered":"2024-04-18T21:05:09.599262+0000","last_clean":"2024-04-18T21:05:09.599262+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:09.599262+0000","last_undegraded":"2024-04-18T21:05:09.599262+0000","last_fullsized":"2024-04-18T21:05:09.599262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599155+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:09.599155+0000","last_peered":"2024-04-18T21:05:09.599155+0000","last_clean":"2024-04-18T21:05:09.599155+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:09.599155+0000","last_undegraded":"2024-04-18T21:05:09.599155+0000","last_fullsized":"2024-04-18T21:05:09.599155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599141+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:09.599141+0000","last_peered":"2024-04-18T21:05:09.599141+0000","last_clean":"2024-04-18T21:05:09.599141+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:09.599141+0000","last_undegraded":"2024-04-18T21:05:09.599141+0000","last_fullsized":"2024-04-18T21:05:09.599141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600318+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:09.600318+0000","last_peered":"2024-04-18T21:05:09.600318+0000","last_clean":"2024-04-18T21:05:09.600318+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:09.600318+0000","last_undegraded":"2024-04-18T21:05:09.600318+0000","last_fullsized":"2024-04-18T21:05:09.600318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597823+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:09.597823+0000","last_peered":"2024-04-18T21:05:09.597823+0000","last_clean":"2024-04-18T21:05:09.597823+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:09.597823+0000","last_undegraded":"2024-04-18T21:05:09.597823+0000","last_fullsized":"2024-04-18T21:05:09.597823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599251+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:09.599251+0000","last_peered":"2024-04-18T21:05:09.599251+0000","last_clean":"2024-04-18T21:05:09.599251+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:09.599251+0000","last_undegraded":"2024-04-18T21:05:09.599251+0000","last_fullsized":"2024-04-18T21:05:09.599251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":647274,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":647890,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:11.936 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-18T21:05:11.936 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T21:05:11.936 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T21:05:11.937 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T21:05:11.937 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-18T21:05:12.297 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:12.313 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1307184140},{"type":"v1","addr":"172.21.15.96:6801","nonce":1307184140}]},"active_addr":"172.21.15.96:6801/1307184140","active_change":"2024-04-18T21:04:51.591479+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3041280334}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2987142766}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1787401383}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3787608338}]}]} 2024-04-18T21:05:12.316 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T21:05:12.316 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T21:05:12.316 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:12.619 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:12.619 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:09.584166+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:12.636 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T21:05:12.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:12.925 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:12.925 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:09.584166+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:12.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T21:05:12.944 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T21:05:12.944 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T21:05:13.096 INFO:teuthology.orchestra.run.smithi096.stdout:34359738375 2024-04-18T21:05:13.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:05:13.114 INFO:teuthology.orchestra.run.smithi096.stdout:34359738375 2024-04-18T21:05:13.114 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:05:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:34359738375 2024-04-18T21:05:13.115 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:05:13.424 INFO:teuthology.orchestra.run.smithi096.stdout:34359738374 2024-04-18T21:05:13.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-04-18T21:05:13.457 INFO:teuthology.orchestra.run.smithi096.stdout:34359738374 2024-04-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi096.stdout:34359738374 2024-04-18T21:05:13.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-04-18T21:05:13.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-04-18T21:05:13.680 INFO:tasks.ceph.mds.a.smithi096.stderr:2024-04-18T21:05:13.676+0000 7f1e544aa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-18T21:05:14.442 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:05:14.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:05:14.481 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:05:14.752 INFO:teuthology.orchestra.run.smithi096.stdout:34359738375 2024-04-18T21:05:14.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-04-18T21:05:14.771 DEBUG:teuthology.parallel:result is None 2024-04-18T21:05:14.784 INFO:teuthology.orchestra.run.smithi096.stdout:34359738375 2024-04-18T21:05:14.786 INFO:teuthology.orchestra.run.smithi096.stdout:34359738375 2024-04-18T21:05:14.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-04-18T21:05:14.804 DEBUG:teuthology.parallel:result is None 2024-04-18T21:05:14.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-04-18T21:05:14.805 DEBUG:teuthology.parallel:result is None 2024-04-18T21:05:14.805 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T21:05:14.805 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:15.125 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:15.127 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:15.142 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-18T21:05:13.606534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90044,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025476,"statfs":{"total":289910292480,"available":289818087424,"internally_reserved":0,"allocated":663552,"data_stored":1350892,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.040491"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598968+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:09.598968+0000","last_peered":"2024-04-18T21:05:09.598968+0000","last_clean":"2024-04-18T21:05:09.598968+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:09.598968+0000","last_undegraded":"2024-04-18T21:05:09.598968+0000","last_fullsized":"2024-04-18T21:05:09.598968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597992+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:09.597992+0000","last_peered":"2024-04-18T21:05:09.597992+0000","last_clean":"2024-04-18T21:05:09.597992+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:09.597992+0000","last_undegraded":"2024-04-18T21:05:09.597992+0000","last_fullsized":"2024-04-18T21:05:09.597992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598070+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:09.598070+0000","last_peered":"2024-04-18T21:05:09.598070+0000","last_clean":"2024-04-18T21:05:09.598070+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:09.598070+0000","last_undegraded":"2024-04-18T21:05:09.598070+0000","last_fullsized":"2024-04-18T21:05:09.598070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599912+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:09.599912+0000","last_peered":"2024-04-18T21:05:09.599912+0000","last_clean":"2024-04-18T21:05:09.599912+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:09.599912+0000","last_undegraded":"2024-04-18T21:05:09.599912+0000","last_fullsized":"2024-04-18T21:05:09.599912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598039+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:09.598039+0000","last_peered":"2024-04-18T21:05:09.598039+0000","last_clean":"2024-04-18T21:05:09.598039+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:09.598039+0000","last_undegraded":"2024-04-18T21:05:09.598039+0000","last_fullsized":"2024-04-18T21:05:09.598039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597637+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:09.597637+0000","last_peered":"2024-04-18T21:05:09.597637+0000","last_clean":"2024-04-18T21:05:09.597637+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:09.597637+0000","last_undegraded":"2024-04-18T21:05:09.597637+0000","last_fullsized":"2024-04-18T21:05:09.597637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598279+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:09.598279+0000","last_peered":"2024-04-18T21:05:09.598279+0000","last_clean":"2024-04-18T21:05:09.598279+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:09.598279+0000","last_undegraded":"2024-04-18T21:05:09.598279+0000","last_fullsized":"2024-04-18T21:05:09.598279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596977+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:09.596977+0000","last_peered":"2024-04-18T21:05:09.596977+0000","last_clean":"2024-04-18T21:05:09.596977+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:09.596977+0000","last_undegraded":"2024-04-18T21:05:09.596977+0000","last_fullsized":"2024-04-18T21:05:09.596977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598461+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:09.598461+0000","last_peered":"2024-04-18T21:05:09.598461+0000","last_clean":"2024-04-18T21:05:09.598461+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:09.598461+0000","last_undegraded":"2024-04-18T21:05:09.598461+0000","last_fullsized":"2024-04-18T21:05:09.598461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598421+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:09.598421+0000","last_peered":"2024-04-18T21:05:09.598421+0000","last_clean":"2024-04-18T21:05:09.598421+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:09.598421+0000","last_undegraded":"2024-04-18T21:05:09.598421+0000","last_fullsized":"2024-04-18T21:05:09.598421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598782+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:09.598782+0000","last_peered":"2024-04-18T21:05:09.598782+0000","last_clean":"2024-04-18T21:05:09.598782+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:09.598782+0000","last_undegraded":"2024-04-18T21:05:09.598782+0000","last_fullsized":"2024-04-18T21:05:09.598782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598444+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:09.598444+0000","last_peered":"2024-04-18T21:05:09.598444+0000","last_clean":"2024-04-18T21:05:09.598444+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:09.598444+0000","last_undegraded":"2024-04-18T21:05:09.598444+0000","last_fullsized":"2024-04-18T21:05:09.598444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597755+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:09.597755+0000","last_peered":"2024-04-18T21:05:09.597755+0000","last_clean":"2024-04-18T21:05:09.597755+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:09.597755+0000","last_undegraded":"2024-04-18T21:05:09.597755+0000","last_fullsized":"2024-04-18T21:05:09.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598086+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:09.598086+0000","last_peered":"2024-04-18T21:05:09.598086+0000","last_clean":"2024-04-18T21:05:09.598086+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:09.598086+0000","last_undegraded":"2024-04-18T21:05:09.598086+0000","last_fullsized":"2024-04-18T21:05:09.598086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597654+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:09.597654+0000","last_peered":"2024-04-18T21:05:09.597654+0000","last_clean":"2024-04-18T21:05:09.597654+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:09.597654+0000","last_undegraded":"2024-04-18T21:05:09.597654+0000","last_fullsized":"2024-04-18T21:05:09.597654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597079+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:09.597079+0000","last_peered":"2024-04-18T21:05:09.597079+0000","last_clean":"2024-04-18T21:05:09.597079+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:09.597079+0000","last_undegraded":"2024-04-18T21:05:09.597079+0000","last_fullsized":"2024-04-18T21:05:09.597079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599986+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:09.599986+0000","last_peered":"2024-04-18T21:05:09.599986+0000","last_clean":"2024-04-18T21:05:09.599986+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:09.599986+0000","last_undegraded":"2024-04-18T21:05:09.599986+0000","last_fullsized":"2024-04-18T21:05:09.599986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599139+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:09.599139+0000","last_peered":"2024-04-18T21:05:09.599139+0000","last_clean":"2024-04-18T21:05:09.599139+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:09.599139+0000","last_undegraded":"2024-04-18T21:05:09.599139+0000","last_fullsized":"2024-04-18T21:05:09.599139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598392+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:09.598392+0000","last_peered":"2024-04-18T21:05:09.598392+0000","last_clean":"2024-04-18T21:05:09.598392+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:09.598392+0000","last_undegraded":"2024-04-18T21:05:09.598392+0000","last_fullsized":"2024-04-18T21:05:09.598392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599335+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:09.599335+0000","last_peered":"2024-04-18T21:05:09.599335+0000","last_clean":"2024-04-18T21:05:09.599335+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:09.599335+0000","last_undegraded":"2024-04-18T21:05:09.599335+0000","last_fullsized":"2024-04-18T21:05:09.599335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599660+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:09.599660+0000","last_peered":"2024-04-18T21:05:09.599660+0000","last_clean":"2024-04-18T21:05:09.599660+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:09.599660+0000","last_undegraded":"2024-04-18T21:05:09.599660+0000","last_fullsized":"2024-04-18T21:05:09.599660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597324+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:09.597324+0000","last_peered":"2024-04-18T21:05:09.597324+0000","last_clean":"2024-04-18T21:05:09.597324+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:09.597324+0000","last_undegraded":"2024-04-18T21:05:09.597324+0000","last_fullsized":"2024-04-18T21:05:09.597324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597169+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:09.597169+0000","last_peered":"2024-04-18T21:05:09.597169+0000","last_clean":"2024-04-18T21:05:09.597169+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:09.597169+0000","last_undegraded":"2024-04-18T21:05:09.597169+0000","last_fullsized":"2024-04-18T21:05:09.597169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597772+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:09.597772+0000","last_peered":"2024-04-18T21:05:09.597772+0000","last_clean":"2024-04-18T21:05:09.597772+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:09.597772+0000","last_undegraded":"2024-04-18T21:05:09.597772+0000","last_fullsized":"2024-04-18T21:05:09.597772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598943+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:09.598943+0000","last_peered":"2024-04-18T21:05:09.598943+0000","last_clean":"2024-04-18T21:05:09.598943+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:09.598943+0000","last_undegraded":"2024-04-18T21:05:09.598943+0000","last_fullsized":"2024-04-18T21:05:09.598943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599108+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:09.599108+0000","last_peered":"2024-04-18T21:05:09.599108+0000","last_clean":"2024-04-18T21:05:09.599108+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:09.599108+0000","last_undegraded":"2024-04-18T21:05:09.599108+0000","last_fullsized":"2024-04-18T21:05:09.599108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599150+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:09.599150+0000","last_peered":"2024-04-18T21:05:09.599150+0000","last_clean":"2024-04-18T21:05:09.599150+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:09.599150+0000","last_undegraded":"2024-04-18T21:05:09.599150+0000","last_fullsized":"2024-04-18T21:05:09.599150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599471+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:09.599471+0000","last_peered":"2024-04-18T21:05:09.599471+0000","last_clean":"2024-04-18T21:05:09.599471+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:09.599471+0000","last_undegraded":"2024-04-18T21:05:09.599471+0000","last_fullsized":"2024-04-18T21:05:09.599471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598876+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:09.598876+0000","last_peered":"2024-04-18T21:05:09.598876+0000","last_clean":"2024-04-18T21:05:09.598876+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:09.598876+0000","last_undegraded":"2024-04-18T21:05:09.598876+0000","last_fullsized":"2024-04-18T21:05:09.598876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597939+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:09.597939+0000","last_peered":"2024-04-18T21:05:09.597939+0000","last_clean":"2024-04-18T21:05:09.597939+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:09.597939+0000","last_undegraded":"2024-04-18T21:05:09.597939+0000","last_fullsized":"2024-04-18T21:05:09.597939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597358+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:09.597358+0000","last_peered":"2024-04-18T21:05:09.597358+0000","last_clean":"2024-04-18T21:05:09.597358+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:09.597358+0000","last_undegraded":"2024-04-18T21:05:09.597358+0000","last_fullsized":"2024-04-18T21:05:09.597358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597398+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:09.597398+0000","last_peered":"2024-04-18T21:05:09.597398+0000","last_clean":"2024-04-18T21:05:09.597398+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:09.597398+0000","last_undegraded":"2024-04-18T21:05:09.597398+0000","last_fullsized":"2024-04-18T21:05:09.597398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598760+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:09.598760+0000","last_peered":"2024-04-18T21:05:09.598760+0000","last_clean":"2024-04-18T21:05:09.598760+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:09.598760+0000","last_undegraded":"2024-04-18T21:05:09.598760+0000","last_fullsized":"2024-04-18T21:05:09.598760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599367+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:09.599367+0000","last_peered":"2024-04-18T21:05:09.599367+0000","last_clean":"2024-04-18T21:05:09.599367+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:09.599367+0000","last_undegraded":"2024-04-18T21:05:09.599367+0000","last_fullsized":"2024-04-18T21:05:09.599367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599082+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:09.599082+0000","last_peered":"2024-04-18T21:05:09.599082+0000","last_clean":"2024-04-18T21:05:09.599082+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:09.599082+0000","last_undegraded":"2024-04-18T21:05:09.599082+0000","last_fullsized":"2024-04-18T21:05:09.599082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597915+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:09.597915+0000","last_peered":"2024-04-18T21:05:09.597915+0000","last_clean":"2024-04-18T21:05:09.597915+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:09.597915+0000","last_undegraded":"2024-04-18T21:05:09.597915+0000","last_fullsized":"2024-04-18T21:05:09.597915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600134+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:09.600134+0000","last_peered":"2024-04-18T21:05:09.600134+0000","last_clean":"2024-04-18T21:05:09.600134+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:09.600134+0000","last_undegraded":"2024-04-18T21:05:09.600134+0000","last_fullsized":"2024-04-18T21:05:09.600134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598229+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:09.598229+0000","last_peered":"2024-04-18T21:05:09.598229+0000","last_clean":"2024-04-18T21:05:09.598229+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:09.598229+0000","last_undegraded":"2024-04-18T21:05:09.598229+0000","last_fullsized":"2024-04-18T21:05:09.598229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598658+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:09.598658+0000","last_peered":"2024-04-18T21:05:09.598658+0000","last_clean":"2024-04-18T21:05:09.598658+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:09.598658+0000","last_undegraded":"2024-04-18T21:05:09.598658+0000","last_fullsized":"2024-04-18T21:05:09.598658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597388+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:09.597388+0000","last_peered":"2024-04-18T21:05:09.597388+0000","last_clean":"2024-04-18T21:05:09.597388+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:09.597388+0000","last_undegraded":"2024-04-18T21:05:09.597388+0000","last_fullsized":"2024-04-18T21:05:09.597388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596837+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:09.596837+0000","last_peered":"2024-04-18T21:05:09.596837+0000","last_clean":"2024-04-18T21:05:09.596837+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:09.596837+0000","last_undegraded":"2024-04-18T21:05:09.596837+0000","last_fullsized":"2024-04-18T21:05:09.596837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599636+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:09.599636+0000","last_peered":"2024-04-18T21:05:09.599636+0000","last_clean":"2024-04-18T21:05:09.599636+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:09.599636+0000","last_undegraded":"2024-04-18T21:05:09.599636+0000","last_fullsized":"2024-04-18T21:05:09.599636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596976+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:09.596976+0000","last_peered":"2024-04-18T21:05:09.596976+0000","last_clean":"2024-04-18T21:05:09.596976+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:09.596976+0000","last_undegraded":"2024-04-18T21:05:09.596976+0000","last_fullsized":"2024-04-18T21:05:09.596976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599727+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:09.599727+0000","last_peered":"2024-04-18T21:05:09.599727+0000","last_clean":"2024-04-18T21:05:09.599727+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:09.599727+0000","last_undegraded":"2024-04-18T21:05:09.599727+0000","last_fullsized":"2024-04-18T21:05:09.599727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598512+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:09.598512+0000","last_peered":"2024-04-18T21:05:09.598512+0000","last_clean":"2024-04-18T21:05:09.598512+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:09.598512+0000","last_undegraded":"2024-04-18T21:05:09.598512+0000","last_fullsized":"2024-04-18T21:05:09.598512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600048+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:09.600048+0000","last_peered":"2024-04-18T21:05:09.600048+0000","last_clean":"2024-04-18T21:05:09.600048+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:09.600048+0000","last_undegraded":"2024-04-18T21:05:09.600048+0000","last_fullsized":"2024-04-18T21:05:09.600048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599364+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:09.599364+0000","last_peered":"2024-04-18T21:05:09.599364+0000","last_clean":"2024-04-18T21:05:09.599364+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:09.599364+0000","last_undegraded":"2024-04-18T21:05:09.599364+0000","last_fullsized":"2024-04-18T21:05:09.599364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599469+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:09.599469+0000","last_peered":"2024-04-18T21:05:09.599469+0000","last_clean":"2024-04-18T21:05:09.599469+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:09.599469+0000","last_undegraded":"2024-04-18T21:05:09.599469+0000","last_fullsized":"2024-04-18T21:05:09.599469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599735+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:09.599735+0000","last_peered":"2024-04-18T21:05:09.599735+0000","last_clean":"2024-04-18T21:05:09.599735+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:09.599735+0000","last_undegraded":"2024-04-18T21:05:09.599735+0000","last_fullsized":"2024-04-18T21:05:09.599735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599299+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:09.599299+0000","last_peered":"2024-04-18T21:05:09.599299+0000","last_clean":"2024-04-18T21:05:09.599299+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:09.599299+0000","last_undegraded":"2024-04-18T21:05:09.599299+0000","last_fullsized":"2024-04-18T21:05:09.599299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599447+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:09.599447+0000","last_peered":"2024-04-18T21:05:09.599447+0000","last_clean":"2024-04-18T21:05:09.599447+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:09.599447+0000","last_undegraded":"2024-04-18T21:05:09.599447+0000","last_fullsized":"2024-04-18T21:05:09.599447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598762+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:09.598762+0000","last_peered":"2024-04-18T21:05:09.598762+0000","last_clean":"2024-04-18T21:05:09.598762+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:09.598762+0000","last_undegraded":"2024-04-18T21:05:09.598762+0000","last_fullsized":"2024-04-18T21:05:09.598762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599000+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:09.599000+0000","last_peered":"2024-04-18T21:05:09.599000+0000","last_clean":"2024-04-18T21:05:09.599000+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:09.599000+0000","last_undegraded":"2024-04-18T21:05:09.599000+0000","last_fullsized":"2024-04-18T21:05:09.599000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598602+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:09.598602+0000","last_peered":"2024-04-18T21:05:09.598602+0000","last_clean":"2024-04-18T21:05:09.598602+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:09.598602+0000","last_undegraded":"2024-04-18T21:05:09.598602+0000","last_fullsized":"2024-04-18T21:05:09.598602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598948+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:09.598948+0000","last_peered":"2024-04-18T21:05:09.598948+0000","last_clean":"2024-04-18T21:05:09.598948+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:09.598948+0000","last_undegraded":"2024-04-18T21:05:09.598948+0000","last_fullsized":"2024-04-18T21:05:09.598948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597968+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:09.597968+0000","last_peered":"2024-04-18T21:05:09.597968+0000","last_clean":"2024-04-18T21:05:09.597968+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:09.597968+0000","last_undegraded":"2024-04-18T21:05:09.597968+0000","last_fullsized":"2024-04-18T21:05:09.597968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599722+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:09.599722+0000","last_peered":"2024-04-18T21:05:09.599722+0000","last_clean":"2024-04-18T21:05:09.599722+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:09.599722+0000","last_undegraded":"2024-04-18T21:05:09.599722+0000","last_fullsized":"2024-04-18T21:05:09.599722+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598414+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:09.598414+0000","last_peered":"2024-04-18T21:05:09.598414+0000","last_clean":"2024-04-18T21:05:09.598414+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:09.598414+0000","last_undegraded":"2024-04-18T21:05:09.598414+0000","last_fullsized":"2024-04-18T21:05:09.598414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599554+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:09.599554+0000","last_peered":"2024-04-18T21:05:09.599554+0000","last_clean":"2024-04-18T21:05:09.599554+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:09.599554+0000","last_undegraded":"2024-04-18T21:05:09.599554+0000","last_fullsized":"2024-04-18T21:05:09.599554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597870+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:09.597870+0000","last_peered":"2024-04-18T21:05:09.597870+0000","last_clean":"2024-04-18T21:05:09.597870+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:09.597870+0000","last_undegraded":"2024-04-18T21:05:09.597870+0000","last_fullsized":"2024-04-18T21:05:09.597870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597919+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:09.597919+0000","last_peered":"2024-04-18T21:05:09.597919+0000","last_clean":"2024-04-18T21:05:09.597919+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:09.597919+0000","last_undegraded":"2024-04-18T21:05:09.597919+0000","last_fullsized":"2024-04-18T21:05:09.597919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599217+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:09.599217+0000","last_peered":"2024-04-18T21:05:09.599217+0000","last_clean":"2024-04-18T21:05:09.599217+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:09.599217+0000","last_undegraded":"2024-04-18T21:05:09.599217+0000","last_fullsized":"2024-04-18T21:05:09.599217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598327+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:09.598327+0000","last_peered":"2024-04-18T21:05:09.598327+0000","last_clean":"2024-04-18T21:05:09.598327+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:09.598327+0000","last_undegraded":"2024-04-18T21:05:09.598327+0000","last_fullsized":"2024-04-18T21:05:09.598327+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598804+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:09.598804+0000","last_peered":"2024-04-18T21:05:09.598804+0000","last_clean":"2024-04-18T21:05:09.598804+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:09.598804+0000","last_undegraded":"2024-04-18T21:05:09.598804+0000","last_fullsized":"2024-04-18T21:05:09.598804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599075+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:09.599075+0000","last_peered":"2024-04-18T21:05:09.599075+0000","last_clean":"2024-04-18T21:05:09.599075+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:09.599075+0000","last_undegraded":"2024-04-18T21:05:09.599075+0000","last_fullsized":"2024-04-18T21:05:09.599075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599404+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:09.599404+0000","last_peered":"2024-04-18T21:05:09.599404+0000","last_clean":"2024-04-18T21:05:09.599404+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:09.599404+0000","last_undegraded":"2024-04-18T21:05:09.599404+0000","last_fullsized":"2024-04-18T21:05:09.599404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599639+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:09.599639+0000","last_peered":"2024-04-18T21:05:09.599639+0000","last_clean":"2024-04-18T21:05:09.599639+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:09.599639+0000","last_undegraded":"2024-04-18T21:05:09.599639+0000","last_fullsized":"2024-04-18T21:05:09.599639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600069+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:09.600069+0000","last_peered":"2024-04-18T21:05:09.600069+0000","last_clean":"2024-04-18T21:05:09.600069+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:09.600069+0000","last_undegraded":"2024-04-18T21:05:09.600069+0000","last_fullsized":"2024-04-18T21:05:09.600069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599802+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:09.599802+0000","last_peered":"2024-04-18T21:05:09.599802+0000","last_clean":"2024-04-18T21:05:09.599802+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:09.599802+0000","last_undegraded":"2024-04-18T21:05:09.599802+0000","last_fullsized":"2024-04-18T21:05:09.599802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600141+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:09.600141+0000","last_peered":"2024-04-18T21:05:09.600141+0000","last_clean":"2024-04-18T21:05:09.600141+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:09.600141+0000","last_undegraded":"2024-04-18T21:05:09.600141+0000","last_fullsized":"2024-04-18T21:05:09.600141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597468+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:09.597468+0000","last_peered":"2024-04-18T21:05:09.597468+0000","last_clean":"2024-04-18T21:05:09.597468+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:09.597468+0000","last_undegraded":"2024-04-18T21:05:09.597468+0000","last_fullsized":"2024-04-18T21:05:09.597468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600143+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:09.600143+0000","last_peered":"2024-04-18T21:05:09.600143+0000","last_clean":"2024-04-18T21:05:09.600143+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:09.600143+0000","last_undegraded":"2024-04-18T21:05:09.600143+0000","last_fullsized":"2024-04-18T21:05:09.600143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600066+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:09.600066+0000","last_peered":"2024-04-18T21:05:09.600066+0000","last_clean":"2024-04-18T21:05:09.600066+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:09.600066+0000","last_undegraded":"2024-04-18T21:05:09.600066+0000","last_fullsized":"2024-04-18T21:05:09.600066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597586+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:09.597586+0000","last_peered":"2024-04-18T21:05:09.597586+0000","last_clean":"2024-04-18T21:05:09.597586+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:09.597586+0000","last_undegraded":"2024-04-18T21:05:09.597586+0000","last_fullsized":"2024-04-18T21:05:09.597586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599991+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:09.599991+0000","last_peered":"2024-04-18T21:05:09.599991+0000","last_clean":"2024-04-18T21:05:09.599991+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:09.599991+0000","last_undegraded":"2024-04-18T21:05:09.599991+0000","last_fullsized":"2024-04-18T21:05:09.599991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600385+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:09.600385+0000","last_peered":"2024-04-18T21:05:09.600385+0000","last_clean":"2024-04-18T21:05:09.600385+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:09.600385+0000","last_undegraded":"2024-04-18T21:05:09.600385+0000","last_fullsized":"2024-04-18T21:05:09.600385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598019+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:09.598019+0000","last_peered":"2024-04-18T21:05:09.598019+0000","last_clean":"2024-04-18T21:05:09.598019+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:09.598019+0000","last_undegraded":"2024-04-18T21:05:09.598019+0000","last_fullsized":"2024-04-18T21:05:09.598019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600388+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:09.600388+0000","last_peered":"2024-04-18T21:05:09.600388+0000","last_clean":"2024-04-18T21:05:09.600388+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:09.600388+0000","last_undegraded":"2024-04-18T21:05:09.600388+0000","last_fullsized":"2024-04-18T21:05:09.600388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597980+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:09.597980+0000","last_peered":"2024-04-18T21:05:09.597980+0000","last_clean":"2024-04-18T21:05:09.597980+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:09.597980+0000","last_undegraded":"2024-04-18T21:05:09.597980+0000","last_fullsized":"2024-04-18T21:05:09.597980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597890+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:09.597890+0000","last_peered":"2024-04-18T21:05:09.597890+0000","last_clean":"2024-04-18T21:05:09.597890+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:09.597890+0000","last_undegraded":"2024-04-18T21:05:09.597890+0000","last_fullsized":"2024-04-18T21:05:09.597890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600046+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:09.600046+0000","last_peered":"2024-04-18T21:05:09.600046+0000","last_clean":"2024-04-18T21:05:09.600046+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:09.600046+0000","last_undegraded":"2024-04-18T21:05:09.600046+0000","last_fullsized":"2024-04-18T21:05:09.600046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598801+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:09.598801+0000","last_peered":"2024-04-18T21:05:09.598801+0000","last_clean":"2024-04-18T21:05:09.598801+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:09.598801+0000","last_undegraded":"2024-04-18T21:05:09.598801+0000","last_fullsized":"2024-04-18T21:05:09.598801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599682+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:09.599682+0000","last_peered":"2024-04-18T21:05:09.599682+0000","last_clean":"2024-04-18T21:05:09.599682+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:09.599682+0000","last_undegraded":"2024-04-18T21:05:09.599682+0000","last_fullsized":"2024-04-18T21:05:09.599682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598593+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:09.598593+0000","last_peered":"2024-04-18T21:05:09.598593+0000","last_clean":"2024-04-18T21:05:09.598593+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:09.598593+0000","last_undegraded":"2024-04-18T21:05:09.598593+0000","last_fullsized":"2024-04-18T21:05:09.598593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597624+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:09.597624+0000","last_peered":"2024-04-18T21:05:09.597624+0000","last_clean":"2024-04-18T21:05:09.597624+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:09.597624+0000","last_undegraded":"2024-04-18T21:05:09.597624+0000","last_fullsized":"2024-04-18T21:05:09.597624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599784+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:09.599784+0000","last_peered":"2024-04-18T21:05:09.599784+0000","last_clean":"2024-04-18T21:05:09.599784+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:09.599784+0000","last_undegraded":"2024-04-18T21:05:09.599784+0000","last_fullsized":"2024-04-18T21:05:09.599784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597293+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:09.597293+0000","last_peered":"2024-04-18T21:05:09.597293+0000","last_clean":"2024-04-18T21:05:09.597293+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:09.597293+0000","last_undegraded":"2024-04-18T21:05:09.597293+0000","last_fullsized":"2024-04-18T21:05:09.597293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599648+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:09.599648+0000","last_peered":"2024-04-18T21:05:09.599648+0000","last_clean":"2024-04-18T21:05:09.599648+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:09.599648+0000","last_undegraded":"2024-04-18T21:05:09.599648+0000","last_fullsized":"2024-04-18T21:05:09.599648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598342+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:09.598342+0000","last_peered":"2024-04-18T21:05:09.598342+0000","last_clean":"2024-04-18T21:05:09.598342+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:09.598342+0000","last_undegraded":"2024-04-18T21:05:09.598342+0000","last_fullsized":"2024-04-18T21:05:09.598342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599489+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:09.599489+0000","last_peered":"2024-04-18T21:05:09.599489+0000","last_clean":"2024-04-18T21:05:09.599489+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:09.599489+0000","last_undegraded":"2024-04-18T21:05:09.599489+0000","last_fullsized":"2024-04-18T21:05:09.599489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598559+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:09.598559+0000","last_peered":"2024-04-18T21:05:09.598559+0000","last_clean":"2024-04-18T21:05:09.598559+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:09.598559+0000","last_undegraded":"2024-04-18T21:05:09.598559+0000","last_fullsized":"2024-04-18T21:05:09.598559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598371+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:09.598371+0000","last_peered":"2024-04-18T21:05:09.598371+0000","last_clean":"2024-04-18T21:05:09.598371+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:09.598371+0000","last_undegraded":"2024-04-18T21:05:09.598371+0000","last_fullsized":"2024-04-18T21:05:09.598371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598001+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:09.598001+0000","last_peered":"2024-04-18T21:05:09.598001+0000","last_clean":"2024-04-18T21:05:09.598001+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:09.598001+0000","last_undegraded":"2024-04-18T21:05:09.598001+0000","last_fullsized":"2024-04-18T21:05:09.598001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598312+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:09.598312+0000","last_peered":"2024-04-18T21:05:09.598312+0000","last_clean":"2024-04-18T21:05:09.598312+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:09.598312+0000","last_undegraded":"2024-04-18T21:05:09.598312+0000","last_fullsized":"2024-04-18T21:05:09.598312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598393+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:09.598393+0000","last_peered":"2024-04-18T21:05:09.598393+0000","last_clean":"2024-04-18T21:05:09.598393+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:09.598393+0000","last_undegraded":"2024-04-18T21:05:09.598393+0000","last_fullsized":"2024-04-18T21:05:09.598393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599054+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:09.599054+0000","last_peered":"2024-04-18T21:05:09.599054+0000","last_clean":"2024-04-18T21:05:09.599054+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:09.599054+0000","last_undegraded":"2024-04-18T21:05:09.599054+0000","last_fullsized":"2024-04-18T21:05:09.599054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599890+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:09.599890+0000","last_peered":"2024-04-18T21:05:09.599890+0000","last_clean":"2024-04-18T21:05:09.599890+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:09.599890+0000","last_undegraded":"2024-04-18T21:05:09.599890+0000","last_fullsized":"2024-04-18T21:05:09.599890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599262+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:09.599262+0000","last_peered":"2024-04-18T21:05:09.599262+0000","last_clean":"2024-04-18T21:05:09.599262+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:09.599262+0000","last_undegraded":"2024-04-18T21:05:09.599262+0000","last_fullsized":"2024-04-18T21:05:09.599262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599155+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:09.599155+0000","last_peered":"2024-04-18T21:05:09.599155+0000","last_clean":"2024-04-18T21:05:09.599155+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:09.599155+0000","last_undegraded":"2024-04-18T21:05:09.599155+0000","last_fullsized":"2024-04-18T21:05:09.599155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599141+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:09.599141+0000","last_peered":"2024-04-18T21:05:09.599141+0000","last_clean":"2024-04-18T21:05:09.599141+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:09.599141+0000","last_undegraded":"2024-04-18T21:05:09.599141+0000","last_fullsized":"2024-04-18T21:05:09.599141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600318+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:09.600318+0000","last_peered":"2024-04-18T21:05:09.600318+0000","last_clean":"2024-04-18T21:05:09.600318+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:09.600318+0000","last_undegraded":"2024-04-18T21:05:09.600318+0000","last_fullsized":"2024-04-18T21:05:09.600318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597823+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:09.597823+0000","last_peered":"2024-04-18T21:05:09.597823+0000","last_clean":"2024-04-18T21:05:09.597823+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:09.597823+0000","last_undegraded":"2024-04-18T21:05:09.597823+0000","last_fullsized":"2024-04-18T21:05:09.597823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599251+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:09.599251+0000","last_peered":"2024-04-18T21:05:09.599251+0000","last_clean":"2024-04-18T21:05:09.599251+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:09.599251+0000","last_undegraded":"2024-04-18T21:05:09.599251+0000","last_fullsized":"2024-04-18T21:05:09.599251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":647274,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":647890,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:15.146 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:15.474 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:15.476 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:15.490 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-18T21:05:13.606534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90044,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025476,"statfs":{"total":289910292480,"available":289818087424,"internally_reserved":0,"allocated":663552,"data_stored":1350892,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.040491"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598968+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:09.598968+0000","last_peered":"2024-04-18T21:05:09.598968+0000","last_clean":"2024-04-18T21:05:09.598968+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:09.598968+0000","last_undegraded":"2024-04-18T21:05:09.598968+0000","last_fullsized":"2024-04-18T21:05:09.598968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597992+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:09.597992+0000","last_peered":"2024-04-18T21:05:09.597992+0000","last_clean":"2024-04-18T21:05:09.597992+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:09.597992+0000","last_undegraded":"2024-04-18T21:05:09.597992+0000","last_fullsized":"2024-04-18T21:05:09.597992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598070+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:09.598070+0000","last_peered":"2024-04-18T21:05:09.598070+0000","last_clean":"2024-04-18T21:05:09.598070+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:09.598070+0000","last_undegraded":"2024-04-18T21:05:09.598070+0000","last_fullsized":"2024-04-18T21:05:09.598070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599912+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:09.599912+0000","last_peered":"2024-04-18T21:05:09.599912+0000","last_clean":"2024-04-18T21:05:09.599912+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:09.599912+0000","last_undegraded":"2024-04-18T21:05:09.599912+0000","last_fullsized":"2024-04-18T21:05:09.599912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598039+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:09.598039+0000","last_peered":"2024-04-18T21:05:09.598039+0000","last_clean":"2024-04-18T21:05:09.598039+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:09.598039+0000","last_undegraded":"2024-04-18T21:05:09.598039+0000","last_fullsized":"2024-04-18T21:05:09.598039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597637+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:09.597637+0000","last_peered":"2024-04-18T21:05:09.597637+0000","last_clean":"2024-04-18T21:05:09.597637+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:09.597637+0000","last_undegraded":"2024-04-18T21:05:09.597637+0000","last_fullsized":"2024-04-18T21:05:09.597637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598279+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:09.598279+0000","last_peered":"2024-04-18T21:05:09.598279+0000","last_clean":"2024-04-18T21:05:09.598279+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:09.598279+0000","last_undegraded":"2024-04-18T21:05:09.598279+0000","last_fullsized":"2024-04-18T21:05:09.598279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596977+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:09.596977+0000","last_peered":"2024-04-18T21:05:09.596977+0000","last_clean":"2024-04-18T21:05:09.596977+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:09.596977+0000","last_undegraded":"2024-04-18T21:05:09.596977+0000","last_fullsized":"2024-04-18T21:05:09.596977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598461+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:09.598461+0000","last_peered":"2024-04-18T21:05:09.598461+0000","last_clean":"2024-04-18T21:05:09.598461+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:09.598461+0000","last_undegraded":"2024-04-18T21:05:09.598461+0000","last_fullsized":"2024-04-18T21:05:09.598461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598421+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:09.598421+0000","last_peered":"2024-04-18T21:05:09.598421+0000","last_clean":"2024-04-18T21:05:09.598421+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:09.598421+0000","last_undegraded":"2024-04-18T21:05:09.598421+0000","last_fullsized":"2024-04-18T21:05:09.598421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598782+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:09.598782+0000","last_peered":"2024-04-18T21:05:09.598782+0000","last_clean":"2024-04-18T21:05:09.598782+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:09.598782+0000","last_undegraded":"2024-04-18T21:05:09.598782+0000","last_fullsized":"2024-04-18T21:05:09.598782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598444+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:09.598444+0000","last_peered":"2024-04-18T21:05:09.598444+0000","last_clean":"2024-04-18T21:05:09.598444+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:09.598444+0000","last_undegraded":"2024-04-18T21:05:09.598444+0000","last_fullsized":"2024-04-18T21:05:09.598444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597755+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:09.597755+0000","last_peered":"2024-04-18T21:05:09.597755+0000","last_clean":"2024-04-18T21:05:09.597755+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:09.597755+0000","last_undegraded":"2024-04-18T21:05:09.597755+0000","last_fullsized":"2024-04-18T21:05:09.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598086+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:09.598086+0000","last_peered":"2024-04-18T21:05:09.598086+0000","last_clean":"2024-04-18T21:05:09.598086+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:09.598086+0000","last_undegraded":"2024-04-18T21:05:09.598086+0000","last_fullsized":"2024-04-18T21:05:09.598086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597654+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:09.597654+0000","last_peered":"2024-04-18T21:05:09.597654+0000","last_clean":"2024-04-18T21:05:09.597654+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:09.597654+0000","last_undegraded":"2024-04-18T21:05:09.597654+0000","last_fullsized":"2024-04-18T21:05:09.597654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597079+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:09.597079+0000","last_peered":"2024-04-18T21:05:09.597079+0000","last_clean":"2024-04-18T21:05:09.597079+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:09.597079+0000","last_undegraded":"2024-04-18T21:05:09.597079+0000","last_fullsized":"2024-04-18T21:05:09.597079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599986+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:09.599986+0000","last_peered":"2024-04-18T21:05:09.599986+0000","last_clean":"2024-04-18T21:05:09.599986+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:09.599986+0000","last_undegraded":"2024-04-18T21:05:09.599986+0000","last_fullsized":"2024-04-18T21:05:09.599986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599139+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:09.599139+0000","last_peered":"2024-04-18T21:05:09.599139+0000","last_clean":"2024-04-18T21:05:09.599139+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:09.599139+0000","last_undegraded":"2024-04-18T21:05:09.599139+0000","last_fullsized":"2024-04-18T21:05:09.599139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598392+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:09.598392+0000","last_peered":"2024-04-18T21:05:09.598392+0000","last_clean":"2024-04-18T21:05:09.598392+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:09.598392+0000","last_undegraded":"2024-04-18T21:05:09.598392+0000","last_fullsized":"2024-04-18T21:05:09.598392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599335+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:09.599335+0000","last_peered":"2024-04-18T21:05:09.599335+0000","last_clean":"2024-04-18T21:05:09.599335+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:09.599335+0000","last_undegraded":"2024-04-18T21:05:09.599335+0000","last_fullsized":"2024-04-18T21:05:09.599335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599660+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:09.599660+0000","last_peered":"2024-04-18T21:05:09.599660+0000","last_clean":"2024-04-18T21:05:09.599660+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:09.599660+0000","last_undegraded":"2024-04-18T21:05:09.599660+0000","last_fullsized":"2024-04-18T21:05:09.599660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597324+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:09.597324+0000","last_peered":"2024-04-18T21:05:09.597324+0000","last_clean":"2024-04-18T21:05:09.597324+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:09.597324+0000","last_undegraded":"2024-04-18T21:05:09.597324+0000","last_fullsized":"2024-04-18T21:05:09.597324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597169+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:09.597169+0000","last_peered":"2024-04-18T21:05:09.597169+0000","last_clean":"2024-04-18T21:05:09.597169+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:09.597169+0000","last_undegraded":"2024-04-18T21:05:09.597169+0000","last_fullsized":"2024-04-18T21:05:09.597169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597772+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:09.597772+0000","last_peered":"2024-04-18T21:05:09.597772+0000","last_clean":"2024-04-18T21:05:09.597772+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:09.597772+0000","last_undegraded":"2024-04-18T21:05:09.597772+0000","last_fullsized":"2024-04-18T21:05:09.597772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598943+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:09.598943+0000","last_peered":"2024-04-18T21:05:09.598943+0000","last_clean":"2024-04-18T21:05:09.598943+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:09.598943+0000","last_undegraded":"2024-04-18T21:05:09.598943+0000","last_fullsized":"2024-04-18T21:05:09.598943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599108+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:09.599108+0000","last_peered":"2024-04-18T21:05:09.599108+0000","last_clean":"2024-04-18T21:05:09.599108+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:09.599108+0000","last_undegraded":"2024-04-18T21:05:09.599108+0000","last_fullsized":"2024-04-18T21:05:09.599108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599150+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:09.599150+0000","last_peered":"2024-04-18T21:05:09.599150+0000","last_clean":"2024-04-18T21:05:09.599150+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:09.599150+0000","last_undegraded":"2024-04-18T21:05:09.599150+0000","last_fullsized":"2024-04-18T21:05:09.599150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599471+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:09.599471+0000","last_peered":"2024-04-18T21:05:09.599471+0000","last_clean":"2024-04-18T21:05:09.599471+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:09.599471+0000","last_undegraded":"2024-04-18T21:05:09.599471+0000","last_fullsized":"2024-04-18T21:05:09.599471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598876+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:09.598876+0000","last_peered":"2024-04-18T21:05:09.598876+0000","last_clean":"2024-04-18T21:05:09.598876+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:09.598876+0000","last_undegraded":"2024-04-18T21:05:09.598876+0000","last_fullsized":"2024-04-18T21:05:09.598876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597939+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:09.597939+0000","last_peered":"2024-04-18T21:05:09.597939+0000","last_clean":"2024-04-18T21:05:09.597939+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:09.597939+0000","last_undegraded":"2024-04-18T21:05:09.597939+0000","last_fullsized":"2024-04-18T21:05:09.597939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597358+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:09.597358+0000","last_peered":"2024-04-18T21:05:09.597358+0000","last_clean":"2024-04-18T21:05:09.597358+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:09.597358+0000","last_undegraded":"2024-04-18T21:05:09.597358+0000","last_fullsized":"2024-04-18T21:05:09.597358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597398+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:09.597398+0000","last_peered":"2024-04-18T21:05:09.597398+0000","last_clean":"2024-04-18T21:05:09.597398+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:09.597398+0000","last_undegraded":"2024-04-18T21:05:09.597398+0000","last_fullsized":"2024-04-18T21:05:09.597398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598760+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:09.598760+0000","last_peered":"2024-04-18T21:05:09.598760+0000","last_clean":"2024-04-18T21:05:09.598760+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:09.598760+0000","last_undegraded":"2024-04-18T21:05:09.598760+0000","last_fullsized":"2024-04-18T21:05:09.598760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599367+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:09.599367+0000","last_peered":"2024-04-18T21:05:09.599367+0000","last_clean":"2024-04-18T21:05:09.599367+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:09.599367+0000","last_undegraded":"2024-04-18T21:05:09.599367+0000","last_fullsized":"2024-04-18T21:05:09.599367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599082+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:09.599082+0000","last_peered":"2024-04-18T21:05:09.599082+0000","last_clean":"2024-04-18T21:05:09.599082+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:09.599082+0000","last_undegraded":"2024-04-18T21:05:09.599082+0000","last_fullsized":"2024-04-18T21:05:09.599082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597915+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:09.597915+0000","last_peered":"2024-04-18T21:05:09.597915+0000","last_clean":"2024-04-18T21:05:09.597915+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:09.597915+0000","last_undegraded":"2024-04-18T21:05:09.597915+0000","last_fullsized":"2024-04-18T21:05:09.597915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600134+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:09.600134+0000","last_peered":"2024-04-18T21:05:09.600134+0000","last_clean":"2024-04-18T21:05:09.600134+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:09.600134+0000","last_undegraded":"2024-04-18T21:05:09.600134+0000","last_fullsized":"2024-04-18T21:05:09.600134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598229+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:09.598229+0000","last_peered":"2024-04-18T21:05:09.598229+0000","last_clean":"2024-04-18T21:05:09.598229+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:09.598229+0000","last_undegraded":"2024-04-18T21:05:09.598229+0000","last_fullsized":"2024-04-18T21:05:09.598229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598658+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:09.598658+0000","last_peered":"2024-04-18T21:05:09.598658+0000","last_clean":"2024-04-18T21:05:09.598658+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:09.598658+0000","last_undegraded":"2024-04-18T21:05:09.598658+0000","last_fullsized":"2024-04-18T21:05:09.598658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597388+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:09.597388+0000","last_peered":"2024-04-18T21:05:09.597388+0000","last_clean":"2024-04-18T21:05:09.597388+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:09.597388+0000","last_undegraded":"2024-04-18T21:05:09.597388+0000","last_fullsized":"2024-04-18T21:05:09.597388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596837+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:09.596837+0000","last_peered":"2024-04-18T21:05:09.596837+0000","last_clean":"2024-04-18T21:05:09.596837+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:09.596837+0000","last_undegraded":"2024-04-18T21:05:09.596837+0000","last_fullsized":"2024-04-18T21:05:09.596837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599636+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:09.599636+0000","last_peered":"2024-04-18T21:05:09.599636+0000","last_clean":"2024-04-18T21:05:09.599636+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:09.599636+0000","last_undegraded":"2024-04-18T21:05:09.599636+0000","last_fullsized":"2024-04-18T21:05:09.599636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596976+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:09.596976+0000","last_peered":"2024-04-18T21:05:09.596976+0000","last_clean":"2024-04-18T21:05:09.596976+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:09.596976+0000","last_undegraded":"2024-04-18T21:05:09.596976+0000","last_fullsized":"2024-04-18T21:05:09.596976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599727+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:09.599727+0000","last_peered":"2024-04-18T21:05:09.599727+0000","last_clean":"2024-04-18T21:05:09.599727+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:09.599727+0000","last_undegraded":"2024-04-18T21:05:09.599727+0000","last_fullsized":"2024-04-18T21:05:09.599727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598512+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:09.598512+0000","last_peered":"2024-04-18T21:05:09.598512+0000","last_clean":"2024-04-18T21:05:09.598512+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:09.598512+0000","last_undegraded":"2024-04-18T21:05:09.598512+0000","last_fullsized":"2024-04-18T21:05:09.598512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600048+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:09.600048+0000","last_peered":"2024-04-18T21:05:09.600048+0000","last_clean":"2024-04-18T21:05:09.600048+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:09.600048+0000","last_undegraded":"2024-04-18T21:05:09.600048+0000","last_fullsized":"2024-04-18T21:05:09.600048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599364+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:09.599364+0000","last_peered":"2024-04-18T21:05:09.599364+0000","last_clean":"2024-04-18T21:05:09.599364+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:09.599364+0000","last_undegraded":"2024-04-18T21:05:09.599364+0000","last_fullsized":"2024-04-18T21:05:09.599364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599469+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:09.599469+0000","last_peered":"2024-04-18T21:05:09.599469+0000","last_clean":"2024-04-18T21:05:09.599469+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:09.599469+0000","last_undegraded":"2024-04-18T21:05:09.599469+0000","last_fullsized":"2024-04-18T21:05:09.599469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599735+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:09.599735+0000","last_peered":"2024-04-18T21:05:09.599735+0000","last_clean":"2024-04-18T21:05:09.599735+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:09.599735+0000","last_undegraded":"2024-04-18T21:05:09.599735+0000","last_fullsized":"2024-04-18T21:05:09.599735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599299+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:09.599299+0000","last_peered":"2024-04-18T21:05:09.599299+0000","last_clean":"2024-04-18T21:05:09.599299+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:09.599299+0000","last_undegraded":"2024-04-18T21:05:09.599299+0000","last_fullsized":"2024-04-18T21:05:09.599299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599447+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:09.599447+0000","last_peered":"2024-04-18T21:05:09.599447+0000","last_clean":"2024-04-18T21:05:09.599447+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:09.599447+0000","last_undegraded":"2024-04-18T21:05:09.599447+0000","last_fullsized":"2024-04-18T21:05:09.599447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598762+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:09.598762+0000","last_peered":"2024-04-18T21:05:09.598762+0000","last_clean":"2024-04-18T21:05:09.598762+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:09.598762+0000","last_undegraded":"2024-04-18T21:05:09.598762+0000","last_fullsized":"2024-04-18T21:05:09.598762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599000+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:09.599000+0000","last_peered":"2024-04-18T21:05:09.599000+0000","last_clean":"2024-04-18T21:05:09.599000+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:09.599000+0000","last_undegraded":"2024-04-18T21:05:09.599000+0000","last_fullsized":"2024-04-18T21:05:09.599000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598602+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:09.598602+0000","last_peered":"2024-04-18T21:05:09.598602+0000","last_clean":"2024-04-18T21:05:09.598602+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:09.598602+0000","last_undegraded":"2024-04-18T21:05:09.598602+0000","last_fullsized":"2024-04-18T21:05:09.598602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598948+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:09.598948+0000","last_peered":"2024-04-18T21:05:09.598948+0000","last_clean":"2024-04-18T21:05:09.598948+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:09.598948+0000","last_undegraded":"2024-04-18T21:05:09.598948+0000","last_fullsized":"2024-04-18T21:05:09.598948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597968+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:09.597968+0000","last_peered":"2024-04-18T21:05:09.597968+0000","last_clean":"2024-04-18T21:05:09.597968+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:09.597968+0000","last_undegraded":"2024-04-18T21:05:09.597968+0000","last_fullsized":"2024-04-18T21:05:09.597968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599722+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:09.599722+0000","last_peered":"2024-04-18T21:05:09.599722+0000","last_clean":"2024-04-18T21:05:09.599722+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:09.599722+0000","last_undegraded":"2024-04-18T21:05:09.599722+0000","last_fullsized":"2024-04-18T21:05:09.599722+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598414+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:09.598414+0000","last_peered":"2024-04-18T21:05:09.598414+0000","last_clean":"2024-04-18T21:05:09.598414+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:09.598414+0000","last_undegraded":"2024-04-18T21:05:09.598414+0000","last_fullsized":"2024-04-18T21:05:09.598414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599554+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:09.599554+0000","last_peered":"2024-04-18T21:05:09.599554+0000","last_clean":"2024-04-18T21:05:09.599554+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:09.599554+0000","last_undegraded":"2024-04-18T21:05:09.599554+0000","last_fullsized":"2024-04-18T21:05:09.599554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597870+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:09.597870+0000","last_peered":"2024-04-18T21:05:09.597870+0000","last_clean":"2024-04-18T21:05:09.597870+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:09.597870+0000","last_undegraded":"2024-04-18T21:05:09.597870+0000","last_fullsized":"2024-04-18T21:05:09.597870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597919+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:09.597919+0000","last_peered":"2024-04-18T21:05:09.597919+0000","last_clean":"2024-04-18T21:05:09.597919+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:09.597919+0000","last_undegraded":"2024-04-18T21:05:09.597919+0000","last_fullsized":"2024-04-18T21:05:09.597919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599217+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:09.599217+0000","last_peered":"2024-04-18T21:05:09.599217+0000","last_clean":"2024-04-18T21:05:09.599217+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:09.599217+0000","last_undegraded":"2024-04-18T21:05:09.599217+0000","last_fullsized":"2024-04-18T21:05:09.599217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598327+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:09.598327+0000","last_peered":"2024-04-18T21:05:09.598327+0000","last_clean":"2024-04-18T21:05:09.598327+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:09.598327+0000","last_undegraded":"2024-04-18T21:05:09.598327+0000","last_fullsized":"2024-04-18T21:05:09.598327+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598804+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:09.598804+0000","last_peered":"2024-04-18T21:05:09.598804+0000","last_clean":"2024-04-18T21:05:09.598804+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:09.598804+0000","last_undegraded":"2024-04-18T21:05:09.598804+0000","last_fullsized":"2024-04-18T21:05:09.598804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599075+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:09.599075+0000","last_peered":"2024-04-18T21:05:09.599075+0000","last_clean":"2024-04-18T21:05:09.599075+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:09.599075+0000","last_undegraded":"2024-04-18T21:05:09.599075+0000","last_fullsized":"2024-04-18T21:05:09.599075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599404+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:09.599404+0000","last_peered":"2024-04-18T21:05:09.599404+0000","last_clean":"2024-04-18T21:05:09.599404+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:09.599404+0000","last_undegraded":"2024-04-18T21:05:09.599404+0000","last_fullsized":"2024-04-18T21:05:09.599404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599639+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:09.599639+0000","last_peered":"2024-04-18T21:05:09.599639+0000","last_clean":"2024-04-18T21:05:09.599639+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:09.599639+0000","last_undegraded":"2024-04-18T21:05:09.599639+0000","last_fullsized":"2024-04-18T21:05:09.599639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600069+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:09.600069+0000","last_peered":"2024-04-18T21:05:09.600069+0000","last_clean":"2024-04-18T21:05:09.600069+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:09.600069+0000","last_undegraded":"2024-04-18T21:05:09.600069+0000","last_fullsized":"2024-04-18T21:05:09.600069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599802+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:09.599802+0000","last_peered":"2024-04-18T21:05:09.599802+0000","last_clean":"2024-04-18T21:05:09.599802+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:09.599802+0000","last_undegraded":"2024-04-18T21:05:09.599802+0000","last_fullsized":"2024-04-18T21:05:09.599802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600141+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:09.600141+0000","last_peered":"2024-04-18T21:05:09.600141+0000","last_clean":"2024-04-18T21:05:09.600141+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:09.600141+0000","last_undegraded":"2024-04-18T21:05:09.600141+0000","last_fullsized":"2024-04-18T21:05:09.600141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597468+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:09.597468+0000","last_peered":"2024-04-18T21:05:09.597468+0000","last_clean":"2024-04-18T21:05:09.597468+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:09.597468+0000","last_undegraded":"2024-04-18T21:05:09.597468+0000","last_fullsized":"2024-04-18T21:05:09.597468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600143+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:09.600143+0000","last_peered":"2024-04-18T21:05:09.600143+0000","last_clean":"2024-04-18T21:05:09.600143+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:09.600143+0000","last_undegraded":"2024-04-18T21:05:09.600143+0000","last_fullsized":"2024-04-18T21:05:09.600143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600066+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:09.600066+0000","last_peered":"2024-04-18T21:05:09.600066+0000","last_clean":"2024-04-18T21:05:09.600066+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:09.600066+0000","last_undegraded":"2024-04-18T21:05:09.600066+0000","last_fullsized":"2024-04-18T21:05:09.600066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597586+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:09.597586+0000","last_peered":"2024-04-18T21:05:09.597586+0000","last_clean":"2024-04-18T21:05:09.597586+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:09.597586+0000","last_undegraded":"2024-04-18T21:05:09.597586+0000","last_fullsized":"2024-04-18T21:05:09.597586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599991+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:09.599991+0000","last_peered":"2024-04-18T21:05:09.599991+0000","last_clean":"2024-04-18T21:05:09.599991+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:09.599991+0000","last_undegraded":"2024-04-18T21:05:09.599991+0000","last_fullsized":"2024-04-18T21:05:09.599991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600385+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:09.600385+0000","last_peered":"2024-04-18T21:05:09.600385+0000","last_clean":"2024-04-18T21:05:09.600385+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:09.600385+0000","last_undegraded":"2024-04-18T21:05:09.600385+0000","last_fullsized":"2024-04-18T21:05:09.600385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598019+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:09.598019+0000","last_peered":"2024-04-18T21:05:09.598019+0000","last_clean":"2024-04-18T21:05:09.598019+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:09.598019+0000","last_undegraded":"2024-04-18T21:05:09.598019+0000","last_fullsized":"2024-04-18T21:05:09.598019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600388+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:09.600388+0000","last_peered":"2024-04-18T21:05:09.600388+0000","last_clean":"2024-04-18T21:05:09.600388+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:09.600388+0000","last_undegraded":"2024-04-18T21:05:09.600388+0000","last_fullsized":"2024-04-18T21:05:09.600388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597980+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:09.597980+0000","last_peered":"2024-04-18T21:05:09.597980+0000","last_clean":"2024-04-18T21:05:09.597980+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:09.597980+0000","last_undegraded":"2024-04-18T21:05:09.597980+0000","last_fullsized":"2024-04-18T21:05:09.597980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597890+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:09.597890+0000","last_peered":"2024-04-18T21:05:09.597890+0000","last_clean":"2024-04-18T21:05:09.597890+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:09.597890+0000","last_undegraded":"2024-04-18T21:05:09.597890+0000","last_fullsized":"2024-04-18T21:05:09.597890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600046+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:09.600046+0000","last_peered":"2024-04-18T21:05:09.600046+0000","last_clean":"2024-04-18T21:05:09.600046+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:09.600046+0000","last_undegraded":"2024-04-18T21:05:09.600046+0000","last_fullsized":"2024-04-18T21:05:09.600046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598801+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:09.598801+0000","last_peered":"2024-04-18T21:05:09.598801+0000","last_clean":"2024-04-18T21:05:09.598801+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:09.598801+0000","last_undegraded":"2024-04-18T21:05:09.598801+0000","last_fullsized":"2024-04-18T21:05:09.598801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599682+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:09.599682+0000","last_peered":"2024-04-18T21:05:09.599682+0000","last_clean":"2024-04-18T21:05:09.599682+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:09.599682+0000","last_undegraded":"2024-04-18T21:05:09.599682+0000","last_fullsized":"2024-04-18T21:05:09.599682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598593+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:09.598593+0000","last_peered":"2024-04-18T21:05:09.598593+0000","last_clean":"2024-04-18T21:05:09.598593+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:09.598593+0000","last_undegraded":"2024-04-18T21:05:09.598593+0000","last_fullsized":"2024-04-18T21:05:09.598593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597624+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:09.597624+0000","last_peered":"2024-04-18T21:05:09.597624+0000","last_clean":"2024-04-18T21:05:09.597624+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:09.597624+0000","last_undegraded":"2024-04-18T21:05:09.597624+0000","last_fullsized":"2024-04-18T21:05:09.597624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599784+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:09.599784+0000","last_peered":"2024-04-18T21:05:09.599784+0000","last_clean":"2024-04-18T21:05:09.599784+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:09.599784+0000","last_undegraded":"2024-04-18T21:05:09.599784+0000","last_fullsized":"2024-04-18T21:05:09.599784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597293+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:09.597293+0000","last_peered":"2024-04-18T21:05:09.597293+0000","last_clean":"2024-04-18T21:05:09.597293+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:09.597293+0000","last_undegraded":"2024-04-18T21:05:09.597293+0000","last_fullsized":"2024-04-18T21:05:09.597293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599648+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:09.599648+0000","last_peered":"2024-04-18T21:05:09.599648+0000","last_clean":"2024-04-18T21:05:09.599648+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:09.599648+0000","last_undegraded":"2024-04-18T21:05:09.599648+0000","last_fullsized":"2024-04-18T21:05:09.599648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598342+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:09.598342+0000","last_peered":"2024-04-18T21:05:09.598342+0000","last_clean":"2024-04-18T21:05:09.598342+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:09.598342+0000","last_undegraded":"2024-04-18T21:05:09.598342+0000","last_fullsized":"2024-04-18T21:05:09.598342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599489+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:09.599489+0000","last_peered":"2024-04-18T21:05:09.599489+0000","last_clean":"2024-04-18T21:05:09.599489+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:09.599489+0000","last_undegraded":"2024-04-18T21:05:09.599489+0000","last_fullsized":"2024-04-18T21:05:09.599489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598559+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:09.598559+0000","last_peered":"2024-04-18T21:05:09.598559+0000","last_clean":"2024-04-18T21:05:09.598559+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:09.598559+0000","last_undegraded":"2024-04-18T21:05:09.598559+0000","last_fullsized":"2024-04-18T21:05:09.598559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598371+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:09.598371+0000","last_peered":"2024-04-18T21:05:09.598371+0000","last_clean":"2024-04-18T21:05:09.598371+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:09.598371+0000","last_undegraded":"2024-04-18T21:05:09.598371+0000","last_fullsized":"2024-04-18T21:05:09.598371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598001+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:09.598001+0000","last_peered":"2024-04-18T21:05:09.598001+0000","last_clean":"2024-04-18T21:05:09.598001+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:09.598001+0000","last_undegraded":"2024-04-18T21:05:09.598001+0000","last_fullsized":"2024-04-18T21:05:09.598001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598312+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:09.598312+0000","last_peered":"2024-04-18T21:05:09.598312+0000","last_clean":"2024-04-18T21:05:09.598312+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:09.598312+0000","last_undegraded":"2024-04-18T21:05:09.598312+0000","last_fullsized":"2024-04-18T21:05:09.598312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598393+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:09.598393+0000","last_peered":"2024-04-18T21:05:09.598393+0000","last_clean":"2024-04-18T21:05:09.598393+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:09.598393+0000","last_undegraded":"2024-04-18T21:05:09.598393+0000","last_fullsized":"2024-04-18T21:05:09.598393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599054+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:09.599054+0000","last_peered":"2024-04-18T21:05:09.599054+0000","last_clean":"2024-04-18T21:05:09.599054+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:09.599054+0000","last_undegraded":"2024-04-18T21:05:09.599054+0000","last_fullsized":"2024-04-18T21:05:09.599054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599890+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:09.599890+0000","last_peered":"2024-04-18T21:05:09.599890+0000","last_clean":"2024-04-18T21:05:09.599890+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:09.599890+0000","last_undegraded":"2024-04-18T21:05:09.599890+0000","last_fullsized":"2024-04-18T21:05:09.599890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599262+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:09.599262+0000","last_peered":"2024-04-18T21:05:09.599262+0000","last_clean":"2024-04-18T21:05:09.599262+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:09.599262+0000","last_undegraded":"2024-04-18T21:05:09.599262+0000","last_fullsized":"2024-04-18T21:05:09.599262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599155+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:09.599155+0000","last_peered":"2024-04-18T21:05:09.599155+0000","last_clean":"2024-04-18T21:05:09.599155+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:09.599155+0000","last_undegraded":"2024-04-18T21:05:09.599155+0000","last_fullsized":"2024-04-18T21:05:09.599155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599141+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:09.599141+0000","last_peered":"2024-04-18T21:05:09.599141+0000","last_clean":"2024-04-18T21:05:09.599141+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:09.599141+0000","last_undegraded":"2024-04-18T21:05:09.599141+0000","last_fullsized":"2024-04-18T21:05:09.599141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600318+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:09.600318+0000","last_peered":"2024-04-18T21:05:09.600318+0000","last_clean":"2024-04-18T21:05:09.600318+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:09.600318+0000","last_undegraded":"2024-04-18T21:05:09.600318+0000","last_fullsized":"2024-04-18T21:05:09.600318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597823+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:09.597823+0000","last_peered":"2024-04-18T21:05:09.597823+0000","last_clean":"2024-04-18T21:05:09.597823+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:09.597823+0000","last_undegraded":"2024-04-18T21:05:09.597823+0000","last_fullsized":"2024-04-18T21:05:09.597823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599251+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:09.599251+0000","last_peered":"2024-04-18T21:05:09.599251+0000","last_clean":"2024-04-18T21:05:09.599251+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:09.599251+0000","last_undegraded":"2024-04-18T21:05:09.599251+0000","last_fullsized":"2024-04-18T21:05:09.599251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":647274,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":647890,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:15.494 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T21:05:15.494 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T21:05:15.494 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T21:05:15.494 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T21:05:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:15.849 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T21:05:15.867 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T21:05:15.867 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:16.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:16.150 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:09.584166+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:16.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:16.168 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:16.444 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T21:05:16.462 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:16.749 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-18T21:05:16.767 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:05:17.064 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T21:05:17.082 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:05:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T21:05:17.373 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:17.704 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:17.704 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:07.912310+0000","modified":"2024-04-18T21:05:09.941505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/2660214547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2660214547},{"type":"v1","addr":"172.21.15.96:6803","nonce":2660214547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:17.705 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-18T21:05:17.723 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:18.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:18.015 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:09.584166+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:18.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:18.034 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:18.318 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T21:05:18.335 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:18.603 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-18T21:05:18.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:05:18.902 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T21:05:18.919 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:05:19.210 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T21:05:19.227 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:19.542 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:19.542 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:07.912310+0000","modified":"2024-04-18T21:05:09.941505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/2660214547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2660214547},{"type":"v1","addr":"172.21.15.96:6803","nonce":2660214547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:19.542 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-18T21:05:19.559 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:19.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:19.844 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:05:09.584166+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:19.863 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:20.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:20.166 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:07.912310+0000","modified":"2024-04-18T21:05:09.941505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/2660214547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2660214547},{"type":"v1","addr":"172.21.15.96:6803","nonce":2660214547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:20.167 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-18T21:05:20.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T21:05:07.912310+0000', 'modified': '2024-04-18T21:05:09.941505+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4202': {'gid': 4202, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6803/2660214547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6802', 'nonce': 2660214547}, {'type': 'v1', 'addr': '172.21.15.96:6803', 'nonce': 2660214547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4202, 'qdb_cluster': [4202]} 2024-04-18T21:05:20.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T21:05:20.284 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-18T21:05:20.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:20.416+0000 7f6786ffd640 0 client.4456 ms_handle_reset on v2:172.21.15.96:6802/2660214547 2024-04-18T21:05:20.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:20.435+0000 7f6786ffd640 0 client.4614 ms_handle_reset on v2:172.21.15.96:6802/2660214547 2024-04-18T21:05:20.439 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:05:20.439 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:05:20.439 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-04-18T21:05:20.439 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4202, 2024-04-18T21:05:20.439 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 11.855969825000001, 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 5, 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 18, 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 18, 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 16.788345795000001 2024-04-18T21:05:20.440 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:05:20.454 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-18T21:05:20.464 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-18T21:05:20.465 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'c46a99d99fa3e2dad10a5ce96141fec909e651df'}} 2024-04-18T21:05:20.465 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-18T21:05:20.465 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-18T21:05:20.465 DEBUG:teuthology.orchestra.run.smithi096:> sync 2024-04-18T21:05:20.819 DEBUG:teuthology.orchestra.run.smithi111:> sync 2024-04-18T21:05:20.981 DEBUG:teuthology.orchestra.run.smithi134:> sync 2024-04-18T21:05:21.157 DEBUG:teuthology.orchestra.run.smithi194:> sync 2024-04-18T21:05:21.258 DEBUG:tasks.thrashosds:checking console status of smithi096 2024-04-18T21:05:21.258 DEBUG:teuthology.orchestra.console.smithi096:Waiting for login prompt 2024-04-18T21:05:21.258 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi096 2024-04-18T21:05:21.428 DEBUG:teuthology.orchestra.console.smithi096:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:21.429 DEBUG:teuthology.orchestra.console.smithi096:expect after: smithi096 login: 2024-04-18T21:05:21.483 DEBUG:teuthology.orchestra.console.smithi096:console disconnect output: [Enter `^Ec?' for help] smithi096 login: [disconnect] 2024-04-18T21:05:21.583 DEBUG:tasks.thrashosds:checking console status of smithi111 2024-04-18T21:05:21.583 DEBUG:teuthology.orchestra.console.smithi111:Waiting for login prompt 2024-04-18T21:05:21.583 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi111 2024-04-18T21:05:21.738 DEBUG:teuthology.orchestra.console.smithi111:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:21.739 DEBUG:teuthology.orchestra.console.smithi111:expect after: smithi111 login: 2024-04-18T21:05:21.791 DEBUG:teuthology.orchestra.console.smithi111:console disconnect output: [Enter `^Ec?' for help] smithi111 login: [disconnect] 2024-04-18T21:05:21.893 DEBUG:tasks.thrashosds:checking console status of smithi134 2024-04-18T21:05:21.893 DEBUG:teuthology.orchestra.console.smithi134:Waiting for login prompt 2024-04-18T21:05:21.893 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi134 2024-04-18T21:05:22.022 DEBUG:teuthology.orchestra.console.smithi134:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:22.022 DEBUG:teuthology.orchestra.console.smithi134:expect after: smithi134 login: 2024-04-18T21:05:22.075 DEBUG:teuthology.orchestra.console.smithi134:console disconnect output: [Enter `^Ec?' for help] smithi134 login: [disconnect] 2024-04-18T21:05:22.176 DEBUG:tasks.thrashosds:checking console status of smithi194 2024-04-18T21:05:22.176 DEBUG:teuthology.orchestra.console.smithi194:Waiting for login prompt 2024-04-18T21:05:22.176 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi194 2024-04-18T21:05:22.281 DEBUG:teuthology.orchestra.console.smithi194:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:22.281 DEBUG:teuthology.orchestra.console.smithi194:expect after: smithi194 login: 2024-04-18T21:05:22.333 DEBUG:teuthology.orchestra.console.smithi194:console disconnect output: [Enter `^Ec?' for help] smithi194 login: [disconnect] 2024-04-18T21:05:22.435 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-18T21:05:22.776 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-18T21:05:22.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T21:05:22.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:23.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:23.083 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:23.099 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-18T21:05:21.609097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90044,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025476,"statfs":{"total":289910292480,"available":289818087424,"internally_reserved":0,"allocated":663552,"data_stored":1350892,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003556"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598968+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:09.598968+0000","last_peered":"2024-04-18T21:05:09.598968+0000","last_clean":"2024-04-18T21:05:09.598968+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:09.598968+0000","last_undegraded":"2024-04-18T21:05:09.598968+0000","last_fullsized":"2024-04-18T21:05:09.598968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597992+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:09.597992+0000","last_peered":"2024-04-18T21:05:09.597992+0000","last_clean":"2024-04-18T21:05:09.597992+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:09.597992+0000","last_undegraded":"2024-04-18T21:05:09.597992+0000","last_fullsized":"2024-04-18T21:05:09.597992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598070+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:09.598070+0000","last_peered":"2024-04-18T21:05:09.598070+0000","last_clean":"2024-04-18T21:05:09.598070+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:09.598070+0000","last_undegraded":"2024-04-18T21:05:09.598070+0000","last_fullsized":"2024-04-18T21:05:09.598070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599912+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:09.599912+0000","last_peered":"2024-04-18T21:05:09.599912+0000","last_clean":"2024-04-18T21:05:09.599912+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:09.599912+0000","last_undegraded":"2024-04-18T21:05:09.599912+0000","last_fullsized":"2024-04-18T21:05:09.599912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598039+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:09.598039+0000","last_peered":"2024-04-18T21:05:09.598039+0000","last_clean":"2024-04-18T21:05:09.598039+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:09.598039+0000","last_undegraded":"2024-04-18T21:05:09.598039+0000","last_fullsized":"2024-04-18T21:05:09.598039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597637+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:09.597637+0000","last_peered":"2024-04-18T21:05:09.597637+0000","last_clean":"2024-04-18T21:05:09.597637+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:09.597637+0000","last_undegraded":"2024-04-18T21:05:09.597637+0000","last_fullsized":"2024-04-18T21:05:09.597637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598279+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:09.598279+0000","last_peered":"2024-04-18T21:05:09.598279+0000","last_clean":"2024-04-18T21:05:09.598279+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:09.598279+0000","last_undegraded":"2024-04-18T21:05:09.598279+0000","last_fullsized":"2024-04-18T21:05:09.598279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596977+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:09.596977+0000","last_peered":"2024-04-18T21:05:09.596977+0000","last_clean":"2024-04-18T21:05:09.596977+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:09.596977+0000","last_undegraded":"2024-04-18T21:05:09.596977+0000","last_fullsized":"2024-04-18T21:05:09.596977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598461+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:09.598461+0000","last_peered":"2024-04-18T21:05:09.598461+0000","last_clean":"2024-04-18T21:05:09.598461+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:09.598461+0000","last_undegraded":"2024-04-18T21:05:09.598461+0000","last_fullsized":"2024-04-18T21:05:09.598461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598421+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:09.598421+0000","last_peered":"2024-04-18T21:05:09.598421+0000","last_clean":"2024-04-18T21:05:09.598421+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:09.598421+0000","last_undegraded":"2024-04-18T21:05:09.598421+0000","last_fullsized":"2024-04-18T21:05:09.598421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598782+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:09.598782+0000","last_peered":"2024-04-18T21:05:09.598782+0000","last_clean":"2024-04-18T21:05:09.598782+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:09.598782+0000","last_undegraded":"2024-04-18T21:05:09.598782+0000","last_fullsized":"2024-04-18T21:05:09.598782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598444+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:09.598444+0000","last_peered":"2024-04-18T21:05:09.598444+0000","last_clean":"2024-04-18T21:05:09.598444+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:09.598444+0000","last_undegraded":"2024-04-18T21:05:09.598444+0000","last_fullsized":"2024-04-18T21:05:09.598444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597755+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:09.597755+0000","last_peered":"2024-04-18T21:05:09.597755+0000","last_clean":"2024-04-18T21:05:09.597755+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:09.597755+0000","last_undegraded":"2024-04-18T21:05:09.597755+0000","last_fullsized":"2024-04-18T21:05:09.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598086+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:09.598086+0000","last_peered":"2024-04-18T21:05:09.598086+0000","last_clean":"2024-04-18T21:05:09.598086+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:09.598086+0000","last_undegraded":"2024-04-18T21:05:09.598086+0000","last_fullsized":"2024-04-18T21:05:09.598086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597654+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:09.597654+0000","last_peered":"2024-04-18T21:05:09.597654+0000","last_clean":"2024-04-18T21:05:09.597654+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:09.597654+0000","last_undegraded":"2024-04-18T21:05:09.597654+0000","last_fullsized":"2024-04-18T21:05:09.597654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597079+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:09.597079+0000","last_peered":"2024-04-18T21:05:09.597079+0000","last_clean":"2024-04-18T21:05:09.597079+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:09.597079+0000","last_undegraded":"2024-04-18T21:05:09.597079+0000","last_fullsized":"2024-04-18T21:05:09.597079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599986+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:09.599986+0000","last_peered":"2024-04-18T21:05:09.599986+0000","last_clean":"2024-04-18T21:05:09.599986+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:09.599986+0000","last_undegraded":"2024-04-18T21:05:09.599986+0000","last_fullsized":"2024-04-18T21:05:09.599986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599139+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:09.599139+0000","last_peered":"2024-04-18T21:05:09.599139+0000","last_clean":"2024-04-18T21:05:09.599139+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:09.599139+0000","last_undegraded":"2024-04-18T21:05:09.599139+0000","last_fullsized":"2024-04-18T21:05:09.599139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598392+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:09.598392+0000","last_peered":"2024-04-18T21:05:09.598392+0000","last_clean":"2024-04-18T21:05:09.598392+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:09.598392+0000","last_undegraded":"2024-04-18T21:05:09.598392+0000","last_fullsized":"2024-04-18T21:05:09.598392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599335+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:09.599335+0000","last_peered":"2024-04-18T21:05:09.599335+0000","last_clean":"2024-04-18T21:05:09.599335+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:09.599335+0000","last_undegraded":"2024-04-18T21:05:09.599335+0000","last_fullsized":"2024-04-18T21:05:09.599335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599660+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:09.599660+0000","last_peered":"2024-04-18T21:05:09.599660+0000","last_clean":"2024-04-18T21:05:09.599660+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:09.599660+0000","last_undegraded":"2024-04-18T21:05:09.599660+0000","last_fullsized":"2024-04-18T21:05:09.599660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597324+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:09.597324+0000","last_peered":"2024-04-18T21:05:09.597324+0000","last_clean":"2024-04-18T21:05:09.597324+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:09.597324+0000","last_undegraded":"2024-04-18T21:05:09.597324+0000","last_fullsized":"2024-04-18T21:05:09.597324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597169+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:09.597169+0000","last_peered":"2024-04-18T21:05:09.597169+0000","last_clean":"2024-04-18T21:05:09.597169+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:09.597169+0000","last_undegraded":"2024-04-18T21:05:09.597169+0000","last_fullsized":"2024-04-18T21:05:09.597169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597772+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:09.597772+0000","last_peered":"2024-04-18T21:05:09.597772+0000","last_clean":"2024-04-18T21:05:09.597772+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:09.597772+0000","last_undegraded":"2024-04-18T21:05:09.597772+0000","last_fullsized":"2024-04-18T21:05:09.597772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598943+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:09.598943+0000","last_peered":"2024-04-18T21:05:09.598943+0000","last_clean":"2024-04-18T21:05:09.598943+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:09.598943+0000","last_undegraded":"2024-04-18T21:05:09.598943+0000","last_fullsized":"2024-04-18T21:05:09.598943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599108+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:09.599108+0000","last_peered":"2024-04-18T21:05:09.599108+0000","last_clean":"2024-04-18T21:05:09.599108+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:09.599108+0000","last_undegraded":"2024-04-18T21:05:09.599108+0000","last_fullsized":"2024-04-18T21:05:09.599108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599150+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:09.599150+0000","last_peered":"2024-04-18T21:05:09.599150+0000","last_clean":"2024-04-18T21:05:09.599150+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:09.599150+0000","last_undegraded":"2024-04-18T21:05:09.599150+0000","last_fullsized":"2024-04-18T21:05:09.599150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599471+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:09.599471+0000","last_peered":"2024-04-18T21:05:09.599471+0000","last_clean":"2024-04-18T21:05:09.599471+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:09.599471+0000","last_undegraded":"2024-04-18T21:05:09.599471+0000","last_fullsized":"2024-04-18T21:05:09.599471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598876+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:09.598876+0000","last_peered":"2024-04-18T21:05:09.598876+0000","last_clean":"2024-04-18T21:05:09.598876+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:09.598876+0000","last_undegraded":"2024-04-18T21:05:09.598876+0000","last_fullsized":"2024-04-18T21:05:09.598876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597939+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:09.597939+0000","last_peered":"2024-04-18T21:05:09.597939+0000","last_clean":"2024-04-18T21:05:09.597939+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:09.597939+0000","last_undegraded":"2024-04-18T21:05:09.597939+0000","last_fullsized":"2024-04-18T21:05:09.597939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597358+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:09.597358+0000","last_peered":"2024-04-18T21:05:09.597358+0000","last_clean":"2024-04-18T21:05:09.597358+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:09.597358+0000","last_undegraded":"2024-04-18T21:05:09.597358+0000","last_fullsized":"2024-04-18T21:05:09.597358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597398+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:09.597398+0000","last_peered":"2024-04-18T21:05:09.597398+0000","last_clean":"2024-04-18T21:05:09.597398+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:09.597398+0000","last_undegraded":"2024-04-18T21:05:09.597398+0000","last_fullsized":"2024-04-18T21:05:09.597398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598760+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:09.598760+0000","last_peered":"2024-04-18T21:05:09.598760+0000","last_clean":"2024-04-18T21:05:09.598760+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:09.598760+0000","last_undegraded":"2024-04-18T21:05:09.598760+0000","last_fullsized":"2024-04-18T21:05:09.598760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599367+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:09.599367+0000","last_peered":"2024-04-18T21:05:09.599367+0000","last_clean":"2024-04-18T21:05:09.599367+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:09.599367+0000","last_undegraded":"2024-04-18T21:05:09.599367+0000","last_fullsized":"2024-04-18T21:05:09.599367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599082+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:09.599082+0000","last_peered":"2024-04-18T21:05:09.599082+0000","last_clean":"2024-04-18T21:05:09.599082+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:09.599082+0000","last_undegraded":"2024-04-18T21:05:09.599082+0000","last_fullsized":"2024-04-18T21:05:09.599082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597915+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:09.597915+0000","last_peered":"2024-04-18T21:05:09.597915+0000","last_clean":"2024-04-18T21:05:09.597915+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:09.597915+0000","last_undegraded":"2024-04-18T21:05:09.597915+0000","last_fullsized":"2024-04-18T21:05:09.597915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600134+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:09.600134+0000","last_peered":"2024-04-18T21:05:09.600134+0000","last_clean":"2024-04-18T21:05:09.600134+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:09.600134+0000","last_undegraded":"2024-04-18T21:05:09.600134+0000","last_fullsized":"2024-04-18T21:05:09.600134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598229+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:09.598229+0000","last_peered":"2024-04-18T21:05:09.598229+0000","last_clean":"2024-04-18T21:05:09.598229+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:09.598229+0000","last_undegraded":"2024-04-18T21:05:09.598229+0000","last_fullsized":"2024-04-18T21:05:09.598229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598658+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:09.598658+0000","last_peered":"2024-04-18T21:05:09.598658+0000","last_clean":"2024-04-18T21:05:09.598658+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:09.598658+0000","last_undegraded":"2024-04-18T21:05:09.598658+0000","last_fullsized":"2024-04-18T21:05:09.598658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597388+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:09.597388+0000","last_peered":"2024-04-18T21:05:09.597388+0000","last_clean":"2024-04-18T21:05:09.597388+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:09.597388+0000","last_undegraded":"2024-04-18T21:05:09.597388+0000","last_fullsized":"2024-04-18T21:05:09.597388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596837+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:09.596837+0000","last_peered":"2024-04-18T21:05:09.596837+0000","last_clean":"2024-04-18T21:05:09.596837+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:09.596837+0000","last_undegraded":"2024-04-18T21:05:09.596837+0000","last_fullsized":"2024-04-18T21:05:09.596837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599636+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:09.599636+0000","last_peered":"2024-04-18T21:05:09.599636+0000","last_clean":"2024-04-18T21:05:09.599636+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:09.599636+0000","last_undegraded":"2024-04-18T21:05:09.599636+0000","last_fullsized":"2024-04-18T21:05:09.599636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596976+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:09.596976+0000","last_peered":"2024-04-18T21:05:09.596976+0000","last_clean":"2024-04-18T21:05:09.596976+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:09.596976+0000","last_undegraded":"2024-04-18T21:05:09.596976+0000","last_fullsized":"2024-04-18T21:05:09.596976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599727+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:09.599727+0000","last_peered":"2024-04-18T21:05:09.599727+0000","last_clean":"2024-04-18T21:05:09.599727+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:09.599727+0000","last_undegraded":"2024-04-18T21:05:09.599727+0000","last_fullsized":"2024-04-18T21:05:09.599727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598512+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:09.598512+0000","last_peered":"2024-04-18T21:05:09.598512+0000","last_clean":"2024-04-18T21:05:09.598512+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:09.598512+0000","last_undegraded":"2024-04-18T21:05:09.598512+0000","last_fullsized":"2024-04-18T21:05:09.598512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600048+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:09.600048+0000","last_peered":"2024-04-18T21:05:09.600048+0000","last_clean":"2024-04-18T21:05:09.600048+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:09.600048+0000","last_undegraded":"2024-04-18T21:05:09.600048+0000","last_fullsized":"2024-04-18T21:05:09.600048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599364+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:09.599364+0000","last_peered":"2024-04-18T21:05:09.599364+0000","last_clean":"2024-04-18T21:05:09.599364+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:09.599364+0000","last_undegraded":"2024-04-18T21:05:09.599364+0000","last_fullsized":"2024-04-18T21:05:09.599364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599469+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:09.599469+0000","last_peered":"2024-04-18T21:05:09.599469+0000","last_clean":"2024-04-18T21:05:09.599469+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:09.599469+0000","last_undegraded":"2024-04-18T21:05:09.599469+0000","last_fullsized":"2024-04-18T21:05:09.599469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599735+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:09.599735+0000","last_peered":"2024-04-18T21:05:09.599735+0000","last_clean":"2024-04-18T21:05:09.599735+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:09.599735+0000","last_undegraded":"2024-04-18T21:05:09.599735+0000","last_fullsized":"2024-04-18T21:05:09.599735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599299+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:09.599299+0000","last_peered":"2024-04-18T21:05:09.599299+0000","last_clean":"2024-04-18T21:05:09.599299+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:09.599299+0000","last_undegraded":"2024-04-18T21:05:09.599299+0000","last_fullsized":"2024-04-18T21:05:09.599299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599447+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:09.599447+0000","last_peered":"2024-04-18T21:05:09.599447+0000","last_clean":"2024-04-18T21:05:09.599447+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:09.599447+0000","last_undegraded":"2024-04-18T21:05:09.599447+0000","last_fullsized":"2024-04-18T21:05:09.599447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598762+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:09.598762+0000","last_peered":"2024-04-18T21:05:09.598762+0000","last_clean":"2024-04-18T21:05:09.598762+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:09.598762+0000","last_undegraded":"2024-04-18T21:05:09.598762+0000","last_fullsized":"2024-04-18T21:05:09.598762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599000+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:09.599000+0000","last_peered":"2024-04-18T21:05:09.599000+0000","last_clean":"2024-04-18T21:05:09.599000+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:09.599000+0000","last_undegraded":"2024-04-18T21:05:09.599000+0000","last_fullsized":"2024-04-18T21:05:09.599000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598602+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:09.598602+0000","last_peered":"2024-04-18T21:05:09.598602+0000","last_clean":"2024-04-18T21:05:09.598602+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:09.598602+0000","last_undegraded":"2024-04-18T21:05:09.598602+0000","last_fullsized":"2024-04-18T21:05:09.598602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598948+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:09.598948+0000","last_peered":"2024-04-18T21:05:09.598948+0000","last_clean":"2024-04-18T21:05:09.598948+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:09.598948+0000","last_undegraded":"2024-04-18T21:05:09.598948+0000","last_fullsized":"2024-04-18T21:05:09.598948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597968+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:09.597968+0000","last_peered":"2024-04-18T21:05:09.597968+0000","last_clean":"2024-04-18T21:05:09.597968+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:09.597968+0000","last_undegraded":"2024-04-18T21:05:09.597968+0000","last_fullsized":"2024-04-18T21:05:09.597968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599722+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:09.599722+0000","last_peered":"2024-04-18T21:05:09.599722+0000","last_clean":"2024-04-18T21:05:09.599722+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:09.599722+0000","last_undegraded":"2024-04-18T21:05:09.599722+0000","last_fullsized":"2024-04-18T21:05:09.599722+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598414+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:09.598414+0000","last_peered":"2024-04-18T21:05:09.598414+0000","last_clean":"2024-04-18T21:05:09.598414+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:09.598414+0000","last_undegraded":"2024-04-18T21:05:09.598414+0000","last_fullsized":"2024-04-18T21:05:09.598414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599554+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:09.599554+0000","last_peered":"2024-04-18T21:05:09.599554+0000","last_clean":"2024-04-18T21:05:09.599554+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:09.599554+0000","last_undegraded":"2024-04-18T21:05:09.599554+0000","last_fullsized":"2024-04-18T21:05:09.599554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597870+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:09.597870+0000","last_peered":"2024-04-18T21:05:09.597870+0000","last_clean":"2024-04-18T21:05:09.597870+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:09.597870+0000","last_undegraded":"2024-04-18T21:05:09.597870+0000","last_fullsized":"2024-04-18T21:05:09.597870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597919+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:09.597919+0000","last_peered":"2024-04-18T21:05:09.597919+0000","last_clean":"2024-04-18T21:05:09.597919+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:09.597919+0000","last_undegraded":"2024-04-18T21:05:09.597919+0000","last_fullsized":"2024-04-18T21:05:09.597919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599217+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:09.599217+0000","last_peered":"2024-04-18T21:05:09.599217+0000","last_clean":"2024-04-18T21:05:09.599217+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:09.599217+0000","last_undegraded":"2024-04-18T21:05:09.599217+0000","last_fullsized":"2024-04-18T21:05:09.599217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598327+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:09.598327+0000","last_peered":"2024-04-18T21:05:09.598327+0000","last_clean":"2024-04-18T21:05:09.598327+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:09.598327+0000","last_undegraded":"2024-04-18T21:05:09.598327+0000","last_fullsized":"2024-04-18T21:05:09.598327+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598804+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:09.598804+0000","last_peered":"2024-04-18T21:05:09.598804+0000","last_clean":"2024-04-18T21:05:09.598804+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:09.598804+0000","last_undegraded":"2024-04-18T21:05:09.598804+0000","last_fullsized":"2024-04-18T21:05:09.598804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599075+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:09.599075+0000","last_peered":"2024-04-18T21:05:09.599075+0000","last_clean":"2024-04-18T21:05:09.599075+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:09.599075+0000","last_undegraded":"2024-04-18T21:05:09.599075+0000","last_fullsized":"2024-04-18T21:05:09.599075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599404+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:09.599404+0000","last_peered":"2024-04-18T21:05:09.599404+0000","last_clean":"2024-04-18T21:05:09.599404+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:09.599404+0000","last_undegraded":"2024-04-18T21:05:09.599404+0000","last_fullsized":"2024-04-18T21:05:09.599404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599639+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:09.599639+0000","last_peered":"2024-04-18T21:05:09.599639+0000","last_clean":"2024-04-18T21:05:09.599639+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:09.599639+0000","last_undegraded":"2024-04-18T21:05:09.599639+0000","last_fullsized":"2024-04-18T21:05:09.599639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600069+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:09.600069+0000","last_peered":"2024-04-18T21:05:09.600069+0000","last_clean":"2024-04-18T21:05:09.600069+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:09.600069+0000","last_undegraded":"2024-04-18T21:05:09.600069+0000","last_fullsized":"2024-04-18T21:05:09.600069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599802+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:09.599802+0000","last_peered":"2024-04-18T21:05:09.599802+0000","last_clean":"2024-04-18T21:05:09.599802+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:09.599802+0000","last_undegraded":"2024-04-18T21:05:09.599802+0000","last_fullsized":"2024-04-18T21:05:09.599802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600141+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:09.600141+0000","last_peered":"2024-04-18T21:05:09.600141+0000","last_clean":"2024-04-18T21:05:09.600141+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:09.600141+0000","last_undegraded":"2024-04-18T21:05:09.600141+0000","last_fullsized":"2024-04-18T21:05:09.600141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597468+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:09.597468+0000","last_peered":"2024-04-18T21:05:09.597468+0000","last_clean":"2024-04-18T21:05:09.597468+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:09.597468+0000","last_undegraded":"2024-04-18T21:05:09.597468+0000","last_fullsized":"2024-04-18T21:05:09.597468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600143+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:09.600143+0000","last_peered":"2024-04-18T21:05:09.600143+0000","last_clean":"2024-04-18T21:05:09.600143+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:09.600143+0000","last_undegraded":"2024-04-18T21:05:09.600143+0000","last_fullsized":"2024-04-18T21:05:09.600143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600066+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:09.600066+0000","last_peered":"2024-04-18T21:05:09.600066+0000","last_clean":"2024-04-18T21:05:09.600066+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:09.600066+0000","last_undegraded":"2024-04-18T21:05:09.600066+0000","last_fullsized":"2024-04-18T21:05:09.600066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597586+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:09.597586+0000","last_peered":"2024-04-18T21:05:09.597586+0000","last_clean":"2024-04-18T21:05:09.597586+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:09.597586+0000","last_undegraded":"2024-04-18T21:05:09.597586+0000","last_fullsized":"2024-04-18T21:05:09.597586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599991+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:09.599991+0000","last_peered":"2024-04-18T21:05:09.599991+0000","last_clean":"2024-04-18T21:05:09.599991+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:09.599991+0000","last_undegraded":"2024-04-18T21:05:09.599991+0000","last_fullsized":"2024-04-18T21:05:09.599991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600385+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:09.600385+0000","last_peered":"2024-04-18T21:05:09.600385+0000","last_clean":"2024-04-18T21:05:09.600385+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:09.600385+0000","last_undegraded":"2024-04-18T21:05:09.600385+0000","last_fullsized":"2024-04-18T21:05:09.600385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598019+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:09.598019+0000","last_peered":"2024-04-18T21:05:09.598019+0000","last_clean":"2024-04-18T21:05:09.598019+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:09.598019+0000","last_undegraded":"2024-04-18T21:05:09.598019+0000","last_fullsized":"2024-04-18T21:05:09.598019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600388+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:09.600388+0000","last_peered":"2024-04-18T21:05:09.600388+0000","last_clean":"2024-04-18T21:05:09.600388+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:09.600388+0000","last_undegraded":"2024-04-18T21:05:09.600388+0000","last_fullsized":"2024-04-18T21:05:09.600388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597980+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:09.597980+0000","last_peered":"2024-04-18T21:05:09.597980+0000","last_clean":"2024-04-18T21:05:09.597980+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:09.597980+0000","last_undegraded":"2024-04-18T21:05:09.597980+0000","last_fullsized":"2024-04-18T21:05:09.597980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597890+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:09.597890+0000","last_peered":"2024-04-18T21:05:09.597890+0000","last_clean":"2024-04-18T21:05:09.597890+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:09.597890+0000","last_undegraded":"2024-04-18T21:05:09.597890+0000","last_fullsized":"2024-04-18T21:05:09.597890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600046+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:09.600046+0000","last_peered":"2024-04-18T21:05:09.600046+0000","last_clean":"2024-04-18T21:05:09.600046+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:09.600046+0000","last_undegraded":"2024-04-18T21:05:09.600046+0000","last_fullsized":"2024-04-18T21:05:09.600046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598801+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:09.598801+0000","last_peered":"2024-04-18T21:05:09.598801+0000","last_clean":"2024-04-18T21:05:09.598801+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:09.598801+0000","last_undegraded":"2024-04-18T21:05:09.598801+0000","last_fullsized":"2024-04-18T21:05:09.598801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599682+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:09.599682+0000","last_peered":"2024-04-18T21:05:09.599682+0000","last_clean":"2024-04-18T21:05:09.599682+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:09.599682+0000","last_undegraded":"2024-04-18T21:05:09.599682+0000","last_fullsized":"2024-04-18T21:05:09.599682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598593+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:09.598593+0000","last_peered":"2024-04-18T21:05:09.598593+0000","last_clean":"2024-04-18T21:05:09.598593+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:09.598593+0000","last_undegraded":"2024-04-18T21:05:09.598593+0000","last_fullsized":"2024-04-18T21:05:09.598593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597624+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:09.597624+0000","last_peered":"2024-04-18T21:05:09.597624+0000","last_clean":"2024-04-18T21:05:09.597624+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:09.597624+0000","last_undegraded":"2024-04-18T21:05:09.597624+0000","last_fullsized":"2024-04-18T21:05:09.597624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599784+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:09.599784+0000","last_peered":"2024-04-18T21:05:09.599784+0000","last_clean":"2024-04-18T21:05:09.599784+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:09.599784+0000","last_undegraded":"2024-04-18T21:05:09.599784+0000","last_fullsized":"2024-04-18T21:05:09.599784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597293+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:09.597293+0000","last_peered":"2024-04-18T21:05:09.597293+0000","last_clean":"2024-04-18T21:05:09.597293+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:09.597293+0000","last_undegraded":"2024-04-18T21:05:09.597293+0000","last_fullsized":"2024-04-18T21:05:09.597293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599648+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:09.599648+0000","last_peered":"2024-04-18T21:05:09.599648+0000","last_clean":"2024-04-18T21:05:09.599648+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:09.599648+0000","last_undegraded":"2024-04-18T21:05:09.599648+0000","last_fullsized":"2024-04-18T21:05:09.599648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598342+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:09.598342+0000","last_peered":"2024-04-18T21:05:09.598342+0000","last_clean":"2024-04-18T21:05:09.598342+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:09.598342+0000","last_undegraded":"2024-04-18T21:05:09.598342+0000","last_fullsized":"2024-04-18T21:05:09.598342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599489+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:09.599489+0000","last_peered":"2024-04-18T21:05:09.599489+0000","last_clean":"2024-04-18T21:05:09.599489+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:09.599489+0000","last_undegraded":"2024-04-18T21:05:09.599489+0000","last_fullsized":"2024-04-18T21:05:09.599489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598559+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:09.598559+0000","last_peered":"2024-04-18T21:05:09.598559+0000","last_clean":"2024-04-18T21:05:09.598559+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:09.598559+0000","last_undegraded":"2024-04-18T21:05:09.598559+0000","last_fullsized":"2024-04-18T21:05:09.598559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598371+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:09.598371+0000","last_peered":"2024-04-18T21:05:09.598371+0000","last_clean":"2024-04-18T21:05:09.598371+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:09.598371+0000","last_undegraded":"2024-04-18T21:05:09.598371+0000","last_fullsized":"2024-04-18T21:05:09.598371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598001+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:09.598001+0000","last_peered":"2024-04-18T21:05:09.598001+0000","last_clean":"2024-04-18T21:05:09.598001+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:09.598001+0000","last_undegraded":"2024-04-18T21:05:09.598001+0000","last_fullsized":"2024-04-18T21:05:09.598001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598312+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:09.598312+0000","last_peered":"2024-04-18T21:05:09.598312+0000","last_clean":"2024-04-18T21:05:09.598312+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:09.598312+0000","last_undegraded":"2024-04-18T21:05:09.598312+0000","last_fullsized":"2024-04-18T21:05:09.598312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598393+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:09.598393+0000","last_peered":"2024-04-18T21:05:09.598393+0000","last_clean":"2024-04-18T21:05:09.598393+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:09.598393+0000","last_undegraded":"2024-04-18T21:05:09.598393+0000","last_fullsized":"2024-04-18T21:05:09.598393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599054+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:09.599054+0000","last_peered":"2024-04-18T21:05:09.599054+0000","last_clean":"2024-04-18T21:05:09.599054+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:09.599054+0000","last_undegraded":"2024-04-18T21:05:09.599054+0000","last_fullsized":"2024-04-18T21:05:09.599054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599890+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:09.599890+0000","last_peered":"2024-04-18T21:05:09.599890+0000","last_clean":"2024-04-18T21:05:09.599890+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:09.599890+0000","last_undegraded":"2024-04-18T21:05:09.599890+0000","last_fullsized":"2024-04-18T21:05:09.599890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599262+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:09.599262+0000","last_peered":"2024-04-18T21:05:09.599262+0000","last_clean":"2024-04-18T21:05:09.599262+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:09.599262+0000","last_undegraded":"2024-04-18T21:05:09.599262+0000","last_fullsized":"2024-04-18T21:05:09.599262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599155+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:09.599155+0000","last_peered":"2024-04-18T21:05:09.599155+0000","last_clean":"2024-04-18T21:05:09.599155+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:09.599155+0000","last_undegraded":"2024-04-18T21:05:09.599155+0000","last_fullsized":"2024-04-18T21:05:09.599155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599141+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:09.599141+0000","last_peered":"2024-04-18T21:05:09.599141+0000","last_clean":"2024-04-18T21:05:09.599141+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:09.599141+0000","last_undegraded":"2024-04-18T21:05:09.599141+0000","last_fullsized":"2024-04-18T21:05:09.599141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600318+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:09.600318+0000","last_peered":"2024-04-18T21:05:09.600318+0000","last_clean":"2024-04-18T21:05:09.600318+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:09.600318+0000","last_undegraded":"2024-04-18T21:05:09.600318+0000","last_fullsized":"2024-04-18T21:05:09.600318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597823+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:09.597823+0000","last_peered":"2024-04-18T21:05:09.597823+0000","last_clean":"2024-04-18T21:05:09.597823+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:09.597823+0000","last_undegraded":"2024-04-18T21:05:09.597823+0000","last_fullsized":"2024-04-18T21:05:09.597823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599251+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:09.599251+0000","last_peered":"2024-04-18T21:05:09.599251+0000","last_clean":"2024-04-18T21:05:09.599251+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:09.599251+0000","last_undegraded":"2024-04-18T21:05:09.599251+0000","last_fullsized":"2024-04-18T21:05:09.599251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":647274,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":647890,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:23.104 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:23.443 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:23.459 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-18T21:05:21.609097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90044,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025476,"statfs":{"total":289910292480,"available":289818087424,"internally_reserved":0,"allocated":663552,"data_stored":1350892,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003556"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598968+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:09.598968+0000","last_peered":"2024-04-18T21:05:09.598968+0000","last_clean":"2024-04-18T21:05:09.598968+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:09.598968+0000","last_undegraded":"2024-04-18T21:05:09.598968+0000","last_fullsized":"2024-04-18T21:05:09.598968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597992+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:09.597992+0000","last_peered":"2024-04-18T21:05:09.597992+0000","last_clean":"2024-04-18T21:05:09.597992+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:09.597992+0000","last_undegraded":"2024-04-18T21:05:09.597992+0000","last_fullsized":"2024-04-18T21:05:09.597992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598070+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:09.598070+0000","last_peered":"2024-04-18T21:05:09.598070+0000","last_clean":"2024-04-18T21:05:09.598070+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:09.598070+0000","last_undegraded":"2024-04-18T21:05:09.598070+0000","last_fullsized":"2024-04-18T21:05:09.598070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599912+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:09.599912+0000","last_peered":"2024-04-18T21:05:09.599912+0000","last_clean":"2024-04-18T21:05:09.599912+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:09.599912+0000","last_undegraded":"2024-04-18T21:05:09.599912+0000","last_fullsized":"2024-04-18T21:05:09.599912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598039+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:09.598039+0000","last_peered":"2024-04-18T21:05:09.598039+0000","last_clean":"2024-04-18T21:05:09.598039+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:09.598039+0000","last_undegraded":"2024-04-18T21:05:09.598039+0000","last_fullsized":"2024-04-18T21:05:09.598039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597637+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:09.597637+0000","last_peered":"2024-04-18T21:05:09.597637+0000","last_clean":"2024-04-18T21:05:09.597637+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:09.597637+0000","last_undegraded":"2024-04-18T21:05:09.597637+0000","last_fullsized":"2024-04-18T21:05:09.597637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598279+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:09.598279+0000","last_peered":"2024-04-18T21:05:09.598279+0000","last_clean":"2024-04-18T21:05:09.598279+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:09.598279+0000","last_undegraded":"2024-04-18T21:05:09.598279+0000","last_fullsized":"2024-04-18T21:05:09.598279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596977+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:09.596977+0000","last_peered":"2024-04-18T21:05:09.596977+0000","last_clean":"2024-04-18T21:05:09.596977+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:09.596977+0000","last_undegraded":"2024-04-18T21:05:09.596977+0000","last_fullsized":"2024-04-18T21:05:09.596977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598461+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:09.598461+0000","last_peered":"2024-04-18T21:05:09.598461+0000","last_clean":"2024-04-18T21:05:09.598461+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:09.598461+0000","last_undegraded":"2024-04-18T21:05:09.598461+0000","last_fullsized":"2024-04-18T21:05:09.598461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598421+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:09.598421+0000","last_peered":"2024-04-18T21:05:09.598421+0000","last_clean":"2024-04-18T21:05:09.598421+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:09.598421+0000","last_undegraded":"2024-04-18T21:05:09.598421+0000","last_fullsized":"2024-04-18T21:05:09.598421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598782+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:09.598782+0000","last_peered":"2024-04-18T21:05:09.598782+0000","last_clean":"2024-04-18T21:05:09.598782+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:09.598782+0000","last_undegraded":"2024-04-18T21:05:09.598782+0000","last_fullsized":"2024-04-18T21:05:09.598782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598444+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:09.598444+0000","last_peered":"2024-04-18T21:05:09.598444+0000","last_clean":"2024-04-18T21:05:09.598444+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:09.598444+0000","last_undegraded":"2024-04-18T21:05:09.598444+0000","last_fullsized":"2024-04-18T21:05:09.598444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597755+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:09.597755+0000","last_peered":"2024-04-18T21:05:09.597755+0000","last_clean":"2024-04-18T21:05:09.597755+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:09.597755+0000","last_undegraded":"2024-04-18T21:05:09.597755+0000","last_fullsized":"2024-04-18T21:05:09.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598086+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:09.598086+0000","last_peered":"2024-04-18T21:05:09.598086+0000","last_clean":"2024-04-18T21:05:09.598086+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:09.598086+0000","last_undegraded":"2024-04-18T21:05:09.598086+0000","last_fullsized":"2024-04-18T21:05:09.598086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597654+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:09.597654+0000","last_peered":"2024-04-18T21:05:09.597654+0000","last_clean":"2024-04-18T21:05:09.597654+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:09.597654+0000","last_undegraded":"2024-04-18T21:05:09.597654+0000","last_fullsized":"2024-04-18T21:05:09.597654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597079+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:09.597079+0000","last_peered":"2024-04-18T21:05:09.597079+0000","last_clean":"2024-04-18T21:05:09.597079+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:09.597079+0000","last_undegraded":"2024-04-18T21:05:09.597079+0000","last_fullsized":"2024-04-18T21:05:09.597079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599986+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:09.599986+0000","last_peered":"2024-04-18T21:05:09.599986+0000","last_clean":"2024-04-18T21:05:09.599986+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:09.599986+0000","last_undegraded":"2024-04-18T21:05:09.599986+0000","last_fullsized":"2024-04-18T21:05:09.599986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599139+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:09.599139+0000","last_peered":"2024-04-18T21:05:09.599139+0000","last_clean":"2024-04-18T21:05:09.599139+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:09.599139+0000","last_undegraded":"2024-04-18T21:05:09.599139+0000","last_fullsized":"2024-04-18T21:05:09.599139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598392+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:09.598392+0000","last_peered":"2024-04-18T21:05:09.598392+0000","last_clean":"2024-04-18T21:05:09.598392+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:09.598392+0000","last_undegraded":"2024-04-18T21:05:09.598392+0000","last_fullsized":"2024-04-18T21:05:09.598392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599335+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:09.599335+0000","last_peered":"2024-04-18T21:05:09.599335+0000","last_clean":"2024-04-18T21:05:09.599335+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:09.599335+0000","last_undegraded":"2024-04-18T21:05:09.599335+0000","last_fullsized":"2024-04-18T21:05:09.599335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599660+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:09.599660+0000","last_peered":"2024-04-18T21:05:09.599660+0000","last_clean":"2024-04-18T21:05:09.599660+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:09.599660+0000","last_undegraded":"2024-04-18T21:05:09.599660+0000","last_fullsized":"2024-04-18T21:05:09.599660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597324+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:09.597324+0000","last_peered":"2024-04-18T21:05:09.597324+0000","last_clean":"2024-04-18T21:05:09.597324+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:09.597324+0000","last_undegraded":"2024-04-18T21:05:09.597324+0000","last_fullsized":"2024-04-18T21:05:09.597324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597169+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:09.597169+0000","last_peered":"2024-04-18T21:05:09.597169+0000","last_clean":"2024-04-18T21:05:09.597169+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:09.597169+0000","last_undegraded":"2024-04-18T21:05:09.597169+0000","last_fullsized":"2024-04-18T21:05:09.597169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597772+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:09.597772+0000","last_peered":"2024-04-18T21:05:09.597772+0000","last_clean":"2024-04-18T21:05:09.597772+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:09.597772+0000","last_undegraded":"2024-04-18T21:05:09.597772+0000","last_fullsized":"2024-04-18T21:05:09.597772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598943+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:09.598943+0000","last_peered":"2024-04-18T21:05:09.598943+0000","last_clean":"2024-04-18T21:05:09.598943+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:09.598943+0000","last_undegraded":"2024-04-18T21:05:09.598943+0000","last_fullsized":"2024-04-18T21:05:09.598943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599108+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:09.599108+0000","last_peered":"2024-04-18T21:05:09.599108+0000","last_clean":"2024-04-18T21:05:09.599108+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:09.599108+0000","last_undegraded":"2024-04-18T21:05:09.599108+0000","last_fullsized":"2024-04-18T21:05:09.599108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599150+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:09.599150+0000","last_peered":"2024-04-18T21:05:09.599150+0000","last_clean":"2024-04-18T21:05:09.599150+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:09.599150+0000","last_undegraded":"2024-04-18T21:05:09.599150+0000","last_fullsized":"2024-04-18T21:05:09.599150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599471+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:09.599471+0000","last_peered":"2024-04-18T21:05:09.599471+0000","last_clean":"2024-04-18T21:05:09.599471+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:09.599471+0000","last_undegraded":"2024-04-18T21:05:09.599471+0000","last_fullsized":"2024-04-18T21:05:09.599471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598876+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:09.598876+0000","last_peered":"2024-04-18T21:05:09.598876+0000","last_clean":"2024-04-18T21:05:09.598876+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:09.598876+0000","last_undegraded":"2024-04-18T21:05:09.598876+0000","last_fullsized":"2024-04-18T21:05:09.598876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597939+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:09.597939+0000","last_peered":"2024-04-18T21:05:09.597939+0000","last_clean":"2024-04-18T21:05:09.597939+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:09.597939+0000","last_undegraded":"2024-04-18T21:05:09.597939+0000","last_fullsized":"2024-04-18T21:05:09.597939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597358+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:09.597358+0000","last_peered":"2024-04-18T21:05:09.597358+0000","last_clean":"2024-04-18T21:05:09.597358+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:09.597358+0000","last_undegraded":"2024-04-18T21:05:09.597358+0000","last_fullsized":"2024-04-18T21:05:09.597358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597398+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:09.597398+0000","last_peered":"2024-04-18T21:05:09.597398+0000","last_clean":"2024-04-18T21:05:09.597398+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:09.597398+0000","last_undegraded":"2024-04-18T21:05:09.597398+0000","last_fullsized":"2024-04-18T21:05:09.597398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598760+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:09.598760+0000","last_peered":"2024-04-18T21:05:09.598760+0000","last_clean":"2024-04-18T21:05:09.598760+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:09.598760+0000","last_undegraded":"2024-04-18T21:05:09.598760+0000","last_fullsized":"2024-04-18T21:05:09.598760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599367+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:09.599367+0000","last_peered":"2024-04-18T21:05:09.599367+0000","last_clean":"2024-04-18T21:05:09.599367+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:09.599367+0000","last_undegraded":"2024-04-18T21:05:09.599367+0000","last_fullsized":"2024-04-18T21:05:09.599367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599082+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:09.599082+0000","last_peered":"2024-04-18T21:05:09.599082+0000","last_clean":"2024-04-18T21:05:09.599082+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:09.599082+0000","last_undegraded":"2024-04-18T21:05:09.599082+0000","last_fullsized":"2024-04-18T21:05:09.599082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597915+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:09.597915+0000","last_peered":"2024-04-18T21:05:09.597915+0000","last_clean":"2024-04-18T21:05:09.597915+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:09.597915+0000","last_undegraded":"2024-04-18T21:05:09.597915+0000","last_fullsized":"2024-04-18T21:05:09.597915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600134+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:09.600134+0000","last_peered":"2024-04-18T21:05:09.600134+0000","last_clean":"2024-04-18T21:05:09.600134+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:09.600134+0000","last_undegraded":"2024-04-18T21:05:09.600134+0000","last_fullsized":"2024-04-18T21:05:09.600134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598229+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:09.598229+0000","last_peered":"2024-04-18T21:05:09.598229+0000","last_clean":"2024-04-18T21:05:09.598229+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:09.598229+0000","last_undegraded":"2024-04-18T21:05:09.598229+0000","last_fullsized":"2024-04-18T21:05:09.598229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598658+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:09.598658+0000","last_peered":"2024-04-18T21:05:09.598658+0000","last_clean":"2024-04-18T21:05:09.598658+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:09.598658+0000","last_undegraded":"2024-04-18T21:05:09.598658+0000","last_fullsized":"2024-04-18T21:05:09.598658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597388+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:09.597388+0000","last_peered":"2024-04-18T21:05:09.597388+0000","last_clean":"2024-04-18T21:05:09.597388+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:09.597388+0000","last_undegraded":"2024-04-18T21:05:09.597388+0000","last_fullsized":"2024-04-18T21:05:09.597388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596837+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:09.596837+0000","last_peered":"2024-04-18T21:05:09.596837+0000","last_clean":"2024-04-18T21:05:09.596837+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:09.596837+0000","last_undegraded":"2024-04-18T21:05:09.596837+0000","last_fullsized":"2024-04-18T21:05:09.596837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599636+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:09.599636+0000","last_peered":"2024-04-18T21:05:09.599636+0000","last_clean":"2024-04-18T21:05:09.599636+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:09.599636+0000","last_undegraded":"2024-04-18T21:05:09.599636+0000","last_fullsized":"2024-04-18T21:05:09.599636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596976+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:09.596976+0000","last_peered":"2024-04-18T21:05:09.596976+0000","last_clean":"2024-04-18T21:05:09.596976+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:09.596976+0000","last_undegraded":"2024-04-18T21:05:09.596976+0000","last_fullsized":"2024-04-18T21:05:09.596976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599727+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:09.599727+0000","last_peered":"2024-04-18T21:05:09.599727+0000","last_clean":"2024-04-18T21:05:09.599727+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:09.599727+0000","last_undegraded":"2024-04-18T21:05:09.599727+0000","last_fullsized":"2024-04-18T21:05:09.599727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598512+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:09.598512+0000","last_peered":"2024-04-18T21:05:09.598512+0000","last_clean":"2024-04-18T21:05:09.598512+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:09.598512+0000","last_undegraded":"2024-04-18T21:05:09.598512+0000","last_fullsized":"2024-04-18T21:05:09.598512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600048+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:09.600048+0000","last_peered":"2024-04-18T21:05:09.600048+0000","last_clean":"2024-04-18T21:05:09.600048+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:09.600048+0000","last_undegraded":"2024-04-18T21:05:09.600048+0000","last_fullsized":"2024-04-18T21:05:09.600048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599364+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:09.599364+0000","last_peered":"2024-04-18T21:05:09.599364+0000","last_clean":"2024-04-18T21:05:09.599364+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:09.599364+0000","last_undegraded":"2024-04-18T21:05:09.599364+0000","last_fullsized":"2024-04-18T21:05:09.599364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599469+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:09.599469+0000","last_peered":"2024-04-18T21:05:09.599469+0000","last_clean":"2024-04-18T21:05:09.599469+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:09.599469+0000","last_undegraded":"2024-04-18T21:05:09.599469+0000","last_fullsized":"2024-04-18T21:05:09.599469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599735+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:09.599735+0000","last_peered":"2024-04-18T21:05:09.599735+0000","last_clean":"2024-04-18T21:05:09.599735+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:09.599735+0000","last_undegraded":"2024-04-18T21:05:09.599735+0000","last_fullsized":"2024-04-18T21:05:09.599735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599299+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:09.599299+0000","last_peered":"2024-04-18T21:05:09.599299+0000","last_clean":"2024-04-18T21:05:09.599299+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:09.599299+0000","last_undegraded":"2024-04-18T21:05:09.599299+0000","last_fullsized":"2024-04-18T21:05:09.599299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599447+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:09.599447+0000","last_peered":"2024-04-18T21:05:09.599447+0000","last_clean":"2024-04-18T21:05:09.599447+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:09.599447+0000","last_undegraded":"2024-04-18T21:05:09.599447+0000","last_fullsized":"2024-04-18T21:05:09.599447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598762+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:09.598762+0000","last_peered":"2024-04-18T21:05:09.598762+0000","last_clean":"2024-04-18T21:05:09.598762+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:09.598762+0000","last_undegraded":"2024-04-18T21:05:09.598762+0000","last_fullsized":"2024-04-18T21:05:09.598762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599000+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:09.599000+0000","last_peered":"2024-04-18T21:05:09.599000+0000","last_clean":"2024-04-18T21:05:09.599000+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:09.599000+0000","last_undegraded":"2024-04-18T21:05:09.599000+0000","last_fullsized":"2024-04-18T21:05:09.599000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598602+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:09.598602+0000","last_peered":"2024-04-18T21:05:09.598602+0000","last_clean":"2024-04-18T21:05:09.598602+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:09.598602+0000","last_undegraded":"2024-04-18T21:05:09.598602+0000","last_fullsized":"2024-04-18T21:05:09.598602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598948+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:09.598948+0000","last_peered":"2024-04-18T21:05:09.598948+0000","last_clean":"2024-04-18T21:05:09.598948+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:09.598948+0000","last_undegraded":"2024-04-18T21:05:09.598948+0000","last_fullsized":"2024-04-18T21:05:09.598948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597968+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:09.597968+0000","last_peered":"2024-04-18T21:05:09.597968+0000","last_clean":"2024-04-18T21:05:09.597968+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:09.597968+0000","last_undegraded":"2024-04-18T21:05:09.597968+0000","last_fullsized":"2024-04-18T21:05:09.597968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599722+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:09.599722+0000","last_peered":"2024-04-18T21:05:09.599722+0000","last_clean":"2024-04-18T21:05:09.599722+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:09.599722+0000","last_undegraded":"2024-04-18T21:05:09.599722+0000","last_fullsized":"2024-04-18T21:05:09.599722+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598414+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:09.598414+0000","last_peered":"2024-04-18T21:05:09.598414+0000","last_clean":"2024-04-18T21:05:09.598414+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:09.598414+0000","last_undegraded":"2024-04-18T21:05:09.598414+0000","last_fullsized":"2024-04-18T21:05:09.598414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599554+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:09.599554+0000","last_peered":"2024-04-18T21:05:09.599554+0000","last_clean":"2024-04-18T21:05:09.599554+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:09.599554+0000","last_undegraded":"2024-04-18T21:05:09.599554+0000","last_fullsized":"2024-04-18T21:05:09.599554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597870+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:09.597870+0000","last_peered":"2024-04-18T21:05:09.597870+0000","last_clean":"2024-04-18T21:05:09.597870+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:09.597870+0000","last_undegraded":"2024-04-18T21:05:09.597870+0000","last_fullsized":"2024-04-18T21:05:09.597870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597919+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:09.597919+0000","last_peered":"2024-04-18T21:05:09.597919+0000","last_clean":"2024-04-18T21:05:09.597919+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:09.597919+0000","last_undegraded":"2024-04-18T21:05:09.597919+0000","last_fullsized":"2024-04-18T21:05:09.597919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599217+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:09.599217+0000","last_peered":"2024-04-18T21:05:09.599217+0000","last_clean":"2024-04-18T21:05:09.599217+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:09.599217+0000","last_undegraded":"2024-04-18T21:05:09.599217+0000","last_fullsized":"2024-04-18T21:05:09.599217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598327+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:09.598327+0000","last_peered":"2024-04-18T21:05:09.598327+0000","last_clean":"2024-04-18T21:05:09.598327+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:09.598327+0000","last_undegraded":"2024-04-18T21:05:09.598327+0000","last_fullsized":"2024-04-18T21:05:09.598327+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598804+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:09.598804+0000","last_peered":"2024-04-18T21:05:09.598804+0000","last_clean":"2024-04-18T21:05:09.598804+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:09.598804+0000","last_undegraded":"2024-04-18T21:05:09.598804+0000","last_fullsized":"2024-04-18T21:05:09.598804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599075+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:09.599075+0000","last_peered":"2024-04-18T21:05:09.599075+0000","last_clean":"2024-04-18T21:05:09.599075+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:09.599075+0000","last_undegraded":"2024-04-18T21:05:09.599075+0000","last_fullsized":"2024-04-18T21:05:09.599075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599404+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:09.599404+0000","last_peered":"2024-04-18T21:05:09.599404+0000","last_clean":"2024-04-18T21:05:09.599404+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:09.599404+0000","last_undegraded":"2024-04-18T21:05:09.599404+0000","last_fullsized":"2024-04-18T21:05:09.599404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599639+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:09.599639+0000","last_peered":"2024-04-18T21:05:09.599639+0000","last_clean":"2024-04-18T21:05:09.599639+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:09.599639+0000","last_undegraded":"2024-04-18T21:05:09.599639+0000","last_fullsized":"2024-04-18T21:05:09.599639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600069+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:09.600069+0000","last_peered":"2024-04-18T21:05:09.600069+0000","last_clean":"2024-04-18T21:05:09.600069+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:09.600069+0000","last_undegraded":"2024-04-18T21:05:09.600069+0000","last_fullsized":"2024-04-18T21:05:09.600069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599802+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:09.599802+0000","last_peered":"2024-04-18T21:05:09.599802+0000","last_clean":"2024-04-18T21:05:09.599802+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:09.599802+0000","last_undegraded":"2024-04-18T21:05:09.599802+0000","last_fullsized":"2024-04-18T21:05:09.599802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600141+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:09.600141+0000","last_peered":"2024-04-18T21:05:09.600141+0000","last_clean":"2024-04-18T21:05:09.600141+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:09.600141+0000","last_undegraded":"2024-04-18T21:05:09.600141+0000","last_fullsized":"2024-04-18T21:05:09.600141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597468+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:09.597468+0000","last_peered":"2024-04-18T21:05:09.597468+0000","last_clean":"2024-04-18T21:05:09.597468+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:09.597468+0000","last_undegraded":"2024-04-18T21:05:09.597468+0000","last_fullsized":"2024-04-18T21:05:09.597468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600143+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:09.600143+0000","last_peered":"2024-04-18T21:05:09.600143+0000","last_clean":"2024-04-18T21:05:09.600143+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:09.600143+0000","last_undegraded":"2024-04-18T21:05:09.600143+0000","last_fullsized":"2024-04-18T21:05:09.600143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600066+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:09.600066+0000","last_peered":"2024-04-18T21:05:09.600066+0000","last_clean":"2024-04-18T21:05:09.600066+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:09.600066+0000","last_undegraded":"2024-04-18T21:05:09.600066+0000","last_fullsized":"2024-04-18T21:05:09.600066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597586+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:09.597586+0000","last_peered":"2024-04-18T21:05:09.597586+0000","last_clean":"2024-04-18T21:05:09.597586+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:09.597586+0000","last_undegraded":"2024-04-18T21:05:09.597586+0000","last_fullsized":"2024-04-18T21:05:09.597586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599991+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:09.599991+0000","last_peered":"2024-04-18T21:05:09.599991+0000","last_clean":"2024-04-18T21:05:09.599991+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:09.599991+0000","last_undegraded":"2024-04-18T21:05:09.599991+0000","last_fullsized":"2024-04-18T21:05:09.599991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600385+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:09.600385+0000","last_peered":"2024-04-18T21:05:09.600385+0000","last_clean":"2024-04-18T21:05:09.600385+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:09.600385+0000","last_undegraded":"2024-04-18T21:05:09.600385+0000","last_fullsized":"2024-04-18T21:05:09.600385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598019+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:09.598019+0000","last_peered":"2024-04-18T21:05:09.598019+0000","last_clean":"2024-04-18T21:05:09.598019+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:09.598019+0000","last_undegraded":"2024-04-18T21:05:09.598019+0000","last_fullsized":"2024-04-18T21:05:09.598019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600388+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:09.600388+0000","last_peered":"2024-04-18T21:05:09.600388+0000","last_clean":"2024-04-18T21:05:09.600388+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:09.600388+0000","last_undegraded":"2024-04-18T21:05:09.600388+0000","last_fullsized":"2024-04-18T21:05:09.600388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597980+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:09.597980+0000","last_peered":"2024-04-18T21:05:09.597980+0000","last_clean":"2024-04-18T21:05:09.597980+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:09.597980+0000","last_undegraded":"2024-04-18T21:05:09.597980+0000","last_fullsized":"2024-04-18T21:05:09.597980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597890+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:09.597890+0000","last_peered":"2024-04-18T21:05:09.597890+0000","last_clean":"2024-04-18T21:05:09.597890+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:09.597890+0000","last_undegraded":"2024-04-18T21:05:09.597890+0000","last_fullsized":"2024-04-18T21:05:09.597890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600046+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:09.600046+0000","last_peered":"2024-04-18T21:05:09.600046+0000","last_clean":"2024-04-18T21:05:09.600046+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:09.600046+0000","last_undegraded":"2024-04-18T21:05:09.600046+0000","last_fullsized":"2024-04-18T21:05:09.600046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598801+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:09.598801+0000","last_peered":"2024-04-18T21:05:09.598801+0000","last_clean":"2024-04-18T21:05:09.598801+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:09.598801+0000","last_undegraded":"2024-04-18T21:05:09.598801+0000","last_fullsized":"2024-04-18T21:05:09.598801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599682+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:09.599682+0000","last_peered":"2024-04-18T21:05:09.599682+0000","last_clean":"2024-04-18T21:05:09.599682+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:09.599682+0000","last_undegraded":"2024-04-18T21:05:09.599682+0000","last_fullsized":"2024-04-18T21:05:09.599682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598593+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:09.598593+0000","last_peered":"2024-04-18T21:05:09.598593+0000","last_clean":"2024-04-18T21:05:09.598593+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:09.598593+0000","last_undegraded":"2024-04-18T21:05:09.598593+0000","last_fullsized":"2024-04-18T21:05:09.598593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597624+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:09.597624+0000","last_peered":"2024-04-18T21:05:09.597624+0000","last_clean":"2024-04-18T21:05:09.597624+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:09.597624+0000","last_undegraded":"2024-04-18T21:05:09.597624+0000","last_fullsized":"2024-04-18T21:05:09.597624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599784+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:09.599784+0000","last_peered":"2024-04-18T21:05:09.599784+0000","last_clean":"2024-04-18T21:05:09.599784+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:09.599784+0000","last_undegraded":"2024-04-18T21:05:09.599784+0000","last_fullsized":"2024-04-18T21:05:09.599784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597293+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:09.597293+0000","last_peered":"2024-04-18T21:05:09.597293+0000","last_clean":"2024-04-18T21:05:09.597293+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:09.597293+0000","last_undegraded":"2024-04-18T21:05:09.597293+0000","last_fullsized":"2024-04-18T21:05:09.597293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599648+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:09.599648+0000","last_peered":"2024-04-18T21:05:09.599648+0000","last_clean":"2024-04-18T21:05:09.599648+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:09.599648+0000","last_undegraded":"2024-04-18T21:05:09.599648+0000","last_fullsized":"2024-04-18T21:05:09.599648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598342+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:09.598342+0000","last_peered":"2024-04-18T21:05:09.598342+0000","last_clean":"2024-04-18T21:05:09.598342+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:09.598342+0000","last_undegraded":"2024-04-18T21:05:09.598342+0000","last_fullsized":"2024-04-18T21:05:09.598342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599489+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:09.599489+0000","last_peered":"2024-04-18T21:05:09.599489+0000","last_clean":"2024-04-18T21:05:09.599489+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:09.599489+0000","last_undegraded":"2024-04-18T21:05:09.599489+0000","last_fullsized":"2024-04-18T21:05:09.599489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598559+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:09.598559+0000","last_peered":"2024-04-18T21:05:09.598559+0000","last_clean":"2024-04-18T21:05:09.598559+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:09.598559+0000","last_undegraded":"2024-04-18T21:05:09.598559+0000","last_fullsized":"2024-04-18T21:05:09.598559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598371+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:09.598371+0000","last_peered":"2024-04-18T21:05:09.598371+0000","last_clean":"2024-04-18T21:05:09.598371+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:09.598371+0000","last_undegraded":"2024-04-18T21:05:09.598371+0000","last_fullsized":"2024-04-18T21:05:09.598371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598001+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:09.598001+0000","last_peered":"2024-04-18T21:05:09.598001+0000","last_clean":"2024-04-18T21:05:09.598001+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:09.598001+0000","last_undegraded":"2024-04-18T21:05:09.598001+0000","last_fullsized":"2024-04-18T21:05:09.598001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598312+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:09.598312+0000","last_peered":"2024-04-18T21:05:09.598312+0000","last_clean":"2024-04-18T21:05:09.598312+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:09.598312+0000","last_undegraded":"2024-04-18T21:05:09.598312+0000","last_fullsized":"2024-04-18T21:05:09.598312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598393+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:09.598393+0000","last_peered":"2024-04-18T21:05:09.598393+0000","last_clean":"2024-04-18T21:05:09.598393+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:09.598393+0000","last_undegraded":"2024-04-18T21:05:09.598393+0000","last_fullsized":"2024-04-18T21:05:09.598393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599054+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:09.599054+0000","last_peered":"2024-04-18T21:05:09.599054+0000","last_clean":"2024-04-18T21:05:09.599054+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:09.599054+0000","last_undegraded":"2024-04-18T21:05:09.599054+0000","last_fullsized":"2024-04-18T21:05:09.599054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599890+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:09.599890+0000","last_peered":"2024-04-18T21:05:09.599890+0000","last_clean":"2024-04-18T21:05:09.599890+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:09.599890+0000","last_undegraded":"2024-04-18T21:05:09.599890+0000","last_fullsized":"2024-04-18T21:05:09.599890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599262+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:09.599262+0000","last_peered":"2024-04-18T21:05:09.599262+0000","last_clean":"2024-04-18T21:05:09.599262+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:09.599262+0000","last_undegraded":"2024-04-18T21:05:09.599262+0000","last_fullsized":"2024-04-18T21:05:09.599262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599155+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:09.599155+0000","last_peered":"2024-04-18T21:05:09.599155+0000","last_clean":"2024-04-18T21:05:09.599155+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:09.599155+0000","last_undegraded":"2024-04-18T21:05:09.599155+0000","last_fullsized":"2024-04-18T21:05:09.599155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599141+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:09.599141+0000","last_peered":"2024-04-18T21:05:09.599141+0000","last_clean":"2024-04-18T21:05:09.599141+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:09.599141+0000","last_undegraded":"2024-04-18T21:05:09.599141+0000","last_fullsized":"2024-04-18T21:05:09.599141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600318+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:09.600318+0000","last_peered":"2024-04-18T21:05:09.600318+0000","last_clean":"2024-04-18T21:05:09.600318+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:09.600318+0000","last_undegraded":"2024-04-18T21:05:09.600318+0000","last_fullsized":"2024-04-18T21:05:09.600318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597823+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:09.597823+0000","last_peered":"2024-04-18T21:05:09.597823+0000","last_clean":"2024-04-18T21:05:09.597823+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:09.597823+0000","last_undegraded":"2024-04-18T21:05:09.597823+0000","last_fullsized":"2024-04-18T21:05:09.597823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599251+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:09.599251+0000","last_peered":"2024-04-18T21:05:09.599251+0000","last_clean":"2024-04-18T21:05:09.599251+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:09.599251+0000","last_undegraded":"2024-04-18T21:05:09.599251+0000","last_fullsized":"2024-04-18T21:05:09.599251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":647274,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":647890,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:23.463 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T21:05:23.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 18 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:fsid ce5e2bf2-36af-4d40-a378-74a7158189ef 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-04-18T21:04:46.921896+0000 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-04-18T21:05:09.584166+0000 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:crush_version 4 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:full_ratio 0.95 2024-04-18T21:05:23.789 INFO:teuthology.orchestra.run.smithi096.stdout:backfillfull_ratio 0.9 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:nearfull_ratio 0.85 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:require_min_compat_client luminous 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:min_compat_client jewel 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:require_osd_release squid 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:stretch_mode_enabled false 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:max_osd 3 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/1095770023,v1:172.21.15.111:6801/1095770023] [v2:172.21.15.111:6802/1095770023,v1:172.21.15.111:6803/1095770023] exists,up e255a90f-ab37-44af-9793-7ea323c63959 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/2586340961,v1:172.21.15.134:6801/2586340961] [v2:172.21.15.134:6802/2586340961,v1:172.21.15.134:6803/2586340961] exists,up 2d189848-7fef-4eed-a1e7-524937587a71 2024-04-18T21:05:23.790 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/2001406304,v1:172.21.15.194:6801/2001406304] [v2:172.21.15.194:6802/2001406304,v1:172.21.15.194:6803/2001406304] exists,up 2de50865-b6ec-4639-a544-dd366b440c50 2024-04-18T21:05:23.806 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/1095770023,v1:172.21.15.111:6801/1095770023] [v2:172.21.15.111:6802/1095770023,v1:172.21.15.111:6803/1095770023] exists,up e255a90f-ab37-44af-9793-7ea323c63959', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/2586340961,v1:172.21.15.134:6801/2586340961] [v2:172.21.15.134:6802/2586340961,v1:172.21.15.134:6803/2586340961] exists,up 2d189848-7fef-4eed-a1e7-524937587a71', 'osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/2001406304,v1:172.21.15.194:6801/2001406304] [v2:172.21.15.194:6802/2001406304,v1:172.21.15.194:6803/2001406304] exists,up 2de50865-b6ec-4639-a544-dd366b440c50'] 2024-04-18T21:05:23.806 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-18T21:05:23.922 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:05:23.922 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mon.a", 2024-04-18T21:05:23.922 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster": "ceph", 2024-04-18T21:05:23.922 INFO:teuthology.orchestra.run.smithi096.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-18T21:05:23.922 INFO:teuthology.orchestra.run.smithi096.stdout: "admin_socket_mode": "", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_client_required": "cephx, none", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_cluster_required": "cephx", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_debug": "true", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_service_required": "cephx", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_supported": "cephx", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio": "true", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio_poll_ms": "250", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio_reap_max": "16", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_async_discard_threads": "0", 2024-04-18T21:05:23.923 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_block_size": "4096", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_aio": "false", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_inflight_ios": "false", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_enable_discard": "false", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_flock_retry": "3", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_inject_crash": "0", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_ioring": "false", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_ioring_hipri": "false", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-18T21:05:23.924 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_type": "", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_alloc_size": "1048576", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_allocator": "hybrid", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_buffered_io": "true", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_check_for_zeros": "false", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_compact_log_sync": "false", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_max_log_runway": "4194304", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_max_prefetch": "1048576", 2024-04-18T21:05:23.925 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_min_flush_size": "524288", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_min_log_runway": "1048576", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_replay_recovery": "false", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_sync_write": "false", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_allocation_from_file": "true", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_allocator": "hybrid", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-18T21:05:23.926 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_create": "true", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_db_create": "false", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_db_path": "", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_db_size": "0", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_path": "", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_preallocate_file": "false", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_size": "107374182400", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_wal_create": "false", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_wal_path": "", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_wal_size": "100663296", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs": "true", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-18T21:05:23.927 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_autotune": "true", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_size": "0", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-18T21:05:23.928 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_type": "2q", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_clone_cow": "true", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_mode": "none", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_csum_type": "crc32c", 2024-04-18T21:05:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_freelist": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-18T21:05:23.930 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_small_allocations": "0", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_default_buffered_read": "true", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_default_buffered_write": "false", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fail_eio": "false", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-18T21:05:23.931 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mount": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_umount": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-18T21:05:23.932 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_ignore_data_csum": "false", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_log_op_age": "5.000000", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_alloc_size": "0", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_blob_size": "0", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_deferred_txc": "32", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_min_alloc_size": "0", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-18T21:05:23.933 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_nid_prealloc": "1024", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_retry_disk_reads": "3", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_cf": "true", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_mem": "512", 2024-04-18T21:05:23.934 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_tracing": "false", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-18T21:05:23.935 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_zero_block_detection": "false", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-18T21:05:23.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_cluster_require_signatures": "false", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_cluster_require_version": "2", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_require_signatures": "false", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_require_version": "2", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_service_require_signatures": "false", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_service_require_version": "2", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_sign_messages": "true", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "chdir": "", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "client_acl_type": "", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "client_asio_thread_count": "2", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "client_cache_mid": "0.750000", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "client_cache_size": "16384", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "client_caps_release_delay": "5", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "client_check_pool_perm": "true", 2024-04-18T21:05:23.937 INFO:teuthology.orchestra.run.smithi096.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_debug_force_sync_read": "false", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_debug_getattr_caps": "false", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_debug_inject_tick_delay": "0", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_die_on_failed_remount": "false", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_dirsize_rbytes": "true", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_force_lazyio": "false", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_fs": "", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_inject_release_failure": "false", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_max_inline_size": "4096", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mds_namespace": "", 2024-04-18T21:05:23.938 INFO:teuthology.orchestra.run.smithi096.stdout: "client_metadata": "", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mount_gid": "-1", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mount_timeout": "300", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mount_uid": "-1", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mountpoint": "/", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_notify_timeout": "10", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc": "true", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_max_dirty": "104857600", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_max_objects": "1000", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_size": "209715200", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_target_dirty": "8388608", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_permissions": "true", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_quota": "true", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_quota_df": "true", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_readahead_max_bytes": "0", 2024-04-18T21:05:23.939 INFO:teuthology.orchestra.run.smithi096.stdout: "client_readahead_max_periods": "4", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_readahead_min": "131072", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_reconnect_stale": "false", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_shutdown_timeout": "30", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_snapdir": ".snap", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_tick_interval": "1", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_trace": "", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_try_dentry_invalidate": "false", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_use_faked_inos": "false", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_use_random_mds": "false", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_graylog": "false", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_graylog_port": "12201", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_monitors": "default=true", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_syslog": "false", 2024-04-18T21:05:23.940 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_syslog_level": "info", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "-", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_network": "", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_network_interface": "", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zlib_isal": "false", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zlib_level": "5", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zlib_winsize": "-15", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zstd_level": "1", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_alien_op_num_threads": "6", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_osd_stat_interval": "0", 2024-04-18T21:05:23.941 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_seastar_cpu_cores": "", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location_hook": "", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location_hook_timeout": "10", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "daemonize": "false", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "daos_pool": "tank", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_alienstore": "0/5", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_allow_any_pool_priority": "false", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_asok": "1/5", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_asok_assert_abort": "false", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_asserts_on_shutdown": "true", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_auth": "20/20", 2024-04-18T21:05:23.942 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_bdev": "1/3", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_bluefs": "1/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_bluestore": "1/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_buffer": "0/1", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_ceph_exporter": "1/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_cephfs_mirror": "0/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_cephsqlite": "0/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_client": "0/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_compressor": "1/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_context": "0/1", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_crimson_interrupt": "0/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_crush": "1/1", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_crypto": "1/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_cyanstore": "0/5", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_deliberately_leak_memory": "false", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_disable_randomized_ping": "false", 2024-04-18T21:05:23.943 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_dpdk": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_eventtrace": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_filer": "0/1", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_filestore": "1/3", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_finisher": "1/1", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_fuse": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_heartbeat_testing_span": "0", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_heartbeatmap": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_javaclient": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_journal": "1/3", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_journaler": "0/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_kstore": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_lockdep": "0/1", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mclock": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds": "1/5", 2024-04-18T21:05:23.944 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_balancer": "1/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_locker": "1/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_log": "1/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_log_expire": "1/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_migrator": "1/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_quiesce": "3/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_memstore": "1/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mgr": "2/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mgrc": "1/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mon": "20/20", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_monc": "0/10", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_ms": "1/1", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_none": "0/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_objclass": "0/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_objectcacher": "0/5", 2024-04-18T21:05:23.945 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_objecter": "0/1", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_optracker": "0/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_osd": "1/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_paxos": "20/20", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_perfcounter": "1/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_prioritycache": "1/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rados": "0/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd": "0/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd_mirror": "0/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd_pwl": "0/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd_replay": "0/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_refs": "0/0", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_reserver": "1/1", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw": "1/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_access": "1/5", 2024-04-18T21:05:23.946 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_datacache": "1/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_dbstore": "1/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_flight": "1/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_notification": "1/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_sync": "1/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rocksdb": "4/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore": "0/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_backref": "0/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_cache": "0/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_cleaner": "0/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_device": "0/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_epm": "0/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-18T21:05:23.947 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_journal": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_lba": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_odata": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_omap": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_onode": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_t": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_tm": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_striper": "0/1", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_test": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_throttle": "1/1", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_timer": "0/1", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_tp": "0/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_trace": "1/5", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "device_failure_prediction_mode": "none", 2024-04-18T21:05:23.948 INFO:teuthology.orchestra.run.smithi096.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_graylog": "false", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_journald": "false", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_stderr": "true", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_syslog": "false", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event_tracing": "false", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_addr": "0.0.0.0", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_http_port": "9926", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_prio_limit": "5", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_sort_metrics": "true", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_stats_period": "5", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "fake_statfs_for_testing": "0", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "fatal_signal_handlers": "true", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "filer_max_purge_ops": "10", 2024-04-18T21:05:23.949 INFO:teuthology.orchestra.run.smithi096.stdout: "filer_max_truncate_ops": "128", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_apply_finisher_threads": "1", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_blackhole": "false", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_btrfs_clone_range": "true", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_btrfs_snap": "true", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_caller_concurrency": "10", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_collect_device_partition_information": "true", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_commit_timeout": "600.000000", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_debug_inject_read_err": "false", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_debug_omap_check": "false", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_debug_verify_split": "false", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_dump_file": "", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-18T21:05:23.950 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fadvise": "true", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fail_eio": "true", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fd_cache_shards": "16", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fd_cache_size": "128", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fiemap": "false", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fiemap_threshold": "4096", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_inject_stall": "0", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_journal_parallel": "false", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_journal_trailing": "false", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_journal_writeahead": "false", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_kill_at": "0", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-18T21:05:23.951 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs": "0", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size": "0", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_merge_threshold": "-10", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_odsync_write": "false", 2024-04-18T21:05:23.952 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_omap_backend": "rocksdb", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_omap_backend_path": "", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_op_thread_timeout": "60", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_op_threads": "2", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_punch_hole": "false", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-18T21:05:23.953 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_ops": "50", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_seek_data_hole": "false", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_sloppy_crc": "false", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_splice": "false", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_split_multiple": "2", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_split_rand_factor": "20", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_update_to": "1000", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-18T21:05:23.954 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_enable": "true", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_xfs_extsize": "false", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_zfs_snap": "false", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "fio_dir": "/tmp/fio", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_allow_other": "true", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_atomic_o_trunc": "true", 2024-04-18T21:05:23.955 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_big_writes": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_debug": "false", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_default_permissions": "false", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_disable_pagecache": "false", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_max_write": "0", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_multithreaded": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_require_active_mds": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_set_user_groups": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_splice_move": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_splice_read": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_splice_write": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_use_invalidate_cb": "true", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "gss_target_name": "ceph", 2024-04-18T21:05:23.956 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_file": "", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_inject_failure": "0", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_interval": "5", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "host": "smithi096", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-18T21:05:23.957 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "inject_early_sigterm": "false", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "jaeger_agent_port": "6799", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "jaeger_tracing_enable": "false", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_aio": "true", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_align_min_size": "65536", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_block_align": "true", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_block_size": "4096", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_dio": "true", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_discard": "false", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_force_aio": "false", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_ignore_corruption": "false", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_max_write_bytes": "10485760", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_max_write_entries": "100", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_replay_from": "0", 2024-04-18T21:05:23.958 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_write_header_frequency": "0", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_zero_on_create": "false", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journaler_prefetch_periods": "10", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journaler_prezero_periods": "5", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "journaler_write_head_interval": "15", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "keyfile": "", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_backend": "rocksdb", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_default_stripe_size": "65536", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_fsck_on_mount": "false", 2024-04-18T21:05:23.959 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_max_bytes": "67108864", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_max_ops": "512", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_nid_prealloc": "1024", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_onode_map_size": "1024", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_sync_submit_transaction": "false", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_sync_transaction": "false", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "librados_thread_count": "2", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "lockdep": "false", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "lockdep_force_backtrace": "false", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "log_coarse_timestamps": "true", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "log_flush_on_exit": "false", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "log_graylog_host": "127.0.0.1", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "log_graylog_port": "12201", 2024-04-18T21:05:23.960 INFO:teuthology.orchestra.run.smithi096.stdout: "log_max_new": "1000", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_max_recent": "10000", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_stderr_prefix": "", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_stop_at_utilization": "0.970000", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": "true", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_graylog": "false", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_journald": "false", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_stderr": "false", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_syslog": "false", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "max_rotating_auth_attempts": "10", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-18T21:05:23.961 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_action_on_write_error": "1", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_alternate_name_max": "8192", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_asio_thread_count": "2", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_export_pin": "true", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_dirs": "true", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_interval": "5", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_interval": "10", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_max": "-1", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_max_until": "-1", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_merge_size": "50", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_midchunk": "0.300000", 2024-04-18T21:05:23.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_min_start": "0.200000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_minchunk": "0.001000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_mode": "0", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_need_max": "1.200000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_need_min": "0.800000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_overload_epochs": "2", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_bits": "3", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_size": "10000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_target_decay": "10.000000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-18T21:05:23.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_beacon_grace": "15.000000", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_beacon_interval": "4.000000", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_mid": "0.700000", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_quiesce_delay": "0", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_release_free_interval": "10", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_reservation": "0.050000", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_trim_interval": "1", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_trim_threshold": "262144", 2024-04-18T21:05:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_client_prealloc_inos": "1000", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_connect_bootstrapping": "false", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_damage_table_max_entries": "10000", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_auth_pins": "false", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_frag": "false", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_scatterstat": "false", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_subtrees": "false", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_decay_halflife": "5.000000", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_default_dir_hash": "2", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_defer_session_stale": "true", 2024-04-18T21:05:23.965 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_deny_all_reconnect": "false", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_keys_per_op": "16384", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_max_commit_size": "10", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_max_entries": "0", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_prefetch": "true", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_on_map": "false", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_early_reply": "true", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_enable_op_tracker": "true", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_enforce_unique_name": "true", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-18T21:05:23.966 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_random": "true", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_health_summarize_threshold": "10", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_health_dummy": "false", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-18T21:05:23.967 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_migrator_session_race": "false", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_join_fs": "", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_journal_format": "1", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_create_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_export_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_import_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_journal_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_journal_expire_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_journal_replay_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_link_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_mdstable_at": "0", 2024-04-18T21:05:23.968 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_openc_at": "0", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_rename_at": "0", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_shutdown_at": "0", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_event_large_threshold": "524288", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_events_per_segment": "1024", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_max_events": "-1", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_max_segments": "128", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_pause": "false", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_segment_size": "0", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_trim_threshold": "128", 2024-04-18T21:05:23.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_warn_factor": "2.000000", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_caps_per_client": "1048576", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_completed_flushes": "100000", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_completed_requests": "100000", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_export_size": "20971520", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_file_recover": "32", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_purge_files": "64", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_purge_ops": "8192", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_snaps_per_dir": "100", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_metrics_update_interval": "2", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_min_caps_per_client": "100", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_min_caps_working_set": "10000", 2024-04-18T21:05:23.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_numa_node": "-1", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_complaint_time": "30.000000", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_duration": "600", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_size": "20", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_slow_op_size": "20", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_log_threshold": "5", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_ping_grace": "15", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_ping_interval": "5", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_max_caps": "30000", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-18T21:05:23.971 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_warning_threshold": "262144", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_replay_interval": "1.000000", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_root_ino_gid": "0", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_root_ino_uid": "0", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-18T21:05:23.972 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_shutdown_check": "0", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_skip_ino": "0", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_snap_max_uid": "4294967294", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_snap_min_uid": "0", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_snap_rstat": "false", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_standby_replay_damaged": "false", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_symlink_recovery": "true", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_thrash_exports": "0", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_thrash_fragments": "0", 2024-04-18T21:05:23.973 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_tick_interval": "5.000000", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_valgrind_exit": "false", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_verify_backtrace": "1", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_verify_scatter": "false", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_wipe_sessions": "false", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mempool_debug": "false", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_device_bytes": "1073741824", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_page_set": "false", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_page_size": "65536", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_client_bytes": "134217728", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_client_messages": "512", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-18T21:05:23.974 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_disabled_modules": "", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_max_pg_creating": "1024", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_max_pg_num_change": "128", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mds_bytes": "134217728", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mds_messages": "128", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mon_bytes": "134217728", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mon_messages": "128", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_osd_bytes": "536870912", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_osd_messages": "8192", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_pool": "true", 2024-04-18T21:05:23.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_standby_modules": "true", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_stats_period": "5", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_stats_threshold": "5", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_tick_period": "2", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_allow_pool_delete": "true", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_allow_pool_size_one": "true", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_auth_validate_all_caps": "true", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_bytes": "104857600", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_directed_command_retry": "2", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-18T21:05:23.976 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_parallel": "3", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_log_interval": "1.000000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_ping_interval": "10.000000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_target_rank": "-1", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_level": "debug", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_file": "true", 2024-04-18T21:05:23.977 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_journald": "false", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_compact_on_bootstrap": "false", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_compact_on_start": "false", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_compact_on_trim": "true", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cpu_threads": "4", 2024-04-18T21:05:23.978 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_crush_min_required_version": "hammer", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_daemon_bytes": "419430400", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data_avail_crit": "5", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data_avail_warn": "5", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data_size_warn": "16106127360", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_dump_json": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_dump_transactions": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_extra_checks": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_require_reef": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_require_squid": "false", 2024-04-18T21:05:23.979 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_down_mkfs_grace": "120", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_down_uptime_grace": "60", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_election_default_strategy": "1", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_election_timeout": "5.000000", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_elector_ping_divisor": "2", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_enable_op_tracker": "true", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_fake_pool_delete": "false", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_force_quorum_join": "false", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_globalid_prealloc": "10000", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_detail_to_clog": "false", 2024-04-18T21:05:23.980 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_log_update_period": "5", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_max_detail": "50", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_to_clog": "true", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_to_clog_interval": "600", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_host": "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_host_override": "", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_initial_members": "", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_lease": "5.000000", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-18T21:05:23.981 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_log_full_interval": "50", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_log_max": "10000", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_log_max_summary": "50", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_log_epochs": "500", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_osd": "10000", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_pg_per_osd": "10000", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_pool_pg_num": "65536", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mds_force_trim_to": "0", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mds_skip_sanity": "false", 2024-04-18T21:05:23.982 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_memory_autotune": "true", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_memory_target": "2147483648", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_beacon_grace": "30", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_digest_period": "5", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_inactive_grace": "60", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_min_osdmap_epochs": "500", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_complaint_time": "30", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_duration": "600", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_size": "20", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_slow_op_size": "20", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_log_threshold": "5", 2024-04-18T21:05:23.983 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_auto_mark_in": "false", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_cache_size": "500", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_down_out_interval": "600", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_force_trim_to": "0", 2024-04-18T21:05:23.984 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_min_down_reporters": "2", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_report_timeout": "900", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_stuck_threshold": "60", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_probe_timeout": "2.000000", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_max_change": "0.050000", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_max_osds": "4", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_interval": "86400", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_max_keys": "100", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_timeout": "300", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_session_timeout": "300", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_smart_report_timeout": "5", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stat_smooth_intervals": "6", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_pool_min_size": "2", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_pool_size": "4", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_debug": "false", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_provider_kill_at": "0", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_requester_kill_at": "0", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_timeout": "60.000000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_target_pg_per_osd": "100", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_tick_interval": "5", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_timecheck_interval": "300.000000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_use_min_delay_socket": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_older_version_delay": "604800", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_misplaced": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_older_version": "true", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": "", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_tracing_enabled": "false", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_op_threads": "3", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_cm": "false", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_device_name": "", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_dscp": "96", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_local_gid": "", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_port_num": "1", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_sl": "3", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_support_srq": "true", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_type": "ib", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_reap_threshold": "5", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_before_connect": "false", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_ipv4": "true", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_ipv6": "false", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_msgr1": "true", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_msgr2": "true", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_port_max": "7568", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_port_min": "6800", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_retry_count": "3", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_retry_delay": "5", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_client": "false", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_mds": "false", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_mgr": "false", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_mon": "false", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_osd": "false", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_client_mode": "crc secure", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_cluster_mode": "crc secure", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_cluster_type": "", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_compress_secure": "false", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_connection_idle_timeout": "900", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_connection_ready_timeout": "10", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_crc_data": "true", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_crc_header": "true", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_bad_msg": "false", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_bug": "true", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_old_message": "true", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_skipped_message": "false", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_coremask": "0xF", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_enable_tso": "true", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_hugepages": "", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_lro": "true", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_memory_channel": "4", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_pmd": "", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_port_id": "0", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dump_on_send": "false", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_initial_backoff": "0.200000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_delay_max": "1.000000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_delay_type": "", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_network_congestion": "0", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_socket_failures": "0", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_learn_addr_from_peer": "true", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_max_accept_failures": "4", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_max_backoff": "15.000000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_mon_client_mode": "secure crc", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_mon_service_mode": "secure crc", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_osd_compress_min_size": "1024", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_osd_compress_mode": "none", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_pq_min_cost": "65536", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_public_type": "", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_service_mode": "crc secure", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_listen_backlog": "512", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_nodelay": "true", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_rcvbuf": "0", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_type": "async+posix", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "no_config_file": "false", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_completion_locks_per_session": "32", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_inflight_ops": "1024", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_tick_interval": "5.000000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_timeout": "10.000000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objectstore_blackhole": "false", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "openssl_engine_opts": "", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_delay_time": "5.000000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_hist_halflife": "1000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_max_low_ops": "2", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_max_ops": "4", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_slop": "0.020000", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_asio_thread_count": "2", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_async_recovery_min_cost": "100", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backfill_scan_max": "512", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backfill_scan_min": "64", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backoff_on_degraded": "false", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backoff_on_peering": "false", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backoff_on_unfound": "true", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_beacon_report_interval": "300", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_duration": "30", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_max_block_size": "67108864", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_blkin_trace_all": "false", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_check_for_log_corruption": "false", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_update_on_start": "true", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_message_cap": "256", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_message_size_cap": "524288000", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_op_priority": "63", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_watch_timeout": "30", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_command_max_records": "256", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_compact_on_start": "false", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_update_on_start": "true", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_update_weight_set": "true", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_feed_pullee": "-1", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_misdirected_ops": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_no_acting_change": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_no_purge_strays": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_op_order": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_shutdown": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_trim_objects": "false", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_snaps": "false", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_keys": "1024", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_stride": "524288", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_default_notify_timeout": "30", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep": "0.000000", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_discard_disconnected_ops": "true", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_enable_op_tracker": "true", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_info": "true", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_shutdown": "true", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_function_tracing": "false", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_grace": "20", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_interval": "6", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_min_peers": "10", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_min_size": "2000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_stale": "600", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_hit_set_max_size": "100000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_hit_set_min_size": "1000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_journal_size": "5120", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_kill_backfill_at": "0", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_cache_size": "50", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_dedup": "true", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_message_max": "40", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_share_max_epochs": "40", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_attr_name_len": "100", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_attr_size": "0", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_backfills": "1", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_markdown_count": "5", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_markdown_period": "600", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_object_name_len": "2048", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_object_namespace_len": "256", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_object_size": "134217728", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pg_blocked_by": "16", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pg_log_entries": "10000", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pgls": "1024", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_push_cost": "8388608", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_push_objects": "10", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_scrubs": "3", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_trimming_pgs": "2", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_write_op_reply_len": "64", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_write_size": "90", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_profile": "balanced", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_base": "805306368", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_cache_min": "134217728", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_target": "4294967296", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_target_autotune": "false", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_min_pg_log_entries": "250", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_min_recovery_priority": "0", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_report_interval": "5", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_num_cache_shards": "32", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_num_op_tracker_shard": "32", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_numa_auto_affinity": "true", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_numa_node": "-1", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_numa_prefer_iface": "true", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objecter_finishers": "1", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objectstore": "bluestore", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objectstore_fuse": "false", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objectstore_tracing": "false", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_complaint_time": "30.000000", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_duration": "600", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_size": "20", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_slow_op_size": "20", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_log_threshold": "5", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_shards": "0", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_shards_hdd": "5", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_shards_ssd": "8", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_pq_min_cost": "65536", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_queue_cut_off": "high", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_thread_timeout": "15", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_open_classes_on_start": "true", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_os_flags": "0", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_peering_op_priority": "255", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_delete_cost": "1048576", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_delete_priority": "5", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_log_trim_max": "10000", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_log_trim_min": "100", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_crimson": "false", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flags": "0", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_min_size": "0", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_pg_num": "32", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_pgp_num": "0", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_read_ratio": "70", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_size": "2", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_type": "replicated", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_push_per_object_cost": "1000", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recover_clone_overlap": "true", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_cost": "20971520", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_active": "0", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_single_start": "1", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_op_priority": "3", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_priority": "5", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep": "0.000000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_repair_during_recovery": "false", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_requested_scrub_priority": "120", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_auto_repair": "false", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_begin_hour": "0", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_begin_week_day": "0", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_chunk_max": "25", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_chunk_min": "5", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_cost": "52428800", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_during_recovery": "false", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_end_hour": "0", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_end_week_day": "0", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_event_cost": "4096", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_invalid_stats": "true", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_max_preemptions": "5", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_priority": "5", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_sleep": "0.000000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_skip_data_digest": "false", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_smart_report_timeout": "5", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_cost": "1048576", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_priority": "5", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_target_transaction_size": "30", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tracing": "false", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_use_stale_snap": "false", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "osdc_blkin_trace_all": "false", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_kill_at": "0", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_max_join_drift": "10", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_min": "500", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_min_wait": "0.050000", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_propose_interval": "1.000000", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_service_trim_max": "500", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_service_trim_min": "250", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_stash_full_interval": "25", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_trim_max": "500", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_trim_min": "250", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "perf": "true", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "-", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrv": "", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "public_bind_addr": "-", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "public_network": "", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "public_network_interface": "", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "qat_compressor_enabled": "false", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "qat_compressor_session_max_number": "256", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rados_mon_op_timeout": "0", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rados_osd_op_timeout": "0", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rados_tracing": "false", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_atime_update_interval": "60", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_balance_parent_reads": "false", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_balance_snap_reads": "false", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_blkin_trace_all": "false", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache": "true", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_policy": "writearound", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_size": "33554432", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_clone_copy_on_read": "false", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_compression_hint": "none", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_concurrent_management_ops": "10", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_clone_format": "auto", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_data_pool": "", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_features": "61", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_format": "2", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_map_options": "", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_order": "22", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_pool": "rbd", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_stripe_count": "0", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_stripe_unit": "0", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_enable_alloc_hint": "true", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_io_scheduler": "simple", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_order": "24", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_pool": "", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_splay_width": "4", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_localize_parent_reads": "false", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_localize_snap_reads": "false", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mtime_update_interval": "60", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_non_blocking_aio": "true", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_op_thread_timeout": "60", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_op_threads": "1", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_parent_cache_enabled": "false", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_plugins": "", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_bps_burst": "0", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_bps_limit": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_exclude_ops": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_iops_burst": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_iops_limit": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_read_from_replica_policy": "default", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_skip_partial_discard": "true", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_tracing": "false", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_validate_names": "true", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_validate_pool": "true", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "restapi_base_url": "", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "restapi_log_level": "", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_acl_grants_max_num": "100", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_admin_entry": "admin", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_backend_store": "rados", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_barbican_url": "", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_beast_enable_async": "true", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_counters_cache": "false", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cache_enabled": "true", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cache_expiry_interval": "900", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cache_lru_size": "10000", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_config_store": "rados", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_content_length_compat": "false", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_copy_obj_progress": "true", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cors_rules_max_num": "100", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cross_domain_policy": "", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_addr": "", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_password": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_username": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_require_ssl": "true", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_addr": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_auth": "token", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_namespace": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_prefix": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_token_file": "", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_buffersize": "524288", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_low_speed_time": "300", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d4n_port": "6379", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_changes_size": "1000", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_num_shards": "128", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_window": "30", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dns_name": "", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dns_s3website_name": "", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dynamic_resharding": "true", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_gc_threads": "true", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_lc_threads": "true", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_ops_log": "false", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_quota_threads": "true", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_static_website": "false", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_usage_log": "false", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enforce_swift_acls": "true", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_exit_timeout_secs": "120", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_expose_bucket": "false", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_extended_http_attrs": "", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_filter": "none", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_frontends": "beast port=7480", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_deferred": "50", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_objs": "32", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_processor_period": "3600", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_init_timeout": "300", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_kafka_connection_idle": "300", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_domain": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_password": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_password_path": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_project": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_tenant": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_token": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_token_path": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_user": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_api_version": "2", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_domain": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_password": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_project": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_user": "", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_url": "", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_debug_interval": "-1", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_lock_max_time": "90", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_objs": "32", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_rules": "1000", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_worker": "3", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_thread_delay": "0", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_dnattr": "uid", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_searchfilter": "", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_uri": "", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_http_headers": "", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_object_name_utc": "false", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_attr_name_len": "0", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_attr_size": "0", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_chunk_size": "4194304", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_listing_results": "1000", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_notify_retries": "10", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_put_param_size": "1048576", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_put_size": "5368709120", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_slo_entries": "1000", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_md_log_max_shards": "64", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_mp_lock_max_time": "600", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_max_gc": "300", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_num_async_rados_threads": "32", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_num_control_oids": "8", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_numa_node": "-1", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_objexp_chunk_size": "100", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_objexp_gc_interval": "600", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_op_thread_timeout": "600", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_op_tracing": "false", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_opa_token": "", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_opa_url": "", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_opa_verify_ssl": "true", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_rados": "false", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_socket_path": "", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_push_interval": "2.000000", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_posix_cache_lanes": "3", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_posix_cache_partitions": "3", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_print_continue": "true", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rados_tracing": "false", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_realm": "", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_realm_id": "", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_region": "", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_request_uri": "", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_batch_size": "64", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_max_aio": "128", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_num_logs": "16", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_thread_interval": "600", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_resolve_cname": "false", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_run_sync_thread": "true", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_scheduler_type": "throttler", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_script_uri": "", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_service_provider_name": "", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_client_id": "", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_client_secret": "", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_entry": "sts", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_key": "sts", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_min_session_duration": "900", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_token_introspection_url": "", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_account_in_url": "false", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_auth_entry": "auth", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_auth_url": "", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_custom_header": "", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_need_stats": "true", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_tenant_name": "", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_token_expiration": "86400", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_url": "", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_url_prefix": "swift", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_lease_period": "120", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_thread_pool_size": "512", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_comment": "", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_createby": "", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_encoding": "", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_flag": "false", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_origin": "", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_tracker": "", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_trust_forwarded_https": "false", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_max_shards": "32", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_max_user_shards": "1", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_use_opa_authz": "false", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_counters_cache": "false", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_max_buckets": "1000", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_policies_max_num": "100", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_unique_email": "true", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_verify_ssl": "true", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zone": "", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zone_id": "", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zonegroup": "", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zonegroup_id": "", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgwlc_auto_session_clear": "true", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_block_size": "4096", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_size": "536870912", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_index_type": "binary_search", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_partition_filters": "false", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_perf": "false", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "run_dir": "/var/run/ceph", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_block_create": "true", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_cache_lru_size": "67108864", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_default_max_object_size": "16777216", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_device_size": "53687091200", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_batch_capacity": "16", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_main_device_type": "SSD", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_segment_size": "67108864", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "set_keepcaps": "false", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "setgroup": "", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "setuser": "", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "setuser_match_path": "", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "thp": "false", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi096.stdout: "threadpool_default_timeout": "60", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi096.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi096.stdout: "throttler_perf_counter": "true" 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:05:24.059 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-18T21:05:24.199 INFO:teuthology.orchestra.run.smithi096.stdout:mon.a: {} 2024-04-18T21:05:24.200 INFO:teuthology.orchestra.run.smithi096.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:05:24.208 INFO:teuthology.orchestra.run.smithi096.stdout:mon.b: {} 2024-04-18T21:05:24.208 INFO:teuthology.orchestra.run.smithi096.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:05:24.216 INFO:teuthology.orchestra.run.smithi096.stdout:mon.c: {} 2024-04-18T21:05:24.217 INFO:teuthology.orchestra.run.smithi096.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:05:24.232 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-18T21:05:24.232 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-18T21:05:24.256 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-18T21:05:24.256 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-18T21:05:24.256 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-18T21:05:24.257 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T21:05:24.257 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.257 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-18T21:05:24.257 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-18T21:05:24.257 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:24.257 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:24.258 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:05:24.258 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:05:24.258 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-18T21:05:24.258 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-18T21:05:24.259 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:24.259 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-18T21:05:24.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:24.260 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-18T21:05:24.260 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:05:24.262 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:24.258+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:24.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-18T21:05:24.318 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2024-04-18T21:05:24.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:05:24.319 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-18T21:05:24.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T21:05:24.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:24.360+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:24.391 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:24.392 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:24.392 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:24.392 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:24.398 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:24.398 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:24.406 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:24.418 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:24.439 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:24.439 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:24.461 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:24.460+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:24.528 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:24.528 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:24.541 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:24.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:24.564+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 18, 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:05:09.584166+0000", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5799936, 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "jewel", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [], 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:05:24.631 INFO:tasks.thrashosds.thrasher:j is {'epoch': 18, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:05:09.584166+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:05:24.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:24.663 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:24.664+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:24.666 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:24.666 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:24.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:24.690 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T21:05:24.708 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-18T21:05:24.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.709 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42322sec preferred_lft 42322sec 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 02:42:47:f5:7f:5c brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T21:05:24.715 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:24.716 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T21:05:24.716 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:24.716 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T21:05:24.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2024-04-18T21:05:24.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2024-04-18T21:05:24.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2024-04-18T21:05:24.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T21:05:24.716 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T21:05:24.759 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:05:24.765 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:24.762+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:24.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:24.813 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:24.813 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:24.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:24.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.823 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T21:05:24.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:24.866 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:24.868+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:24.876 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-04-18T21:05:24.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.877 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-04-18T21:05:24.920 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:24.922 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:24.935 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-18T21:05:24.762992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90044,"kb_used_data":648,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025476,"statfs":{"total":289910292480,"available":289818087424,"internally_reserved":0,"allocated":663552,"data_stored":1350892,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.156458"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598968+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:09.598968+0000","last_peered":"2024-04-18T21:05:09.598968+0000","last_clean":"2024-04-18T21:05:09.598968+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:09.598968+0000","last_undegraded":"2024-04-18T21:05:09.598968+0000","last_fullsized":"2024-04-18T21:05:09.598968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597992+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:09.597992+0000","last_peered":"2024-04-18T21:05:09.597992+0000","last_clean":"2024-04-18T21:05:09.597992+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:09.597992+0000","last_undegraded":"2024-04-18T21:05:09.597992+0000","last_fullsized":"2024-04-18T21:05:09.597992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598070+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:09.598070+0000","last_peered":"2024-04-18T21:05:09.598070+0000","last_clean":"2024-04-18T21:05:09.598070+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:09.598070+0000","last_undegraded":"2024-04-18T21:05:09.598070+0000","last_fullsized":"2024-04-18T21:05:09.598070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599912+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:09.599912+0000","last_peered":"2024-04-18T21:05:09.599912+0000","last_clean":"2024-04-18T21:05:09.599912+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:09.599912+0000","last_undegraded":"2024-04-18T21:05:09.599912+0000","last_fullsized":"2024-04-18T21:05:09.599912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598039+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:09.598039+0000","last_peered":"2024-04-18T21:05:09.598039+0000","last_clean":"2024-04-18T21:05:09.598039+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:09.598039+0000","last_undegraded":"2024-04-18T21:05:09.598039+0000","last_fullsized":"2024-04-18T21:05:09.598039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597637+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:09.597637+0000","last_peered":"2024-04-18T21:05:09.597637+0000","last_clean":"2024-04-18T21:05:09.597637+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:09.597637+0000","last_undegraded":"2024-04-18T21:05:09.597637+0000","last_fullsized":"2024-04-18T21:05:09.597637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598279+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:09.598279+0000","last_peered":"2024-04-18T21:05:09.598279+0000","last_clean":"2024-04-18T21:05:09.598279+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:09.598279+0000","last_undegraded":"2024-04-18T21:05:09.598279+0000","last_fullsized":"2024-04-18T21:05:09.598279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596977+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:09.596977+0000","last_peered":"2024-04-18T21:05:09.596977+0000","last_clean":"2024-04-18T21:05:09.596977+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:09.596977+0000","last_undegraded":"2024-04-18T21:05:09.596977+0000","last_fullsized":"2024-04-18T21:05:09.596977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598461+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:09.598461+0000","last_peered":"2024-04-18T21:05:09.598461+0000","last_clean":"2024-04-18T21:05:09.598461+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:09.598461+0000","last_undegraded":"2024-04-18T21:05:09.598461+0000","last_fullsized":"2024-04-18T21:05:09.598461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598421+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:09.598421+0000","last_peered":"2024-04-18T21:05:09.598421+0000","last_clean":"2024-04-18T21:05:09.598421+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:09.598421+0000","last_undegraded":"2024-04-18T21:05:09.598421+0000","last_fullsized":"2024-04-18T21:05:09.598421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598782+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:09.598782+0000","last_peered":"2024-04-18T21:05:09.598782+0000","last_clean":"2024-04-18T21:05:09.598782+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:09.598782+0000","last_undegraded":"2024-04-18T21:05:09.598782+0000","last_fullsized":"2024-04-18T21:05:09.598782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598444+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:09.598444+0000","last_peered":"2024-04-18T21:05:09.598444+0000","last_clean":"2024-04-18T21:05:09.598444+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:09.598444+0000","last_undegraded":"2024-04-18T21:05:09.598444+0000","last_fullsized":"2024-04-18T21:05:09.598444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597755+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:09.597755+0000","last_peered":"2024-04-18T21:05:09.597755+0000","last_clean":"2024-04-18T21:05:09.597755+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:09.597755+0000","last_undegraded":"2024-04-18T21:05:09.597755+0000","last_fullsized":"2024-04-18T21:05:09.597755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598086+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:09.598086+0000","last_peered":"2024-04-18T21:05:09.598086+0000","last_clean":"2024-04-18T21:05:09.598086+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:09.598086+0000","last_undegraded":"2024-04-18T21:05:09.598086+0000","last_fullsized":"2024-04-18T21:05:09.598086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597654+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:09.597654+0000","last_peered":"2024-04-18T21:05:09.597654+0000","last_clean":"2024-04-18T21:05:09.597654+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:09.597654+0000","last_undegraded":"2024-04-18T21:05:09.597654+0000","last_fullsized":"2024-04-18T21:05:09.597654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597079+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:09.597079+0000","last_peered":"2024-04-18T21:05:09.597079+0000","last_clean":"2024-04-18T21:05:09.597079+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:09.597079+0000","last_undegraded":"2024-04-18T21:05:09.597079+0000","last_fullsized":"2024-04-18T21:05:09.597079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599986+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:09.599986+0000","last_peered":"2024-04-18T21:05:09.599986+0000","last_clean":"2024-04-18T21:05:09.599986+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:09.599986+0000","last_undegraded":"2024-04-18T21:05:09.599986+0000","last_fullsized":"2024-04-18T21:05:09.599986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599139+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:09.599139+0000","last_peered":"2024-04-18T21:05:09.599139+0000","last_clean":"2024-04-18T21:05:09.599139+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:09.599139+0000","last_undegraded":"2024-04-18T21:05:09.599139+0000","last_fullsized":"2024-04-18T21:05:09.599139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598392+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:09.598392+0000","last_peered":"2024-04-18T21:05:09.598392+0000","last_clean":"2024-04-18T21:05:09.598392+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:09.598392+0000","last_undegraded":"2024-04-18T21:05:09.598392+0000","last_fullsized":"2024-04-18T21:05:09.598392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599335+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:09.599335+0000","last_peered":"2024-04-18T21:05:09.599335+0000","last_clean":"2024-04-18T21:05:09.599335+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:09.599335+0000","last_undegraded":"2024-04-18T21:05:09.599335+0000","last_fullsized":"2024-04-18T21:05:09.599335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599660+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:09.599660+0000","last_peered":"2024-04-18T21:05:09.599660+0000","last_clean":"2024-04-18T21:05:09.599660+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:09.599660+0000","last_undegraded":"2024-04-18T21:05:09.599660+0000","last_fullsized":"2024-04-18T21:05:09.599660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597324+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:09.597324+0000","last_peered":"2024-04-18T21:05:09.597324+0000","last_clean":"2024-04-18T21:05:09.597324+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:09.597324+0000","last_undegraded":"2024-04-18T21:05:09.597324+0000","last_fullsized":"2024-04-18T21:05:09.597324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597169+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:09.597169+0000","last_peered":"2024-04-18T21:05:09.597169+0000","last_clean":"2024-04-18T21:05:09.597169+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:09.597169+0000","last_undegraded":"2024-04-18T21:05:09.597169+0000","last_fullsized":"2024-04-18T21:05:09.597169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597772+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:09.597772+0000","last_peered":"2024-04-18T21:05:09.597772+0000","last_clean":"2024-04-18T21:05:09.597772+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:09.597772+0000","last_undegraded":"2024-04-18T21:05:09.597772+0000","last_fullsized":"2024-04-18T21:05:09.597772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598943+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:09.598943+0000","last_peered":"2024-04-18T21:05:09.598943+0000","last_clean":"2024-04-18T21:05:09.598943+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:09.598943+0000","last_undegraded":"2024-04-18T21:05:09.598943+0000","last_fullsized":"2024-04-18T21:05:09.598943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599108+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:09.599108+0000","last_peered":"2024-04-18T21:05:09.599108+0000","last_clean":"2024-04-18T21:05:09.599108+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:09.599108+0000","last_undegraded":"2024-04-18T21:05:09.599108+0000","last_fullsized":"2024-04-18T21:05:09.599108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599150+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:09.599150+0000","last_peered":"2024-04-18T21:05:09.599150+0000","last_clean":"2024-04-18T21:05:09.599150+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:09.599150+0000","last_undegraded":"2024-04-18T21:05:09.599150+0000","last_fullsized":"2024-04-18T21:05:09.599150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599471+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:09.599471+0000","last_peered":"2024-04-18T21:05:09.599471+0000","last_clean":"2024-04-18T21:05:09.599471+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:09.599471+0000","last_undegraded":"2024-04-18T21:05:09.599471+0000","last_fullsized":"2024-04-18T21:05:09.599471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598876+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:09.598876+0000","last_peered":"2024-04-18T21:05:09.598876+0000","last_clean":"2024-04-18T21:05:09.598876+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:09.598876+0000","last_undegraded":"2024-04-18T21:05:09.598876+0000","last_fullsized":"2024-04-18T21:05:09.598876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597939+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:09.597939+0000","last_peered":"2024-04-18T21:05:09.597939+0000","last_clean":"2024-04-18T21:05:09.597939+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:09.597939+0000","last_undegraded":"2024-04-18T21:05:09.597939+0000","last_fullsized":"2024-04-18T21:05:09.597939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597358+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:09.597358+0000","last_peered":"2024-04-18T21:05:09.597358+0000","last_clean":"2024-04-18T21:05:09.597358+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:09.597358+0000","last_undegraded":"2024-04-18T21:05:09.597358+0000","last_fullsized":"2024-04-18T21:05:09.597358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597398+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:09.597398+0000","last_peered":"2024-04-18T21:05:09.597398+0000","last_clean":"2024-04-18T21:05:09.597398+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:09.597398+0000","last_undegraded":"2024-04-18T21:05:09.597398+0000","last_fullsized":"2024-04-18T21:05:09.597398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598760+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:09.598760+0000","last_peered":"2024-04-18T21:05:09.598760+0000","last_clean":"2024-04-18T21:05:09.598760+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:09.598760+0000","last_undegraded":"2024-04-18T21:05:09.598760+0000","last_fullsized":"2024-04-18T21:05:09.598760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599367+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:09.599367+0000","last_peered":"2024-04-18T21:05:09.599367+0000","last_clean":"2024-04-18T21:05:09.599367+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:09.599367+0000","last_undegraded":"2024-04-18T21:05:09.599367+0000","last_fullsized":"2024-04-18T21:05:09.599367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599082+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:09.599082+0000","last_peered":"2024-04-18T21:05:09.599082+0000","last_clean":"2024-04-18T21:05:09.599082+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:09.599082+0000","last_undegraded":"2024-04-18T21:05:09.599082+0000","last_fullsized":"2024-04-18T21:05:09.599082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597915+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:09.597915+0000","last_peered":"2024-04-18T21:05:09.597915+0000","last_clean":"2024-04-18T21:05:09.597915+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:09.597915+0000","last_undegraded":"2024-04-18T21:05:09.597915+0000","last_fullsized":"2024-04-18T21:05:09.597915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600134+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:09.600134+0000","last_peered":"2024-04-18T21:05:09.600134+0000","last_clean":"2024-04-18T21:05:09.600134+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:09.600134+0000","last_undegraded":"2024-04-18T21:05:09.600134+0000","last_fullsized":"2024-04-18T21:05:09.600134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598229+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:09.598229+0000","last_peered":"2024-04-18T21:05:09.598229+0000","last_clean":"2024-04-18T21:05:09.598229+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:09.598229+0000","last_undegraded":"2024-04-18T21:05:09.598229+0000","last_fullsized":"2024-04-18T21:05:09.598229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598658+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:09.598658+0000","last_peered":"2024-04-18T21:05:09.598658+0000","last_clean":"2024-04-18T21:05:09.598658+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:09.598658+0000","last_undegraded":"2024-04-18T21:05:09.598658+0000","last_fullsized":"2024-04-18T21:05:09.598658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597388+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:09.597388+0000","last_peered":"2024-04-18T21:05:09.597388+0000","last_clean":"2024-04-18T21:05:09.597388+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:09.597388+0000","last_undegraded":"2024-04-18T21:05:09.597388+0000","last_fullsized":"2024-04-18T21:05:09.597388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596837+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:09.596837+0000","last_peered":"2024-04-18T21:05:09.596837+0000","last_clean":"2024-04-18T21:05:09.596837+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:09.596837+0000","last_undegraded":"2024-04-18T21:05:09.596837+0000","last_fullsized":"2024-04-18T21:05:09.596837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599636+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:09.599636+0000","last_peered":"2024-04-18T21:05:09.599636+0000","last_clean":"2024-04-18T21:05:09.599636+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:09.599636+0000","last_undegraded":"2024-04-18T21:05:09.599636+0000","last_fullsized":"2024-04-18T21:05:09.599636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.596976+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:09.596976+0000","last_peered":"2024-04-18T21:05:09.596976+0000","last_clean":"2024-04-18T21:05:09.596976+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:09.596976+0000","last_undegraded":"2024-04-18T21:05:09.596976+0000","last_fullsized":"2024-04-18T21:05:09.596976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599727+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:09.599727+0000","last_peered":"2024-04-18T21:05:09.599727+0000","last_clean":"2024-04-18T21:05:09.599727+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:09.599727+0000","last_undegraded":"2024-04-18T21:05:09.599727+0000","last_fullsized":"2024-04-18T21:05:09.599727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598512+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:09.598512+0000","last_peered":"2024-04-18T21:05:09.598512+0000","last_clean":"2024-04-18T21:05:09.598512+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:09.598512+0000","last_undegraded":"2024-04-18T21:05:09.598512+0000","last_fullsized":"2024-04-18T21:05:09.598512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600048+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:09.600048+0000","last_peered":"2024-04-18T21:05:09.600048+0000","last_clean":"2024-04-18T21:05:09.600048+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:09.600048+0000","last_undegraded":"2024-04-18T21:05:09.600048+0000","last_fullsized":"2024-04-18T21:05:09.600048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599364+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:09.599364+0000","last_peered":"2024-04-18T21:05:09.599364+0000","last_clean":"2024-04-18T21:05:09.599364+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:09.599364+0000","last_undegraded":"2024-04-18T21:05:09.599364+0000","last_fullsized":"2024-04-18T21:05:09.599364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599469+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:09.599469+0000","last_peered":"2024-04-18T21:05:09.599469+0000","last_clean":"2024-04-18T21:05:09.599469+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:09.599469+0000","last_undegraded":"2024-04-18T21:05:09.599469+0000","last_fullsized":"2024-04-18T21:05:09.599469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599735+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:09.599735+0000","last_peered":"2024-04-18T21:05:09.599735+0000","last_clean":"2024-04-18T21:05:09.599735+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:09.599735+0000","last_undegraded":"2024-04-18T21:05:09.599735+0000","last_fullsized":"2024-04-18T21:05:09.599735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599299+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:09.599299+0000","last_peered":"2024-04-18T21:05:09.599299+0000","last_clean":"2024-04-18T21:05:09.599299+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:09.599299+0000","last_undegraded":"2024-04-18T21:05:09.599299+0000","last_fullsized":"2024-04-18T21:05:09.599299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599447+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:09.599447+0000","last_peered":"2024-04-18T21:05:09.599447+0000","last_clean":"2024-04-18T21:05:09.599447+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:09.599447+0000","last_undegraded":"2024-04-18T21:05:09.599447+0000","last_fullsized":"2024-04-18T21:05:09.599447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598762+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:09.598762+0000","last_peered":"2024-04-18T21:05:09.598762+0000","last_clean":"2024-04-18T21:05:09.598762+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:09.598762+0000","last_undegraded":"2024-04-18T21:05:09.598762+0000","last_fullsized":"2024-04-18T21:05:09.598762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599000+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:09.599000+0000","last_peered":"2024-04-18T21:05:09.599000+0000","last_clean":"2024-04-18T21:05:09.599000+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:09.599000+0000","last_undegraded":"2024-04-18T21:05:09.599000+0000","last_fullsized":"2024-04-18T21:05:09.599000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598602+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:09.598602+0000","last_peered":"2024-04-18T21:05:09.598602+0000","last_clean":"2024-04-18T21:05:09.598602+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:09.598602+0000","last_undegraded":"2024-04-18T21:05:09.598602+0000","last_fullsized":"2024-04-18T21:05:09.598602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598948+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:09.598948+0000","last_peered":"2024-04-18T21:05:09.598948+0000","last_clean":"2024-04-18T21:05:09.598948+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:09.598948+0000","last_undegraded":"2024-04-18T21:05:09.598948+0000","last_fullsized":"2024-04-18T21:05:09.598948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597968+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:09.597968+0000","last_peered":"2024-04-18T21:05:09.597968+0000","last_clean":"2024-04-18T21:05:09.597968+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:09.597968+0000","last_undegraded":"2024-04-18T21:05:09.597968+0000","last_fullsized":"2024-04-18T21:05:09.597968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599722+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:09.599722+0000","last_peered":"2024-04-18T21:05:09.599722+0000","last_clean":"2024-04-18T21:05:09.599722+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:09.599722+0000","last_undegraded":"2024-04-18T21:05:09.599722+0000","last_fullsized":"2024-04-18T21:05:09.599722+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598414+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:09.598414+0000","last_peered":"2024-04-18T21:05:09.598414+0000","last_clean":"2024-04-18T21:05:09.598414+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:09.598414+0000","last_undegraded":"2024-04-18T21:05:09.598414+0000","last_fullsized":"2024-04-18T21:05:09.598414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599554+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:09.599554+0000","last_peered":"2024-04-18T21:05:09.599554+0000","last_clean":"2024-04-18T21:05:09.599554+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:09.599554+0000","last_undegraded":"2024-04-18T21:05:09.599554+0000","last_fullsized":"2024-04-18T21:05:09.599554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597870+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:09.597870+0000","last_peered":"2024-04-18T21:05:09.597870+0000","last_clean":"2024-04-18T21:05:09.597870+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:09.597870+0000","last_undegraded":"2024-04-18T21:05:09.597870+0000","last_fullsized":"2024-04-18T21:05:09.597870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597919+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:09.597919+0000","last_peered":"2024-04-18T21:05:09.597919+0000","last_clean":"2024-04-18T21:05:09.597919+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:09.597919+0000","last_undegraded":"2024-04-18T21:05:09.597919+0000","last_fullsized":"2024-04-18T21:05:09.597919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599217+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:09.599217+0000","last_peered":"2024-04-18T21:05:09.599217+0000","last_clean":"2024-04-18T21:05:09.599217+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:09.599217+0000","last_undegraded":"2024-04-18T21:05:09.599217+0000","last_fullsized":"2024-04-18T21:05:09.599217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598327+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:09.598327+0000","last_peered":"2024-04-18T21:05:09.598327+0000","last_clean":"2024-04-18T21:05:09.598327+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:09.598327+0000","last_undegraded":"2024-04-18T21:05:09.598327+0000","last_fullsized":"2024-04-18T21:05:09.598327+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598804+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:09.598804+0000","last_peered":"2024-04-18T21:05:09.598804+0000","last_clean":"2024-04-18T21:05:09.598804+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:09.598804+0000","last_undegraded":"2024-04-18T21:05:09.598804+0000","last_fullsized":"2024-04-18T21:05:09.598804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599075+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:09.599075+0000","last_peered":"2024-04-18T21:05:09.599075+0000","last_clean":"2024-04-18T21:05:09.599075+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:09.599075+0000","last_undegraded":"2024-04-18T21:05:09.599075+0000","last_fullsized":"2024-04-18T21:05:09.599075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599404+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:09.599404+0000","last_peered":"2024-04-18T21:05:09.599404+0000","last_clean":"2024-04-18T21:05:09.599404+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:09.599404+0000","last_undegraded":"2024-04-18T21:05:09.599404+0000","last_fullsized":"2024-04-18T21:05:09.599404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599639+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:09.599639+0000","last_peered":"2024-04-18T21:05:09.599639+0000","last_clean":"2024-04-18T21:05:09.599639+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:09.599639+0000","last_undegraded":"2024-04-18T21:05:09.599639+0000","last_fullsized":"2024-04-18T21:05:09.599639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600069+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:09.600069+0000","last_peered":"2024-04-18T21:05:09.600069+0000","last_clean":"2024-04-18T21:05:09.600069+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:09.600069+0000","last_undegraded":"2024-04-18T21:05:09.600069+0000","last_fullsized":"2024-04-18T21:05:09.600069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599802+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:09.599802+0000","last_peered":"2024-04-18T21:05:09.599802+0000","last_clean":"2024-04-18T21:05:09.599802+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:09.599802+0000","last_undegraded":"2024-04-18T21:05:09.599802+0000","last_fullsized":"2024-04-18T21:05:09.599802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600141+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:09.600141+0000","last_peered":"2024-04-18T21:05:09.600141+0000","last_clean":"2024-04-18T21:05:09.600141+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:09.600141+0000","last_undegraded":"2024-04-18T21:05:09.600141+0000","last_fullsized":"2024-04-18T21:05:09.600141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597468+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:09.597468+0000","last_peered":"2024-04-18T21:05:09.597468+0000","last_clean":"2024-04-18T21:05:09.597468+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:09.597468+0000","last_undegraded":"2024-04-18T21:05:09.597468+0000","last_fullsized":"2024-04-18T21:05:09.597468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600143+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:09.600143+0000","last_peered":"2024-04-18T21:05:09.600143+0000","last_clean":"2024-04-18T21:05:09.600143+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:09.600143+0000","last_undegraded":"2024-04-18T21:05:09.600143+0000","last_fullsized":"2024-04-18T21:05:09.600143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600066+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:09.600066+0000","last_peered":"2024-04-18T21:05:09.600066+0000","last_clean":"2024-04-18T21:05:09.600066+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:09.600066+0000","last_undegraded":"2024-04-18T21:05:09.600066+0000","last_fullsized":"2024-04-18T21:05:09.600066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597586+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:09.597586+0000","last_peered":"2024-04-18T21:05:09.597586+0000","last_clean":"2024-04-18T21:05:09.597586+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:09.597586+0000","last_undegraded":"2024-04-18T21:05:09.597586+0000","last_fullsized":"2024-04-18T21:05:09.597586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599991+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:09.599991+0000","last_peered":"2024-04-18T21:05:09.599991+0000","last_clean":"2024-04-18T21:05:09.599991+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:09.599991+0000","last_undegraded":"2024-04-18T21:05:09.599991+0000","last_fullsized":"2024-04-18T21:05:09.599991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600385+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:09.600385+0000","last_peered":"2024-04-18T21:05:09.600385+0000","last_clean":"2024-04-18T21:05:09.600385+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:09.600385+0000","last_undegraded":"2024-04-18T21:05:09.600385+0000","last_fullsized":"2024-04-18T21:05:09.600385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598019+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:09.598019+0000","last_peered":"2024-04-18T21:05:09.598019+0000","last_clean":"2024-04-18T21:05:09.598019+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:09.598019+0000","last_undegraded":"2024-04-18T21:05:09.598019+0000","last_fullsized":"2024-04-18T21:05:09.598019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600388+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:09.600388+0000","last_peered":"2024-04-18T21:05:09.600388+0000","last_clean":"2024-04-18T21:05:09.600388+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:09.600388+0000","last_undegraded":"2024-04-18T21:05:09.600388+0000","last_fullsized":"2024-04-18T21:05:09.600388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598973+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:09.598973+0000","last_peered":"2024-04-18T21:05:09.598973+0000","last_clean":"2024-04-18T21:05:09.598973+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:09.598973+0000","last_undegraded":"2024-04-18T21:05:09.598973+0000","last_fullsized":"2024-04-18T21:05:09.598973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597980+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:09.597980+0000","last_peered":"2024-04-18T21:05:09.597980+0000","last_clean":"2024-04-18T21:05:09.597980+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:09.597980+0000","last_undegraded":"2024-04-18T21:05:09.597980+0000","last_fullsized":"2024-04-18T21:05:09.597980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597890+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:09.597890+0000","last_peered":"2024-04-18T21:05:09.597890+0000","last_clean":"2024-04-18T21:05:09.597890+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:09.597890+0000","last_undegraded":"2024-04-18T21:05:09.597890+0000","last_fullsized":"2024-04-18T21:05:09.597890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600046+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:09.600046+0000","last_peered":"2024-04-18T21:05:09.600046+0000","last_clean":"2024-04-18T21:05:09.600046+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:09.600046+0000","last_undegraded":"2024-04-18T21:05:09.600046+0000","last_fullsized":"2024-04-18T21:05:09.600046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598801+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:09.598801+0000","last_peered":"2024-04-18T21:05:09.598801+0000","last_clean":"2024-04-18T21:05:09.598801+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:09.598801+0000","last_undegraded":"2024-04-18T21:05:09.598801+0000","last_fullsized":"2024-04-18T21:05:09.598801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599682+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:09.599682+0000","last_peered":"2024-04-18T21:05:09.599682+0000","last_clean":"2024-04-18T21:05:09.599682+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:09.599682+0000","last_undegraded":"2024-04-18T21:05:09.599682+0000","last_fullsized":"2024-04-18T21:05:09.599682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598593+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:09.598593+0000","last_peered":"2024-04-18T21:05:09.598593+0000","last_clean":"2024-04-18T21:05:09.598593+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:09.598593+0000","last_undegraded":"2024-04-18T21:05:09.598593+0000","last_fullsized":"2024-04-18T21:05:09.598593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597624+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:09.597624+0000","last_peered":"2024-04-18T21:05:09.597624+0000","last_clean":"2024-04-18T21:05:09.597624+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:09.597624+0000","last_undegraded":"2024-04-18T21:05:09.597624+0000","last_fullsized":"2024-04-18T21:05:09.597624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599784+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:09.599784+0000","last_peered":"2024-04-18T21:05:09.599784+0000","last_clean":"2024-04-18T21:05:09.599784+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:09.599784+0000","last_undegraded":"2024-04-18T21:05:09.599784+0000","last_fullsized":"2024-04-18T21:05:09.599784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597293+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:09.597293+0000","last_peered":"2024-04-18T21:05:09.597293+0000","last_clean":"2024-04-18T21:05:09.597293+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:09.597293+0000","last_undegraded":"2024-04-18T21:05:09.597293+0000","last_fullsized":"2024-04-18T21:05:09.597293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599648+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:09.599648+0000","last_peered":"2024-04-18T21:05:09.599648+0000","last_clean":"2024-04-18T21:05:09.599648+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:09.599648+0000","last_undegraded":"2024-04-18T21:05:09.599648+0000","last_fullsized":"2024-04-18T21:05:09.599648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598342+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:09.598342+0000","last_peered":"2024-04-18T21:05:09.598342+0000","last_clean":"2024-04-18T21:05:09.598342+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:09.598342+0000","last_undegraded":"2024-04-18T21:05:09.598342+0000","last_fullsized":"2024-04-18T21:05:09.598342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599489+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:09.599489+0000","last_peered":"2024-04-18T21:05:09.599489+0000","last_clean":"2024-04-18T21:05:09.599489+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:09.599489+0000","last_undegraded":"2024-04-18T21:05:09.599489+0000","last_fullsized":"2024-04-18T21:05:09.599489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598559+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:09.598559+0000","last_peered":"2024-04-18T21:05:09.598559+0000","last_clean":"2024-04-18T21:05:09.598559+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:09.598559+0000","last_undegraded":"2024-04-18T21:05:09.598559+0000","last_fullsized":"2024-04-18T21:05:09.598559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598371+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:09.598371+0000","last_peered":"2024-04-18T21:05:09.598371+0000","last_clean":"2024-04-18T21:05:09.598371+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:09.598371+0000","last_undegraded":"2024-04-18T21:05:09.598371+0000","last_fullsized":"2024-04-18T21:05:09.598371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598001+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:09.598001+0000","last_peered":"2024-04-18T21:05:09.598001+0000","last_clean":"2024-04-18T21:05:09.598001+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:09.598001+0000","last_undegraded":"2024-04-18T21:05:09.598001+0000","last_fullsized":"2024-04-18T21:05:09.598001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598312+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:09.598312+0000","last_peered":"2024-04-18T21:05:09.598312+0000","last_clean":"2024-04-18T21:05:09.598312+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:09.598312+0000","last_undegraded":"2024-04-18T21:05:09.598312+0000","last_fullsized":"2024-04-18T21:05:09.598312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.598393+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:09.598393+0000","last_peered":"2024-04-18T21:05:09.598393+0000","last_clean":"2024-04-18T21:05:09.598393+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:09.598393+0000","last_undegraded":"2024-04-18T21:05:09.598393+0000","last_fullsized":"2024-04-18T21:05:09.598393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599054+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:09.599054+0000","last_peered":"2024-04-18T21:05:09.599054+0000","last_clean":"2024-04-18T21:05:09.599054+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:09.599054+0000","last_undegraded":"2024-04-18T21:05:09.599054+0000","last_fullsized":"2024-04-18T21:05:09.599054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599890+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:09.599890+0000","last_peered":"2024-04-18T21:05:09.599890+0000","last_clean":"2024-04-18T21:05:09.599890+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:09.599890+0000","last_undegraded":"2024-04-18T21:05:09.599890+0000","last_fullsized":"2024-04-18T21:05:09.599890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599262+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:09.599262+0000","last_peered":"2024-04-18T21:05:09.599262+0000","last_clean":"2024-04-18T21:05:09.599262+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:09.599262+0000","last_undegraded":"2024-04-18T21:05:09.599262+0000","last_fullsized":"2024-04-18T21:05:09.599262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599155+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:09.599155+0000","last_peered":"2024-04-18T21:05:09.599155+0000","last_clean":"2024-04-18T21:05:09.599155+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:09.599155+0000","last_undegraded":"2024-04-18T21:05:09.599155+0000","last_fullsized":"2024-04-18T21:05:09.599155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599141+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:09.599141+0000","last_peered":"2024-04-18T21:05:09.599141+0000","last_clean":"2024-04-18T21:05:09.599141+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:09.599141+0000","last_undegraded":"2024-04-18T21:05:09.599141+0000","last_fullsized":"2024-04-18T21:05:09.599141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.600318+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:09.600318+0000","last_peered":"2024-04-18T21:05:09.600318+0000","last_clean":"2024-04-18T21:05:09.600318+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:09.600318+0000","last_undegraded":"2024-04-18T21:05:09.600318+0000","last_fullsized":"2024-04-18T21:05:09.600318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.597823+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:09.597823+0000","last_peered":"2024-04-18T21:05:09.597823+0000","last_clean":"2024-04-18T21:05:09.597823+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:09.597823+0000","last_undegraded":"2024-04-18T21:05:09.597823+0000","last_fullsized":"2024-04-18T21:05:09.597823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:09.599251+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:09.599251+0000","last_peered":"2024-04-18T21:05:09.599251+0000","last_clean":"2024-04-18T21:05:09.599251+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:09.599251+0000","last_undegraded":"2024-04-18T21:05:09.599251+0000","last_fullsized":"2024-04-18T21:05:09.599251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":647274,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":647890,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:24.939 INFO:tasks.thrashosds.thrasher:Setting 4.17 to [2, 1, 0] 2024-04-18T21:05:24.939 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.17', '2', '1', '0'] 2024-04-18T21:05:24.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.17 2 1 0 2024-04-18T21:05:24.951 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:24.951 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:24.952 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T21:05:24.953 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T21:05:24.954 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:24.954 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T21:05:24.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T21:05:24.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T21:05:24.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T21:05:24.954 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T21:05:24.966 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:24.967 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:24.968+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:25.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:25.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:25.057 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-18T21:05:25.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:25.068+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:25.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:25.104 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-04-18T21:05:25.152 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:25.152 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T21:05:25.152 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:25.152 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-18T21:05:25.152 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T21:05:25.168 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:25.168+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:25.236 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:25.236 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:25.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:25.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:25.253 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-18T21:05:25.253 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T21:05:25.275 INFO:teuthology.orchestra.run.smithi096.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-18T21:05:25.280 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:25.280 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-18T21:05:25.291 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:25.292+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:25.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:25.363 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:25.363 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T21:05:25.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-04-18T21:05:25.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T21:05:25.363 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T21:05:25.371 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:25.372+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:25.411 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:25.411 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:25.425 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:25.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:25.456 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-18T21:05:25.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T21:05:25.456 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:25.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:25.472+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:25.508 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-18T21:05:25.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T21:05:25.508 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:25.556 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-04-18T21:05:25.573 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:25.574+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:25.590 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:25.590 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:25.604 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:25.613 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/run/lock 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/fs/nfsd 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysusers.service 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/run/rpc_pipefs 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:25.664 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-04-18T21:05:25.674 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:25.676+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:25.712 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T21:05:25.712 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:25.751 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:25.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-04-18T21:05:25.770 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T21:05:25.775 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:25.776+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/run/lock 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-04-18T21:05:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/fs/nfsd 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysusers.service 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/run/rpc_pipefs 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:25.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:25.819 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-04-18T21:05:25.845 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:2024-04-18T21:05:25.843+0000 7f3c3a607580 -1 init, newargv = 0x55e6b7c022c0 newargc=15 2024-04-18T21:05:25.845 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[22872]: starting ceph client 2024-04-18T21:05:25.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[22872]: starting fuse 2024-04-18T21:05:25.871 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:25.871 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:25.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:25.876+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:25.885 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:25.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:25.976+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:26.006 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.006 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:26.078 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:26.078+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:26.154 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.154 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:26.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:26.216+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:26.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:26.280+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:26.289 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.289 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.303 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:26.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:26.396+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:26.455 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:26.470 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.470 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.481 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:26.482+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:26.486 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:26.582 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:26.582+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:26.610 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:26.616 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.616 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:26.630 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:26.630 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:26.648 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:26.648 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:26.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:26.684+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:26.752 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:26.752 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:26.752 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:26.753 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:26.753 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:26.767 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:26.780 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:05:26.783 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:26.782+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:26.884 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:26.884+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:26.891 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292784444999999, 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292663443999999, 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292590529999998, 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292521016999999, 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292486095000001, 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292441115999999, 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292375745000001, 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292326356, 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.292272146999998, 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.280494582999999, 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.280259386000001, 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.279792969999999, 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.279533783000002, 2024-04-18T21:05:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.279376227, 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.279291699000002, 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.278975645999999, 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.277009143000001, 2024-04-18T21:05:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.276894391999999, 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:26.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.274897465999999, 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.274191098999999, 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:26.976 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:26.980 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:26.981 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-04-18T21:05:26.982 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:26.994 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T21:05:27.023 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:27.024+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:27.040 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/run/lock 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-04-18T21:05:27.041 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/fs/nfsd 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysusers.service 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/run/rpc_pipefs 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:27.042 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:27.043 INFO:teuthology.orchestra.run.smithi096.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:27.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:27.043 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-04-18T21:05:27.085 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:27.084+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:27.088 INFO:teuthology.orchestra.run.smithi096.stdout:45 2024-04-18T21:05:27.088 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> import re 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> import os 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2024-04-18T21:05:27.089 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> return f 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2024-04-18T21:05:27.090 DEBUG:teuthology.orchestra.run.smithi096:> ' 2024-04-18T21:05:27.116 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:27.116 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:27.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:27.116 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:27.132 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:27.185 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:27.186+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:27.207 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.22872.asok 2024-04-18T21:05:27.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T21:05:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:27.218 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22872.asok 2024-04-18T21:05:27.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:27.218 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22872.asok status 2024-04-18T21:05:27.254 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:27.254 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:27.254 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:27.254 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:27.254 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:27.268 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:27.309 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:27.310+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "5be49cd9e6fca1ff6a05f2473aa3b399da760600", 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 19.0.0-3141-g5be49cd9 (5be49cd9e6fca1ff6a05f2473aa3b399da760600) squid (dev)", 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "22872", 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2024-04-18T21:05:27.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4707, 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4707 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2808124644 2024-04-18T21:05:27.374 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2808124644 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4707 192.168.0.1:0/2808124644", 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/2808124644", 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 5, 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 19, 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2024-04-18T21:05:27.375 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:05:27.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:27.387 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2024-04-18T21:05:27.387 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:27.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:27.388+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:27.394 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2024-04-18T21:05:27.394 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:27.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:27.394 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:27.433 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:27.433 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:27.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:27.433 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.305090138000001, 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.434 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:27.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.439 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.305056566000001, 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:27.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:27.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.305024303, 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:27.445 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:27.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:27.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.304908751999999, 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:27.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.456 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.837474827000001, 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:27.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:27.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.837361702999999, 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:27.462 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:27.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:27.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.837282621, 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:27.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:27.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:27.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.837179417000002, 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.473 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:27.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:27.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.837089644999999, 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:27.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:27.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.837003607, 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.484 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:27.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:27.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836939522000002, 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:27.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836853924, 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836787731000001, 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.500 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.505 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836718352999998, 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836555650000001, 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836404686000002, 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.516 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:27.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:27.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836355177000002, 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836289915000002, 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:27.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:27.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:27.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.836155734999998, 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:27.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:27.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.83605227, 2024-04-18T21:05:27.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:27.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:27.541 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:27.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:27.544 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:27.544+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:27.555 INFO:teuthology.run_tasks:Running task workunit... 2024-04-18T21:05:27.570 INFO:tasks.workunit:Pulling workunits from ref c46a99d99fa3e2dad10a5ce96141fec909e651df 2024-04-18T21:05:27.570 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-18T21:05:27.570 INFO:tasks.workunit:timeout=3h 2024-04-18T21:05:27.570 INFO:tasks.workunit:cleanup=True 2024-04-18T21:05:27.570 DEBUG:teuthology.orchestra.run.smithi096:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:27.601 INFO:teuthology.orchestra.run.smithi096.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:27.601 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-18T21:05:27.602 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-18T21:05:27.602 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:05:27.602 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-18T21:05:27.602 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 21:05:08.587567272 +0000 2024-04-18T21:05:27.602 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 21:05:27.556597605 +0000 2024-04-18T21:05:27.602 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T21:05:27.602 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:27.602 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-18T21:05:27.643 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:27.644+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:27.670 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c46a99d99fa3e2dad10a5ce96141fec909e651df 2024-04-18T21:05:27.676 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:27.676 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:27.677 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:27.677 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:27.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:27.719 INFO:tasks.workunit.client.0.smithi096.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-18T21:05:27.744 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:27.742+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:27.781 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:05:27.814 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:27.815 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:27.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:27.845 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:27.846+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.353749072999999, 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.353648066000002, 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.353547093, 2024-04-18T21:05:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.352863086999999, 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.35277331, 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.352627310999999, 2024-04-18T21:05:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.352532709999998, 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.352427767000002, 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.352352816, 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.345018755000002, 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.340870702, 2024-04-18T21:05:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.340762066, 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.340628336000002, 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.340483336999998, 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.33258081, 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.332325258000001, 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.332269416999999, 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.622688+0000", 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.325960327000001, 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00054014999999999998, 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622688+0000", 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622688+0000", 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622689+0000", 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2600000000000001e-07 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622697+0000", 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6699999999999994e-06 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622716+0000", 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622731+0000", 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5670000000000001e-05 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623025+0000", 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029397700000000001 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623043+0000", 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7986e-05 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623228+0000", 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018496800000000001 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.357942140999999, 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:28.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:28.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.355410764999998, 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:28.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.034 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:28.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:28.035 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:28.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:27.948+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:28.036 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:28.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:28.080+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:28.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:28.148+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:28.166 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:28.166 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:28.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:28.249 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:28.248+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:28.303 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:28.303 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:28.303 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:28.303 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:28.303 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:28.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:28.350 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:28.350+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:28.451 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:28.450+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.886039074999999, 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885918073999999, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885845159999999, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885775646999999, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885740725000002, 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885695746, 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885630375000002, 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885580986000001, 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.885526776999999, 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:28.529 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.873749213, 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:28.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:28.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.532 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.873514016000001, 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:28.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:28.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:28.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.8730476, 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.872788412999999, 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.872630857000001, 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.872546328999999, 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.872230276, 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.870263773000001, 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.557 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:28.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.870149022, 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:28.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.868152095999999, 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.565 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:28.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.867445729, 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:28.569 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:28.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:28.573 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:28.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:28.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:28.576+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:28.664 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:28.675 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:28.674+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:28.707 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:28.707 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:28.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:28.776 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:28.776+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:28.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:28.839 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:28.839 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:28.860 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:28.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:28.876+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:28.885 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:28.885 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:28.900 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:28.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:28.976+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:29.020 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:29.020 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:29.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:29.077 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:29.078+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:29.166 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:29.166 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:29.178 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:29.180+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:29.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:29.279 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:29.280+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:29.304 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:29.304 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:29.319 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:29.380 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:29.380+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:29.441 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:29.441 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:29.455 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:29.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:29.480+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:29.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:29.584+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:29.588 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:29.588 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:29.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:29.683 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:29.684+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:29.726 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:29.726 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:29.740 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:29.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:29.784+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:29.803 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:05:29.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:29.884+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:29.911 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:29.911 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:29.926 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:29.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:29.984+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:30.060 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.060 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.075 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:30.121 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:30.122+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:30.186 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:30.186+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:30.195 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.196 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:30.281 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:30.281 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:30.281 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-18T21:05:30.281 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-18T21:05:30.297 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:30.298+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:30.372 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.372 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:30.387 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:30.388+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:30.443 INFO:teuthology.orchestra.run.smithi096.stderr:no valid command found; 10 closest matches: 2024-04-18T21:05:30.443 INFO:teuthology.orchestra.run.smithi096.stderr:0 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:1 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:2 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:abort 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:assert 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:bench [] [] [] [] 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs files list 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs stats 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:bluestore allocator dump block 2024-04-18T21:05:30.444 INFO:teuthology.orchestra.run.smithi096.stderr:Error EINVAL: invalid command 2024-04-18T21:05:30.446 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:30.446 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:05:30.446 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-18T21:05:30.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:30.488+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:30.588 INFO:teuthology.orchestra.run.smithi096.stderr:no valid command found; 10 closest matches: 2024-04-18T21:05:30.588 INFO:teuthology.orchestra.run.smithi096.stderr:0 2024-04-18T21:05:30.588 INFO:teuthology.orchestra.run.smithi096.stderr:1 2024-04-18T21:05:30.588 INFO:teuthology.orchestra.run.smithi096.stderr:2 2024-04-18T21:05:30.588 INFO:teuthology.orchestra.run.smithi096.stderr:abort 2024-04-18T21:05:30.588 INFO:teuthology.orchestra.run.smithi096.stderr:assert 2024-04-18T21:05:30.589 INFO:teuthology.orchestra.run.smithi096.stderr:bench [] [] [] [] 2024-04-18T21:05:30.589 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:05:30.589 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs files list 2024-04-18T21:05:30.589 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs stats 2024-04-18T21:05:30.589 INFO:teuthology.orchestra.run.smithi096.stderr:bluestore allocator dump block 2024-04-18T21:05:30.589 INFO:teuthology.orchestra.run.smithi096.stderr:Error EINVAL: invalid command 2024-04-18T21:05:30.591 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:30.591 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:05:30.591 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-18T21:05:30.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:30.620+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:30.690 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:30.690+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:30.698 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.698 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.714 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:no valid command found; 10 closest matches: 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:0 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:1 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:2 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:abort 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:assert 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:bench [] [] [] [] 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs files list 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:bluefs stats 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:bluestore allocator dump block 2024-04-18T21:05:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:Error EINVAL: invalid command 2024-04-18T21:05:30.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:30.739 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:05:30.791 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:30.792+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:30.793 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:05:30.878 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:30.883 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.883 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.892 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:30.892+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:30.898 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:30.993 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:30.992+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:31.027 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:31.031 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.031 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.046 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:31.048 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:31.049 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:31.069 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:31.069 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:31.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:31.096+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:31.195 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:31.194+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:31.207 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:31.207 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:31.207 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:31.207 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:31.207 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:31.221 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:31.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:31.296+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750952629, 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:31.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:31.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:31.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750831628, 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750758714, 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.359 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:31.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:31.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:31.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750689201, 2024-04-18T21:05:31.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750654278999999, 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.369 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:31.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:31.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750609300000001, 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.374 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:31.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:31.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750543928999999, 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.379 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:31.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:31.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750494539999998, 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:31.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.750440331, 2024-04-18T21:05:31.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:31.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:31.390 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.738662767000001, 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:31.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.738427569999999, 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:31.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.737961154000001, 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:31.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:31.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.737701967, 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:31.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:31.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.737544411000002, 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:31.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.737459883, 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.737143830000001, 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.735177326999999, 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.421 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.735062576000001, 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:31.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:31.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.73306565, 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:31.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.732359283000001, 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:31.429 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:31.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:31.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:31.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:31.433 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:31.434 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:31.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:31.436+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:31.536 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:31.534+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:31.564 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:31.564 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:31.564 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:31.564 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:31.580 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:31.636 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:31.636+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:31.737 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:31.736+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:31.747 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:31.747 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:31.747 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:31.747 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:31.747 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:31.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:31.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:31.840+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:31.885 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:31.885 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:31.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.755450234999998, 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.886 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.755416662999998, 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:31.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.755384399999997, 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:31.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 33.755268848999997, 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:31.901 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:31.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:31.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.906 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287834923999998, 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.2877218, 2024-04-18T21:05:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287642718000001, 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287539513999999, 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:31.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287449742, 2024-04-18T21:05:31.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287363704000001, 2024-04-18T21:05:31.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:31.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287299618999999, 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:31.936 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:31.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287214021, 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:31.941 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287147827999998, 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.287078449999999, 2024-04-18T21:05:31.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:31.956 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.286915746999998, 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:31.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:31.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:31.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.286764782999999, 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:31.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:31.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.286715273999999, 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:31.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.286650011999999, 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:31.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.286515831999999, 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.981 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.286412367000001, 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:31.985 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:31.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:31.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:31.988+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:32.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:32.088+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:32.119 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:32.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:32.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:32.224+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:32.289 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:32.288+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:32.299 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:32.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:32.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:32.404+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:32.486 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:32.486 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:32.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:32.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:32.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.889082702, 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:32.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.888981694999998, 2024-04-18T21:05:32.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:32.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:32.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:32.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.888880722, 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:32.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.888196715999999, 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:32.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.888106939, 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:32.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:32.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:32.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.887960939999999, 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:32.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:32.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.887866338999999, 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.887761395999998, 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:32.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:32.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.887686445, 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:32.523 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.880352383999998, 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:32.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.876204331, 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:32.530 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:32.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.876095695, 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:32.534 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:32.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.875961964999998, 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:32.538 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:32.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:32.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.875816965999999, 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:32.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:32.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.867914439, 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.546 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.867658887000001, 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.867603045999999, 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.893275769999999, 2024-04-18T21:05:32.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:32.561 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.890744393999999, 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:32.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:32.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8884099330000002, 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:32.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:32.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:32.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:32.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:32.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:32.570 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:32.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:32.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:32.572+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:32.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:32.672+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:32.704 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:32.704 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:32.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:32.773 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:32.770+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:32.815 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:32.853 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:32.899 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:32.900+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:32.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:32.976+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:32.978 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:32.978 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:32.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:32.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:32.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.978 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.380361242999999, 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:32.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.380240241999999, 2024-04-18T21:05:32.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.380167327999999, 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.380097814999999, 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.380062893000002, 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:32.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:32.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:33.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:33.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.380017914, 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.003 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:33.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:33.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:33.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.379952543000002, 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.008 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:33.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:33.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:33.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:33.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.379903154000001, 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.013 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.379848944999999, 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:33.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:33.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.368071381, 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.367836184000002, 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.024 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:33.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.367369768, 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.028 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:33.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:33.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:33.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.367110580999999, 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.366953025000001, 2024-04-18T21:05:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.040 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.366868496999999, 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:33.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:33.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:33.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:33.044 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.366552444, 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:33.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.364585941000001, 2024-04-18T21:05:33.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:33.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.36447119, 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:33.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:33.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:33.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.362474263999999, 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:33.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:33.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.361767897, 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:33.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:33.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:33.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:33.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:33.066 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:33.067 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:33.087 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:33.113 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:33.114+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:33.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:33.176+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:33.199 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:33.199 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:33.199 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:33.213 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:33.239 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:33.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:33.277 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:33.276+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:33.283 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:33.284 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:33.378 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:33.380+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:33.394 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:33.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:33.480+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:33.512 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:33.512 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:33.526 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:33.580 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:33.580+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:33.659 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:33.659 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:33.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:33.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:33.724+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:33.781 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:33.780+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:33.795 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:33.795 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:33.811 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:33.811 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:05:33.882 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:33.882+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:33.977 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:33.977 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:33.983 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:33.982+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:33.992 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:34.083 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:34.084+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:34.124 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.124 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.138 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:34.227 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:34.228+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:34.284 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:34.284+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:34.303 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.303 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:34.386 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:34.386+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:34.488+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:34.495 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:34.588 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:34.586+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:34.628 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.628 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.642 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:34.729 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:34.730+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:34.790 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:34.792+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:34.806 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.806 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.821 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:34.891 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:34.892+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:34.986 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.987 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.992 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:34.990+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:35.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:35.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:35.092+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:35.136 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.136 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:35.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:35.196+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:35.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:35.296+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:35.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:35.318 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.318 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:35.396 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:35.396+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:35.461 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:35.461 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:35.479 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:35.497 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:35.498+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:35.501 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:35.505 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.910941429000001, 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.910840422, 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.910739449000001, 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.910055443000001, 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.909965666000002, 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.909819667000001, 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.909725066, 2024-04-18T21:05:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.909620123, 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.909545172000001, 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.902211111, 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.898063057999998, 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.897954422000002, 2024-04-18T21:05:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.897820692, 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.897675693, 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.889773166000001, 2024-04-18T21:05:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.889517613999999, 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.889461773000001, 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 25.915134497, 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 25.912603121, 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.9102686599999998, 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:35.593 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:35.643 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:35.644+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:35.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:35.700+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:35.726 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:35.726 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:35.726 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:35.726 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:35.739 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:35.739 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:35.740 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:35.741 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:35.827 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:35.828+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:35.836 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:05:35.900 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:35.900+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:35.905 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:35.905 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:35.905 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:35.906 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:35.906 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:35.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:36.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:36.004+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:36.058 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:36.079 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-18T21:05:35.613096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":253,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90084,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025436,"statfs":{"total":289910292480,"available":289818046464,"internally_reserved":0,"allocated":720896,"data_stored":1382708,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.832042"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786322+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:27.786322+0000","last_peered":"2024-04-18T21:05:27.786322+0000","last_clean":"2024-04-18T21:05:27.786322+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:27.786322+0000","last_undegraded":"2024-04-18T21:05:27.786322+0000","last_fullsized":"2024-04-18T21:05:27.786322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785582+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:27.785582+0000","last_peered":"2024-04-18T21:05:27.785582+0000","last_clean":"2024-04-18T21:05:27.785582+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:27.785582+0000","last_undegraded":"2024-04-18T21:05:27.785582+0000","last_fullsized":"2024-04-18T21:05:27.785582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786438+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:27.786438+0000","last_peered":"2024-04-18T21:05:27.786438+0000","last_clean":"2024-04-18T21:05:27.786438+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:27.786438+0000","last_undegraded":"2024-04-18T21:05:27.786438+0000","last_fullsized":"2024-04-18T21:05:27.786438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785940+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:27.785940+0000","last_peered":"2024-04-18T21:05:27.785940+0000","last_clean":"2024-04-18T21:05:27.785940+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:27.785940+0000","last_undegraded":"2024-04-18T21:05:27.785940+0000","last_fullsized":"2024-04-18T21:05:27.785940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784990+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:27.784990+0000","last_peered":"2024-04-18T21:05:27.784990+0000","last_clean":"2024-04-18T21:05:27.784990+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:27.784990+0000","last_undegraded":"2024-04-18T21:05:27.784990+0000","last_fullsized":"2024-04-18T21:05:27.784990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785208+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:27.785208+0000","last_peered":"2024-04-18T21:05:27.785208+0000","last_clean":"2024-04-18T21:05:27.785208+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:27.785208+0000","last_undegraded":"2024-04-18T21:05:27.785208+0000","last_fullsized":"2024-04-18T21:05:27.785208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785303+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:27.785303+0000","last_peered":"2024-04-18T21:05:27.785303+0000","last_clean":"2024-04-18T21:05:27.785303+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:27.785303+0000","last_undegraded":"2024-04-18T21:05:27.785303+0000","last_fullsized":"2024-04-18T21:05:27.785303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784688+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:27.784688+0000","last_peered":"2024-04-18T21:05:27.784688+0000","last_clean":"2024-04-18T21:05:27.784688+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:27.784688+0000","last_undegraded":"2024-04-18T21:05:27.784688+0000","last_fullsized":"2024-04-18T21:05:27.784688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786108+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:27.786108+0000","last_peered":"2024-04-18T21:05:27.786108+0000","last_clean":"2024-04-18T21:05:27.786108+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:27.786108+0000","last_undegraded":"2024-04-18T21:05:27.786108+0000","last_fullsized":"2024-04-18T21:05:27.786108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785719+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:27.785719+0000","last_peered":"2024-04-18T21:05:27.785719+0000","last_clean":"2024-04-18T21:05:27.785719+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:27.785719+0000","last_undegraded":"2024-04-18T21:05:27.785719+0000","last_fullsized":"2024-04-18T21:05:27.785719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786568+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:27.786568+0000","last_peered":"2024-04-18T21:05:27.786568+0000","last_clean":"2024-04-18T21:05:27.786568+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:27.786568+0000","last_undegraded":"2024-04-18T21:05:27.786568+0000","last_fullsized":"2024-04-18T21:05:27.786568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785032+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:27.785032+0000","last_peered":"2024-04-18T21:05:27.785032+0000","last_clean":"2024-04-18T21:05:27.785032+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:27.785032+0000","last_undegraded":"2024-04-18T21:05:27.785032+0000","last_fullsized":"2024-04-18T21:05:27.785032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784441+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:27.784441+0000","last_peered":"2024-04-18T21:05:27.784441+0000","last_clean":"2024-04-18T21:05:27.784441+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:27.784441+0000","last_undegraded":"2024-04-18T21:05:27.784441+0000","last_fullsized":"2024-04-18T21:05:27.784441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785482+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:27.785482+0000","last_peered":"2024-04-18T21:05:27.785482+0000","last_clean":"2024-04-18T21:05:27.785482+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:27.785482+0000","last_undegraded":"2024-04-18T21:05:27.785482+0000","last_fullsized":"2024-04-18T21:05:27.785482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785504+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:27.785504+0000","last_peered":"2024-04-18T21:05:27.785504+0000","last_clean":"2024-04-18T21:05:27.785504+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:27.785504+0000","last_undegraded":"2024-04-18T21:05:27.785504+0000","last_fullsized":"2024-04-18T21:05:27.785504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784818+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:27.784818+0000","last_peered":"2024-04-18T21:05:27.784818+0000","last_clean":"2024-04-18T21:05:27.784818+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:27.784818+0000","last_undegraded":"2024-04-18T21:05:27.784818+0000","last_fullsized":"2024-04-18T21:05:27.784818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786622+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:27.786622+0000","last_peered":"2024-04-18T21:05:27.786622+0000","last_clean":"2024-04-18T21:05:27.786622+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:27.786622+0000","last_undegraded":"2024-04-18T21:05:27.786622+0000","last_fullsized":"2024-04-18T21:05:27.786622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785894+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:27.785894+0000","last_peered":"2024-04-18T21:05:27.785894+0000","last_clean":"2024-04-18T21:05:27.785894+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:27.785894+0000","last_undegraded":"2024-04-18T21:05:27.785894+0000","last_fullsized":"2024-04-18T21:05:27.785894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785732+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:27.785732+0000","last_peered":"2024-04-18T21:05:27.785732+0000","last_clean":"2024-04-18T21:05:27.785732+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:27.785732+0000","last_undegraded":"2024-04-18T21:05:27.785732+0000","last_fullsized":"2024-04-18T21:05:27.785732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785865+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:27.785865+0000","last_peered":"2024-04-18T21:05:27.785865+0000","last_clean":"2024-04-18T21:05:27.785865+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:27.785865+0000","last_undegraded":"2024-04-18T21:05:27.785865+0000","last_fullsized":"2024-04-18T21:05:27.785865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786192+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:27.786192+0000","last_peered":"2024-04-18T21:05:27.786192+0000","last_clean":"2024-04-18T21:05:27.786192+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:27.786192+0000","last_undegraded":"2024-04-18T21:05:27.786192+0000","last_fullsized":"2024-04-18T21:05:27.786192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784161+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:27.784161+0000","last_peered":"2024-04-18T21:05:27.784161+0000","last_clean":"2024-04-18T21:05:27.784161+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:27.784161+0000","last_undegraded":"2024-04-18T21:05:27.784161+0000","last_fullsized":"2024-04-18T21:05:27.784161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784137+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:27.784137+0000","last_peered":"2024-04-18T21:05:27.784137+0000","last_clean":"2024-04-18T21:05:27.784137+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:27.784137+0000","last_undegraded":"2024-04-18T21:05:27.784137+0000","last_fullsized":"2024-04-18T21:05:27.784137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784128+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:27.784128+0000","last_peered":"2024-04-18T21:05:27.784128+0000","last_clean":"2024-04-18T21:05:27.784128+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:27.784128+0000","last_undegraded":"2024-04-18T21:05:27.784128+0000","last_fullsized":"2024-04-18T21:05:27.784128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786323+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:27.786323+0000","last_peered":"2024-04-18T21:05:27.786323+0000","last_clean":"2024-04-18T21:05:27.786323+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:27.786323+0000","last_undegraded":"2024-04-18T21:05:27.786323+0000","last_fullsized":"2024-04-18T21:05:27.786323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785975+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:27.785975+0000","last_peered":"2024-04-18T21:05:27.785975+0000","last_clean":"2024-04-18T21:05:27.785975+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:27.785975+0000","last_undegraded":"2024-04-18T21:05:27.785975+0000","last_fullsized":"2024-04-18T21:05:27.785975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786749+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:27.786749+0000","last_peered":"2024-04-18T21:05:27.786749+0000","last_clean":"2024-04-18T21:05:27.786749+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:27.786749+0000","last_undegraded":"2024-04-18T21:05:27.786749+0000","last_fullsized":"2024-04-18T21:05:27.786749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785584+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:27.785584+0000","last_peered":"2024-04-18T21:05:27.785584+0000","last_clean":"2024-04-18T21:05:27.785584+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:27.785584+0000","last_undegraded":"2024-04-18T21:05:27.785584+0000","last_fullsized":"2024-04-18T21:05:27.785584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785113+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:27.785113+0000","last_peered":"2024-04-18T21:05:27.785113+0000","last_clean":"2024-04-18T21:05:27.785113+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:27.785113+0000","last_undegraded":"2024-04-18T21:05:27.785113+0000","last_fullsized":"2024-04-18T21:05:27.785113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784501+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:27.784501+0000","last_peered":"2024-04-18T21:05:27.784501+0000","last_clean":"2024-04-18T21:05:27.784501+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:27.784501+0000","last_undegraded":"2024-04-18T21:05:27.784501+0000","last_fullsized":"2024-04-18T21:05:27.784501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784220+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:27.784220+0000","last_peered":"2024-04-18T21:05:27.784220+0000","last_clean":"2024-04-18T21:05:27.784220+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:27.784220+0000","last_undegraded":"2024-04-18T21:05:27.784220+0000","last_fullsized":"2024-04-18T21:05:27.784220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784972+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:27.784972+0000","last_peered":"2024-04-18T21:05:27.784972+0000","last_clean":"2024-04-18T21:05:27.784972+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:27.784972+0000","last_undegraded":"2024-04-18T21:05:27.784972+0000","last_fullsized":"2024-04-18T21:05:27.784972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785289+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:27.785289+0000","last_peered":"2024-04-18T21:05:27.785289+0000","last_clean":"2024-04-18T21:05:27.785289+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:27.785289+0000","last_undegraded":"2024-04-18T21:05:27.785289+0000","last_fullsized":"2024-04-18T21:05:27.785289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786294+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:27.786294+0000","last_peered":"2024-04-18T21:05:27.786294+0000","last_clean":"2024-04-18T21:05:27.786294+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:27.786294+0000","last_undegraded":"2024-04-18T21:05:27.786294+0000","last_fullsized":"2024-04-18T21:05:27.786294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785572+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:27.785572+0000","last_peered":"2024-04-18T21:05:27.785572+0000","last_clean":"2024-04-18T21:05:27.785572+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:27.785572+0000","last_undegraded":"2024-04-18T21:05:27.785572+0000","last_fullsized":"2024-04-18T21:05:27.785572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784716+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:27.784716+0000","last_peered":"2024-04-18T21:05:27.784716+0000","last_clean":"2024-04-18T21:05:27.784716+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:27.784716+0000","last_undegraded":"2024-04-18T21:05:27.784716+0000","last_fullsized":"2024-04-18T21:05:27.784716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786273+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:27.786273+0000","last_peered":"2024-04-18T21:05:27.786273+0000","last_clean":"2024-04-18T21:05:27.786273+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:27.786273+0000","last_undegraded":"2024-04-18T21:05:27.786273+0000","last_fullsized":"2024-04-18T21:05:27.786273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784435+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:27.784435+0000","last_peered":"2024-04-18T21:05:27.784435+0000","last_clean":"2024-04-18T21:05:27.784435+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:27.784435+0000","last_undegraded":"2024-04-18T21:05:27.784435+0000","last_fullsized":"2024-04-18T21:05:27.784435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786170+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:27.786170+0000","last_peered":"2024-04-18T21:05:27.786170+0000","last_clean":"2024-04-18T21:05:27.786170+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:27.786170+0000","last_undegraded":"2024-04-18T21:05:27.786170+0000","last_fullsized":"2024-04-18T21:05:27.786170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785143+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:27.785143+0000","last_peered":"2024-04-18T21:05:27.785143+0000","last_clean":"2024-04-18T21:05:27.785143+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:27.785143+0000","last_undegraded":"2024-04-18T21:05:27.785143+0000","last_fullsized":"2024-04-18T21:05:27.785143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786373+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:27.786373+0000","last_peered":"2024-04-18T21:05:27.786373+0000","last_clean":"2024-04-18T21:05:27.786373+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:27.786373+0000","last_undegraded":"2024-04-18T21:05:27.786373+0000","last_fullsized":"2024-04-18T21:05:27.786373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784128+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:27.784128+0000","last_peered":"2024-04-18T21:05:27.784128+0000","last_clean":"2024-04-18T21:05:27.784128+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:27.784128+0000","last_undegraded":"2024-04-18T21:05:27.784128+0000","last_fullsized":"2024-04-18T21:05:27.784128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786201+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:27.786201+0000","last_peered":"2024-04-18T21:05:27.786201+0000","last_clean":"2024-04-18T21:05:27.786201+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:27.786201+0000","last_undegraded":"2024-04-18T21:05:27.786201+0000","last_fullsized":"2024-04-18T21:05:27.786201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784168+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:27.784168+0000","last_peered":"2024-04-18T21:05:27.784168+0000","last_clean":"2024-04-18T21:05:27.784168+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:27.784168+0000","last_undegraded":"2024-04-18T21:05:27.784168+0000","last_fullsized":"2024-04-18T21:05:27.784168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.787240+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:27.787240+0000","last_peered":"2024-04-18T21:05:27.787240+0000","last_clean":"2024-04-18T21:05:27.787240+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:27.787240+0000","last_undegraded":"2024-04-18T21:05:27.787240+0000","last_fullsized":"2024-04-18T21:05:27.787240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785839+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:27.785839+0000","last_peered":"2024-04-18T21:05:27.785839+0000","last_clean":"2024-04-18T21:05:27.785839+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:27.785839+0000","last_undegraded":"2024-04-18T21:05:27.785839+0000","last_fullsized":"2024-04-18T21:05:27.785839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.787157+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:27.787157+0000","last_peered":"2024-04-18T21:05:27.787157+0000","last_clean":"2024-04-18T21:05:27.787157+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:27.787157+0000","last_undegraded":"2024-04-18T21:05:27.787157+0000","last_fullsized":"2024-04-18T21:05:27.787157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785236+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:27.785236+0000","last_peered":"2024-04-18T21:05:27.785236+0000","last_clean":"2024-04-18T21:05:27.785236+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:27.785236+0000","last_undegraded":"2024-04-18T21:05:27.785236+0000","last_fullsized":"2024-04-18T21:05:27.785236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785488+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:27.785488+0000","last_peered":"2024-04-18T21:05:27.785488+0000","last_clean":"2024-04-18T21:05:27.785488+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:27.785488+0000","last_undegraded":"2024-04-18T21:05:27.785488+0000","last_fullsized":"2024-04-18T21:05:27.785488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786775+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:27.786775+0000","last_peered":"2024-04-18T21:05:27.786775+0000","last_clean":"2024-04-18T21:05:27.786775+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:27.786775+0000","last_undegraded":"2024-04-18T21:05:27.786775+0000","last_fullsized":"2024-04-18T21:05:27.786775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786167+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:27.786167+0000","last_peered":"2024-04-18T21:05:27.786167+0000","last_clean":"2024-04-18T21:05:27.786167+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:27.786167+0000","last_undegraded":"2024-04-18T21:05:27.786167+0000","last_fullsized":"2024-04-18T21:05:27.786167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.787062+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:27.787062+0000","last_peered":"2024-04-18T21:05:27.787062+0000","last_clean":"2024-04-18T21:05:27.787062+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:27.787062+0000","last_undegraded":"2024-04-18T21:05:27.787062+0000","last_fullsized":"2024-04-18T21:05:27.787062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784495+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:27.784495+0000","last_peered":"2024-04-18T21:05:27.784495+0000","last_clean":"2024-04-18T21:05:27.784495+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:27.784495+0000","last_undegraded":"2024-04-18T21:05:27.784495+0000","last_fullsized":"2024-04-18T21:05:27.784495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786341+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:27.786341+0000","last_peered":"2024-04-18T21:05:27.786341+0000","last_clean":"2024-04-18T21:05:27.786341+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:27.786341+0000","last_undegraded":"2024-04-18T21:05:27.786341+0000","last_fullsized":"2024-04-18T21:05:27.786341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784422+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:27.784422+0000","last_peered":"2024-04-18T21:05:27.784422+0000","last_clean":"2024-04-18T21:05:27.784422+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:27.784422+0000","last_undegraded":"2024-04-18T21:05:27.784422+0000","last_fullsized":"2024-04-18T21:05:27.784422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786228+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:27.786228+0000","last_peered":"2024-04-18T21:05:27.786228+0000","last_clean":"2024-04-18T21:05:27.786228+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:27.786228+0000","last_undegraded":"2024-04-18T21:05:27.786228+0000","last_fullsized":"2024-04-18T21:05:27.786228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785491+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:27.785491+0000","last_peered":"2024-04-18T21:05:27.785491+0000","last_clean":"2024-04-18T21:05:27.785491+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:27.785491+0000","last_undegraded":"2024-04-18T21:05:27.785491+0000","last_fullsized":"2024-04-18T21:05:27.785491+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786885+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:27.786885+0000","last_peered":"2024-04-18T21:05:27.786885+0000","last_clean":"2024-04-18T21:05:27.786885+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:27.786885+0000","last_undegraded":"2024-04-18T21:05:27.786885+0000","last_fullsized":"2024-04-18T21:05:27.786885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784858+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:27.784858+0000","last_peered":"2024-04-18T21:05:27.784858+0000","last_clean":"2024-04-18T21:05:27.784858+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:27.784858+0000","last_undegraded":"2024-04-18T21:05:27.784858+0000","last_fullsized":"2024-04-18T21:05:27.784858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.787073+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:27.787073+0000","last_peered":"2024-04-18T21:05:27.787073+0000","last_clean":"2024-04-18T21:05:27.787073+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:27.787073+0000","last_undegraded":"2024-04-18T21:05:27.787073+0000","last_fullsized":"2024-04-18T21:05:27.787073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785586+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:27.785586+0000","last_peered":"2024-04-18T21:05:27.785586+0000","last_clean":"2024-04-18T21:05:27.785586+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:27.785586+0000","last_undegraded":"2024-04-18T21:05:27.785586+0000","last_fullsized":"2024-04-18T21:05:27.785586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784697+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:27.784697+0000","last_peered":"2024-04-18T21:05:27.784697+0000","last_clean":"2024-04-18T21:05:27.784697+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:27.784697+0000","last_undegraded":"2024-04-18T21:05:27.784697+0000","last_fullsized":"2024-04-18T21:05:27.784697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786197+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:27.786197+0000","last_peered":"2024-04-18T21:05:27.786197+0000","last_clean":"2024-04-18T21:05:27.786197+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:27.786197+0000","last_undegraded":"2024-04-18T21:05:27.786197+0000","last_fullsized":"2024-04-18T21:05:27.786197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785014+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:27.785014+0000","last_peered":"2024-04-18T21:05:27.785014+0000","last_clean":"2024-04-18T21:05:27.785014+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:27.785014+0000","last_undegraded":"2024-04-18T21:05:27.785014+0000","last_fullsized":"2024-04-18T21:05:27.785014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784732+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:27.784732+0000","last_peered":"2024-04-18T21:05:27.784732+0000","last_clean":"2024-04-18T21:05:27.784732+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:27.784732+0000","last_undegraded":"2024-04-18T21:05:27.784732+0000","last_fullsized":"2024-04-18T21:05:27.784732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786350+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:27.786350+0000","last_peered":"2024-04-18T21:05:27.786350+0000","last_clean":"2024-04-18T21:05:27.786350+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:27.786350+0000","last_undegraded":"2024-04-18T21:05:27.786350+0000","last_fullsized":"2024-04-18T21:05:27.786350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786523+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:27.786523+0000","last_peered":"2024-04-18T21:05:27.786523+0000","last_clean":"2024-04-18T21:05:27.786523+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:27.786523+0000","last_undegraded":"2024-04-18T21:05:27.786523+0000","last_fullsized":"2024-04-18T21:05:27.786523+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786627+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:27.786627+0000","last_peered":"2024-04-18T21:05:27.786627+0000","last_clean":"2024-04-18T21:05:27.786627+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:27.786627+0000","last_undegraded":"2024-04-18T21:05:27.786627+0000","last_fullsized":"2024-04-18T21:05:27.786627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785756+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:27.785756+0000","last_peered":"2024-04-18T21:05:27.785756+0000","last_clean":"2024-04-18T21:05:27.785756+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:27.785756+0000","last_undegraded":"2024-04-18T21:05:27.785756+0000","last_fullsized":"2024-04-18T21:05:27.785756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.787327+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:27.787327+0000","last_peered":"2024-04-18T21:05:27.787327+0000","last_clean":"2024-04-18T21:05:27.787327+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:27.787327+0000","last_undegraded":"2024-04-18T21:05:27.787327+0000","last_fullsized":"2024-04-18T21:05:27.787327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785629+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:27.785629+0000","last_peered":"2024-04-18T21:05:27.785629+0000","last_clean":"2024-04-18T21:05:27.785629+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:27.785629+0000","last_undegraded":"2024-04-18T21:05:27.785629+0000","last_fullsized":"2024-04-18T21:05:27.785629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784353+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:27.784353+0000","last_peered":"2024-04-18T21:05:27.784353+0000","last_clean":"2024-04-18T21:05:27.784353+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:27.784353+0000","last_undegraded":"2024-04-18T21:05:27.784353+0000","last_fullsized":"2024-04-18T21:05:27.784353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785534+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:27.785534+0000","last_peered":"2024-04-18T21:05:27.785534+0000","last_clean":"2024-04-18T21:05:27.785534+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:27.785534+0000","last_undegraded":"2024-04-18T21:05:27.785534+0000","last_fullsized":"2024-04-18T21:05:27.785534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786160+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:27.786160+0000","last_peered":"2024-04-18T21:05:27.786160+0000","last_clean":"2024-04-18T21:05:27.786160+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:27.786160+0000","last_undegraded":"2024-04-18T21:05:27.786160+0000","last_fullsized":"2024-04-18T21:05:27.786160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784503+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:27.784503+0000","last_peered":"2024-04-18T21:05:27.784503+0000","last_clean":"2024-04-18T21:05:27.784503+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:27.784503+0000","last_undegraded":"2024-04-18T21:05:27.784503+0000","last_fullsized":"2024-04-18T21:05:27.784503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786691+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:27.786691+0000","last_peered":"2024-04-18T21:05:27.786691+0000","last_clean":"2024-04-18T21:05:27.786691+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:27.786691+0000","last_undegraded":"2024-04-18T21:05:27.786691+0000","last_fullsized":"2024-04-18T21:05:27.786691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786515+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:27.786515+0000","last_peered":"2024-04-18T21:05:27.786515+0000","last_clean":"2024-04-18T21:05:27.786515+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:27.786515+0000","last_undegraded":"2024-04-18T21:05:27.786515+0000","last_fullsized":"2024-04-18T21:05:27.786515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784353+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:27.784353+0000","last_peered":"2024-04-18T21:05:27.784353+0000","last_clean":"2024-04-18T21:05:27.784353+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:27.784353+0000","last_undegraded":"2024-04-18T21:05:27.784353+0000","last_fullsized":"2024-04-18T21:05:27.784353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'2","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786444+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:27.786444+0000","last_peered":"2024-04-18T21:05:27.786444+0000","last_clean":"2024-04-18T21:05:27.786444+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:27.786444+0000","last_undegraded":"2024-04-18T21:05:27.786444+0000","last_fullsized":"2024-04-18T21:05:27.786444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786443+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:27.786443+0000","last_peered":"2024-04-18T21:05:27.786443+0000","last_clean":"2024-04-18T21:05:27.786443+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:27.786443+0000","last_undegraded":"2024-04-18T21:05:27.786443+0000","last_fullsized":"2024-04-18T21:05:27.786443+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784224+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:27.784224+0000","last_peered":"2024-04-18T21:05:27.784224+0000","last_clean":"2024-04-18T21:05:27.784224+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:27.784224+0000","last_undegraded":"2024-04-18T21:05:27.784224+0000","last_fullsized":"2024-04-18T21:05:27.784224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785851+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:27.785851+0000","last_peered":"2024-04-18T21:05:27.785851+0000","last_clean":"2024-04-18T21:05:27.785851+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:27.785851+0000","last_undegraded":"2024-04-18T21:05:27.785851+0000","last_fullsized":"2024-04-18T21:05:27.785851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"19'9","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.787075+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:27.787075+0000","last_peered":"2024-04-18T21:05:27.787075+0000","last_clean":"2024-04-18T21:05:27.787075+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:27.787075+0000","last_undegraded":"2024-04-18T21:05:27.787075+0000","last_fullsized":"2024-04-18T21:05:27.787075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784427+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:27.784427+0000","last_peered":"2024-04-18T21:05:27.784427+0000","last_clean":"2024-04-18T21:05:27.784427+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:27.784427+0000","last_undegraded":"2024-04-18T21:05:27.784427+0000","last_fullsized":"2024-04-18T21:05:27.784427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785943+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:27.785943+0000","last_peered":"2024-04-18T21:05:27.785943+0000","last_clean":"2024-04-18T21:05:27.785943+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:27.785943+0000","last_undegraded":"2024-04-18T21:05:27.785943+0000","last_fullsized":"2024-04-18T21:05:27.785943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786892+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:27.786892+0000","last_peered":"2024-04-18T21:05:27.786892+0000","last_clean":"2024-04-18T21:05:27.786892+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:27.786892+0000","last_undegraded":"2024-04-18T21:05:27.786892+0000","last_fullsized":"2024-04-18T21:05:27.786892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784415+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:27.784415+0000","last_peered":"2024-04-18T21:05:27.784415+0000","last_clean":"2024-04-18T21:05:27.784415+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:27.784415+0000","last_undegraded":"2024-04-18T21:05:27.784415+0000","last_fullsized":"2024-04-18T21:05:27.784415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786523+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:27.786523+0000","last_peered":"2024-04-18T21:05:27.786523+0000","last_clean":"2024-04-18T21:05:27.786523+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:27.786523+0000","last_undegraded":"2024-04-18T21:05:27.786523+0000","last_fullsized":"2024-04-18T21:05:27.786523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784241+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:27.784241+0000","last_peered":"2024-04-18T21:05:27.784241+0000","last_clean":"2024-04-18T21:05:27.784241+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:27.784241+0000","last_undegraded":"2024-04-18T21:05:27.784241+0000","last_fullsized":"2024-04-18T21:05:27.784241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786597+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:27.786597+0000","last_peered":"2024-04-18T21:05:27.786597+0000","last_clean":"2024-04-18T21:05:27.786597+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:27.786597+0000","last_undegraded":"2024-04-18T21:05:27.786597+0000","last_fullsized":"2024-04-18T21:05:27.786597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784651+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:27.784651+0000","last_peered":"2024-04-18T21:05:27.784651+0000","last_clean":"2024-04-18T21:05:27.784651+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:27.784651+0000","last_undegraded":"2024-04-18T21:05:27.784651+0000","last_fullsized":"2024-04-18T21:05:27.784651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786044+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:27.786044+0000","last_peered":"2024-04-18T21:05:27.786044+0000","last_clean":"2024-04-18T21:05:27.786044+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:27.786044+0000","last_undegraded":"2024-04-18T21:05:27.786044+0000","last_fullsized":"2024-04-18T21:05:27.786044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784682+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:27.784682+0000","last_peered":"2024-04-18T21:05:27.784682+0000","last_clean":"2024-04-18T21:05:27.784682+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:27.784682+0000","last_undegraded":"2024-04-18T21:05:27.784682+0000","last_fullsized":"2024-04-18T21:05:27.784682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785371+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:27.785371+0000","last_peered":"2024-04-18T21:05:27.785371+0000","last_clean":"2024-04-18T21:05:27.785371+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:27.785371+0000","last_undegraded":"2024-04-18T21:05:27.785371+0000","last_fullsized":"2024-04-18T21:05:27.785371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784985+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:27.784985+0000","last_peered":"2024-04-18T21:05:27.784985+0000","last_clean":"2024-04-18T21:05:27.784985+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:27.784985+0000","last_undegraded":"2024-04-18T21:05:27.784985+0000","last_fullsized":"2024-04-18T21:05:27.784985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785138+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:27.785138+0000","last_peered":"2024-04-18T21:05:27.785138+0000","last_clean":"2024-04-18T21:05:27.785138+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:27.785138+0000","last_undegraded":"2024-04-18T21:05:27.785138+0000","last_fullsized":"2024-04-18T21:05:27.785138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785042+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:27.785042+0000","last_peered":"2024-04-18T21:05:27.785042+0000","last_clean":"2024-04-18T21:05:27.785042+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:27.785042+0000","last_undegraded":"2024-04-18T21:05:27.785042+0000","last_fullsized":"2024-04-18T21:05:27.785042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785557+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:27.785557+0000","last_peered":"2024-04-18T21:05:27.785557+0000","last_clean":"2024-04-18T21:05:27.785557+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:27.785557+0000","last_undegraded":"2024-04-18T21:05:27.785557+0000","last_fullsized":"2024-04-18T21:05:27.785557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786973+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:27.786973+0000","last_peered":"2024-04-18T21:05:27.786973+0000","last_clean":"2024-04-18T21:05:27.786973+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:27.786973+0000","last_undegraded":"2024-04-18T21:05:27.786973+0000","last_fullsized":"2024-04-18T21:05:27.786973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786237+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:27.786237+0000","last_peered":"2024-04-18T21:05:27.786237+0000","last_clean":"2024-04-18T21:05:27.786237+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:27.786237+0000","last_undegraded":"2024-04-18T21:05:27.786237+0000","last_fullsized":"2024-04-18T21:05:27.786237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785640+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:27.785640+0000","last_peered":"2024-04-18T21:05:27.785640+0000","last_clean":"2024-04-18T21:05:27.785640+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:27.785640+0000","last_undegraded":"2024-04-18T21:05:27.785640+0000","last_fullsized":"2024-04-18T21:05:27.785640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.784704+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:27.784704+0000","last_peered":"2024-04-18T21:05:27.784704+0000","last_clean":"2024-04-18T21:05:27.784704+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:27.784704+0000","last_undegraded":"2024-04-18T21:05:27.784704+0000","last_fullsized":"2024-04-18T21:05:27.784704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786175+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:27.786175+0000","last_peered":"2024-04-18T21:05:27.786175+0000","last_clean":"2024-04-18T21:05:27.786175+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:27.786175+0000","last_undegraded":"2024-04-18T21:05:27.786175+0000","last_fullsized":"2024-04-18T21:05:27.786175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.785221+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:27.785221+0000","last_peered":"2024-04-18T21:05:27.785221+0000","last_clean":"2024-04-18T21:05:27.785221+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:27.785221+0000","last_undegraded":"2024-04-18T21:05:27.785221+0000","last_fullsized":"2024-04-18T21:05:27.785221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T21:05:27.786430+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:27.786430+0000","last_peered":"2024-04-18T21:05:27.786430+0000","last_clean":"2024-04-18T21:05:27.786430+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:27.786430+0000","last_undegraded":"2024-04-18T21:05:27.786430+0000","last_fullsized":"2024-04-18T21:05:27.786430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5682,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":658970,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":64152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":659586,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:36.087 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:36.087 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:36.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:36.087 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:36.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.087 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.489301804, 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.489180803, 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:36.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:36.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.489107889, 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:36.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.489038376, 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:36.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:36.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.489003453999999, 2024-04-18T21:05:36.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:36.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:36.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:36.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.488958475, 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:36.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:36.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.488893103999999, 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.118 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.488843715000002, 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.123 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:36.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:36.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:36.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.488789506, 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:36.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:36.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.477011942000001, 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.476776744999999, 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.134 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:36.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:36.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.476310329, 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.138 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:36.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.476051141999999, 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:36.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:36.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.475893586000002, 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:36.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.475809057999999, 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.475493005000001, 2024-04-18T21:05:36.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:36.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.473526501999999, 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.473411751, 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:36.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:36.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:36.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.471414825, 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.168 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.470708458000001, 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:36.172 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:36.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:36.176 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:36.177 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:36.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:36.180+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:36.279 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:36.280+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:36.309 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:36.309 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:36.309 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:36.309 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:36.323 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:36.379 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:36.378+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:36.444 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:36.445 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:36.445 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:36.445 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:36.445 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:36.460 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:36.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:36.480+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:36.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:36.584+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:36.629 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:36.629 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:36.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:36.629 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:36.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.501190473000001, 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:36.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:36.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:36.635 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.501156901000002, 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:36.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:36.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:36.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:36.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.501124638, 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:36.641 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:36.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:36.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:36.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.646 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 38.501009087, 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.647 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:36.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:36.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:36.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.033575162000002, 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.652 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:36.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:36.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.657 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.033462038, 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.033382956000001, 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.033279751999999, 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.672 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.03318998, 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:36.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:36.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:36.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.033103942, 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.033039856999999, 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.683 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:36.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:36.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:36.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032954259, 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:36.688 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032888066000002, 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.693 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:36.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:36.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:36.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032818687999999, 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:36.698 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:36.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:36.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.703 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032655985000002, 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032505020999999, 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.709 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:36.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:36.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.714 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032455511999999, 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:36.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:36.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:36.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032390249999999, 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:36.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:36.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:36.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:36.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032256069999999, 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.032152605, 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:36.730 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:36.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:36.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.733 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:36.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:36.734 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:36.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:36.736 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:36.734+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:36.832 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:05:36.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:36.836+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:36.866 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:36.866 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:36.866 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:36.866 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:36.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:36.937 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:36.936+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:37.038 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:37.036+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:37.044 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:37.044 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:37.044 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:37.044 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:37.044 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:37.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:37.139 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:37.138+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:37.185 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.590844393000001, 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.590743386, 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.590642413000001, 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.589958407000001, 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.589868630000002, 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.589722631000001, 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.58962803, 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.589523087, 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.589448136000001, 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.582114075, 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.577966021999998, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.577857386000002, 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.577723656, 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.577578657, 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.569676130000001, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.569420577999999, 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.569364737000001, 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.595037461, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.592506085, 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5901716239999999, 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:37.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:37.278 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:37.276+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:37.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:37.380+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:37.408 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:37.409 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:37.409 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:37.409 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:37.423 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:37.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:37.480+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:37.539 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:37.539 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:37.539 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:37.539 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:37.539 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:37.553 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:37.580 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:37.582+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:37.594 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:37.672 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074492663000001, 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074371662000001, 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074298748, 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074229235000001, 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074194313, 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074149334000001, 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074083963, 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.074034573999999, 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.073980365000001, 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.062202801000002, 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.061967603999999, 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.061501188000001, 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.061242001, 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.061084444999999, 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.060999917, 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.060683864000001, 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.058717360999999, 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.058602610000001, 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.056605684000001, 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.055899317000002, 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:37.761 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:37.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:37.762 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:37.763 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:37.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:37.764+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:37.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:37.864+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:37.894 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:37.894 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:37.908 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:37.965 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:37.964+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:38.025 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:38.025 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:38.040 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:38.065 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:38.064+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:38.163 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:38.163 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:38.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:38.168+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:38.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:38.266 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:38.266+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:38.307 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:38.307 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:38.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:38.366 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:38.368+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:38.440 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:38.440 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:38.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:38.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:38.500+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:38.568 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:38.570+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:38.570 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:38.570 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:38.584 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:38.668 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:38.668+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:38.713 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:38.713 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:38.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:38.769 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:38.770+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:38.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:05:38.870 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:38.872+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:38.899 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:38.971 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:38.972+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.018 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:39.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:39.072+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:39.152 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.152 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.166 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:39.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:39.172+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:39.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:39.276+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:39.283 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.283 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.299 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:39.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:39.376+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:39.421 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.421 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:39.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:39.484+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:39.568 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.568 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:39.576+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:39.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:39.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:39.676+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:39.746 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.746 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.762 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:39.777 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:39.780+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:39.812 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:39.840 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:05:39.878 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:39.880+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:39.930 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.930 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.944 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:39.965 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:39.965 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:39.985 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:39.986 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:39.991 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:39.992+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:40.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:40.072 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:40.072 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:40.072 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:40.072 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:40.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:40.080+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:40.085 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:40.182 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:40.180+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:40.248 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:40.248 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:40.248 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:40.248 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:40.248 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:40.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:40.283 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:40.282+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:40.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:40.384+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.827167750000001, 2024-04-18T21:05:40.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:40.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.827046749000001, 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:40.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:40.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:40.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.826973835, 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.826904322000001, 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.8268694, 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.826824421000001, 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:40.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.82675905, 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:40.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:40.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.826709660999999, 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:40.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.826655452000001, 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:40.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.814877888000002, 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:40.468 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:40.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.814642691, 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:40.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.814176275000001, 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:40.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:40.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.813917088, 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:40.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:40.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.813759531999999, 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.484 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:40.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:40.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.813675004, 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.488 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:40.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.813358951000001, 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:40.492 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:40.496 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.811392447999999, 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.500 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.811277697000001, 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:40.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.504 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.809280771000001, 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:40.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.508 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.808574404000002, 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:40.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:40.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:40.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:40.513 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.513 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.513 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.513 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:40.513 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:40.513 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:40.514 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:40.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:40.516+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:40.615 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:40.616+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:40.646 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:40.646 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:40.646 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:40.646 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:40.660 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:40.716 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:40.716+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:40.784 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:40.784 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:40.784 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:40.784 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:40.784 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:40.798 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:40.816 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:40.816+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:40.918 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:40.920+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:40.923 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:40.923 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:40.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:40.923 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:40.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:40.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:40.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.792712244000001, 2024-04-18T21:05:40.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:40.924 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:40.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:40.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:40.925 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:40.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.926 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:40.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:40.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:40.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:40.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:40.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:40.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.933 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.792678672000001, 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:40.934 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:40.939 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.792646409, 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:40.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:40.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.792530857999999, 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.945 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.325096932999998, 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.955 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324983809000003, 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324904727000003, 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:40.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:40.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324801522999998, 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:40.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:40.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:40.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:40.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324711751000002, 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324625713000003, 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.976 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:40.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:40.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.981 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324561627999998, 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:40.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:40.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.986 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.32447603, 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:40.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:40.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:40.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:40.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324409836999997, 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:40.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:40.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:40.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:40.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324340458999998, 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324177755999997, 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.324026791999998, 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:41.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:41.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:41.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:41.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.323977282999998, 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:41.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.323912020999998, 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.323777841000002, 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:41.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:41.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.323674376, 2024-04-18T21:05:41.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:41.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:41.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:41.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:41.035 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:41.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:41.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:41.036+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:41.084 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:41.084 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:41.084 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:05:41.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:05:41.137 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:41.138+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:41.169 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:41.169 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:41.169 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:41.169 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:41.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:41.238 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:41.236+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:41.306 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:41.306 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:41.306 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:41.306 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:41.306 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:41.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:41.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:41.368+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:41.371 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:41.371 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:05:41.371 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 24, 2024-04-18T21:05:41.371 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:05:41.371 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:05:41.371 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:05:39.830838+0000", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5806080, 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "nodeep-scrub", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "noscrub", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:05:41.372 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "jewel", 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:05:41.373 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:05:41.374 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:41.375 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:41.376 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:41.377 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:41.378 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:05:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:05:41.380 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:41.381 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:41.382 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:41.383 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:41.384 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:05:41.385 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:05:41.386 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:41.387 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:41.388 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:41.389 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:41.390 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.391 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:41.392 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.393 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:41.394 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.395 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:05:41.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:41.397 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:41.398 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:05:41.399 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.400 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.401 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:41.402 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:41.403 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.404 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:05:41.405 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:05:41.407 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:41.408 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:41.409 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:05:41.410 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.512 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.512 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:05:41.512 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.512 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:05:41.513 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:05:41.514 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:05:41.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:41.516 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:05:41.517 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [], 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:05:41.518 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:05:41.519 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:05:41.520 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:05:41.520 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:05:41.520 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:41.520 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:05:41.522 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:41.520+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:41.523 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:05:39.830838+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:05:41.523 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.847593779, 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.847492772000003, 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.847391799, 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.846707793, 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.846618016000001, 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.846472016999996, 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.846377416000003, 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.846272472999999, 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.846197521999997, 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.838863461000003, 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.834715408000001, 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.834606772000001, 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.834473041999999, 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.834328042999999, 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.826425516, 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.826169964000002, 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.826114122999996, 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:41.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.851786847, 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:41.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.849255470999999, 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:41.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.846921009999999, 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:41.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:41.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:41.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:41.617 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:41.617 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:41.663 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:41.664+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:41.723 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:41.724+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:41.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:41.824 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:41.826+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:41.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:05:41.918 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:41.918 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:41.919 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:41.919 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:41.919 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:41.922 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:41.923 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:41.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:41.924+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:41.932 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:41.939 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-04-18T21:05:41.614878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90180,"kb_used_data":800,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025340,"statfs":{"total":289910292480,"available":289817948160,"internally_reserved":0,"allocated":819200,"data_stored":1436590,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.795493"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844644+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:39.844644+0000","last_peered":"2024-04-18T21:05:39.844644+0000","last_clean":"2024-04-18T21:05:39.844644+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:39.844644+0000","last_undegraded":"2024-04-18T21:05:39.844644+0000","last_fullsized":"2024-04-18T21:05:39.844644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843427+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:39.843427+0000","last_peered":"2024-04-18T21:05:39.843427+0000","last_clean":"2024-04-18T21:05:39.843427+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:39.843427+0000","last_undegraded":"2024-04-18T21:05:39.843427+0000","last_fullsized":"2024-04-18T21:05:39.843427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844154+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:39.844154+0000","last_peered":"2024-04-18T21:05:39.844154+0000","last_clean":"2024-04-18T21:05:39.844154+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:39.844154+0000","last_undegraded":"2024-04-18T21:05:39.844154+0000","last_fullsized":"2024-04-18T21:05:39.844154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843576+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:39.843576+0000","last_peered":"2024-04-18T21:05:39.843576+0000","last_clean":"2024-04-18T21:05:39.843576+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:39.843576+0000","last_undegraded":"2024-04-18T21:05:39.843576+0000","last_fullsized":"2024-04-18T21:05:39.843576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843806+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:39.843806+0000","last_peered":"2024-04-18T21:05:39.843806+0000","last_clean":"2024-04-18T21:05:39.843806+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:39.843806+0000","last_undegraded":"2024-04-18T21:05:39.843806+0000","last_fullsized":"2024-04-18T21:05:39.843806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843072+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:39.843072+0000","last_peered":"2024-04-18T21:05:39.843072+0000","last_clean":"2024-04-18T21:05:39.843072+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:39.843072+0000","last_undegraded":"2024-04-18T21:05:39.843072+0000","last_fullsized":"2024-04-18T21:05:39.843072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843270+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:39.843270+0000","last_peered":"2024-04-18T21:05:39.843270+0000","last_clean":"2024-04-18T21:05:39.843270+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:39.843270+0000","last_undegraded":"2024-04-18T21:05:39.843270+0000","last_fullsized":"2024-04-18T21:05:39.843270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842632+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:39.842632+0000","last_peered":"2024-04-18T21:05:39.842632+0000","last_clean":"2024-04-18T21:05:39.842632+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:39.842632+0000","last_undegraded":"2024-04-18T21:05:39.842632+0000","last_fullsized":"2024-04-18T21:05:39.842632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842610+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:39.842610+0000","last_peered":"2024-04-18T21:05:39.842610+0000","last_clean":"2024-04-18T21:05:39.842610+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:39.842610+0000","last_undegraded":"2024-04-18T21:05:39.842610+0000","last_fullsized":"2024-04-18T21:05:39.842610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843807+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:39.843807+0000","last_peered":"2024-04-18T21:05:39.843807+0000","last_clean":"2024-04-18T21:05:39.843807+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:39.843807+0000","last_undegraded":"2024-04-18T21:05:39.843807+0000","last_fullsized":"2024-04-18T21:05:39.843807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844243+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:39.844243+0000","last_peered":"2024-04-18T21:05:39.844243+0000","last_clean":"2024-04-18T21:05:39.844243+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:39.844243+0000","last_undegraded":"2024-04-18T21:05:39.844243+0000","last_fullsized":"2024-04-18T21:05:39.844243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843101+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:39.843101+0000","last_peered":"2024-04-18T21:05:39.843101+0000","last_clean":"2024-04-18T21:05:39.843101+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:39.843101+0000","last_undegraded":"2024-04-18T21:05:39.843101+0000","last_fullsized":"2024-04-18T21:05:39.843101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843260+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:39.843260+0000","last_peered":"2024-04-18T21:05:39.843260+0000","last_clean":"2024-04-18T21:05:39.843260+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:39.843260+0000","last_undegraded":"2024-04-18T21:05:39.843260+0000","last_fullsized":"2024-04-18T21:05:39.843260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843149+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:39.843149+0000","last_peered":"2024-04-18T21:05:39.843149+0000","last_clean":"2024-04-18T21:05:39.843149+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:39.843149+0000","last_undegraded":"2024-04-18T21:05:39.843149+0000","last_fullsized":"2024-04-18T21:05:39.843149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843337+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:39.843337+0000","last_peered":"2024-04-18T21:05:39.843337+0000","last_clean":"2024-04-18T21:05:39.843337+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:39.843337+0000","last_undegraded":"2024-04-18T21:05:39.843337+0000","last_fullsized":"2024-04-18T21:05:39.843337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842604+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:39.842604+0000","last_peered":"2024-04-18T21:05:39.842604+0000","last_clean":"2024-04-18T21:05:39.842604+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:39.842604+0000","last_undegraded":"2024-04-18T21:05:39.842604+0000","last_fullsized":"2024-04-18T21:05:39.842604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842919+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:39.842919+0000","last_peered":"2024-04-18T21:05:39.842919+0000","last_clean":"2024-04-18T21:05:39.842919+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:39.842919+0000","last_undegraded":"2024-04-18T21:05:39.842919+0000","last_fullsized":"2024-04-18T21:05:39.842919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844077+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:39.844077+0000","last_peered":"2024-04-18T21:05:39.844077+0000","last_clean":"2024-04-18T21:05:39.844077+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:39.844077+0000","last_undegraded":"2024-04-18T21:05:39.844077+0000","last_fullsized":"2024-04-18T21:05:39.844077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842309+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:39.842309+0000","last_peered":"2024-04-18T21:05:39.842309+0000","last_clean":"2024-04-18T21:05:39.842309+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:39.842309+0000","last_undegraded":"2024-04-18T21:05:39.842309+0000","last_fullsized":"2024-04-18T21:05:39.842309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843759+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:39.843759+0000","last_peered":"2024-04-18T21:05:39.843759+0000","last_clean":"2024-04-18T21:05:39.843759+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:39.843759+0000","last_undegraded":"2024-04-18T21:05:39.843759+0000","last_fullsized":"2024-04-18T21:05:39.843759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844399+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:39.844399+0000","last_peered":"2024-04-18T21:05:39.844399+0000","last_clean":"2024-04-18T21:05:39.844399+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:39.844399+0000","last_undegraded":"2024-04-18T21:05:39.844399+0000","last_fullsized":"2024-04-18T21:05:39.844399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842647+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:39.842647+0000","last_peered":"2024-04-18T21:05:39.842647+0000","last_clean":"2024-04-18T21:05:39.842647+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:39.842647+0000","last_undegraded":"2024-04-18T21:05:39.842647+0000","last_fullsized":"2024-04-18T21:05:39.842647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841210+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:39.841210+0000","last_peered":"2024-04-18T21:05:39.841210+0000","last_clean":"2024-04-18T21:05:39.841210+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:39.841210+0000","last_undegraded":"2024-04-18T21:05:39.841210+0000","last_fullsized":"2024-04-18T21:05:39.841210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842307+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:39.842307+0000","last_peered":"2024-04-18T21:05:39.842307+0000","last_clean":"2024-04-18T21:05:39.842307+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:39.842307+0000","last_undegraded":"2024-04-18T21:05:39.842307+0000","last_fullsized":"2024-04-18T21:05:39.842307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844710+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:39.844710+0000","last_peered":"2024-04-18T21:05:39.844710+0000","last_clean":"2024-04-18T21:05:39.844710+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:39.844710+0000","last_undegraded":"2024-04-18T21:05:39.844710+0000","last_fullsized":"2024-04-18T21:05:39.844710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842518+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:39.842518+0000","last_peered":"2024-04-18T21:05:39.842518+0000","last_clean":"2024-04-18T21:05:39.842518+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:39.842518+0000","last_undegraded":"2024-04-18T21:05:39.842518+0000","last_fullsized":"2024-04-18T21:05:39.842518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844417+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:39.844417+0000","last_peered":"2024-04-18T21:05:39.844417+0000","last_clean":"2024-04-18T21:05:39.844417+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:39.844417+0000","last_undegraded":"2024-04-18T21:05:39.844417+0000","last_fullsized":"2024-04-18T21:05:39.844417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844126+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:39.844126+0000","last_peered":"2024-04-18T21:05:39.844126+0000","last_clean":"2024-04-18T21:05:39.844126+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:39.844126+0000","last_undegraded":"2024-04-18T21:05:39.844126+0000","last_fullsized":"2024-04-18T21:05:39.844126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841888+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:39.841888+0000","last_peered":"2024-04-18T21:05:39.841888+0000","last_clean":"2024-04-18T21:05:39.841888+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:39.841888+0000","last_undegraded":"2024-04-18T21:05:39.841888+0000","last_fullsized":"2024-04-18T21:05:39.841888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843232+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:39.843232+0000","last_peered":"2024-04-18T21:05:39.843232+0000","last_clean":"2024-04-18T21:05:39.843232+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:39.843232+0000","last_undegraded":"2024-04-18T21:05:39.843232+0000","last_fullsized":"2024-04-18T21:05:39.843232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841308+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:39.841308+0000","last_peered":"2024-04-18T21:05:39.841308+0000","last_clean":"2024-04-18T21:05:39.841308+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:39.841308+0000","last_undegraded":"2024-04-18T21:05:39.841308+0000","last_fullsized":"2024-04-18T21:05:39.841308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842852+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:39.842852+0000","last_peered":"2024-04-18T21:05:39.842852+0000","last_clean":"2024-04-18T21:05:39.842852+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:39.842852+0000","last_undegraded":"2024-04-18T21:05:39.842852+0000","last_fullsized":"2024-04-18T21:05:39.842852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843727+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:39.843727+0000","last_peered":"2024-04-18T21:05:39.843727+0000","last_clean":"2024-04-18T21:05:39.843727+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:39.843727+0000","last_undegraded":"2024-04-18T21:05:39.843727+0000","last_fullsized":"2024-04-18T21:05:39.843727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844550+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:39.844550+0000","last_peered":"2024-04-18T21:05:39.844550+0000","last_clean":"2024-04-18T21:05:39.844550+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:39.844550+0000","last_undegraded":"2024-04-18T21:05:39.844550+0000","last_fullsized":"2024-04-18T21:05:39.844550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843818+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:39.843818+0000","last_peered":"2024-04-18T21:05:39.843818+0000","last_clean":"2024-04-18T21:05:39.843818+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:39.843818+0000","last_undegraded":"2024-04-18T21:05:39.843818+0000","last_fullsized":"2024-04-18T21:05:39.843818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841684+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:39.841684+0000","last_peered":"2024-04-18T21:05:39.841684+0000","last_clean":"2024-04-18T21:05:39.841684+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:39.841684+0000","last_undegraded":"2024-04-18T21:05:39.841684+0000","last_fullsized":"2024-04-18T21:05:39.841684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842734+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:39.842734+0000","last_peered":"2024-04-18T21:05:39.842734+0000","last_clean":"2024-04-18T21:05:39.842734+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:39.842734+0000","last_undegraded":"2024-04-18T21:05:39.842734+0000","last_fullsized":"2024-04-18T21:05:39.842734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843050+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:39.843050+0000","last_peered":"2024-04-18T21:05:39.843050+0000","last_clean":"2024-04-18T21:05:39.843050+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:39.843050+0000","last_undegraded":"2024-04-18T21:05:39.843050+0000","last_fullsized":"2024-04-18T21:05:39.843050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842623+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:39.842623+0000","last_peered":"2024-04-18T21:05:39.842623+0000","last_clean":"2024-04-18T21:05:39.842623+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:39.842623+0000","last_undegraded":"2024-04-18T21:05:39.842623+0000","last_fullsized":"2024-04-18T21:05:39.842623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842950+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:39.842950+0000","last_peered":"2024-04-18T21:05:39.842950+0000","last_clean":"2024-04-18T21:05:39.842950+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:39.842950+0000","last_undegraded":"2024-04-18T21:05:39.842950+0000","last_fullsized":"2024-04-18T21:05:39.842950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.845322+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:39.845322+0000","last_peered":"2024-04-18T21:05:39.845322+0000","last_clean":"2024-04-18T21:05:39.845322+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:39.845322+0000","last_undegraded":"2024-04-18T21:05:39.845322+0000","last_fullsized":"2024-04-18T21:05:39.845322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842364+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:39.842364+0000","last_peered":"2024-04-18T21:05:39.842364+0000","last_clean":"2024-04-18T21:05:39.842364+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:39.842364+0000","last_undegraded":"2024-04-18T21:05:39.842364+0000","last_fullsized":"2024-04-18T21:05:39.842364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844384+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:39.844384+0000","last_peered":"2024-04-18T21:05:39.844384+0000","last_clean":"2024-04-18T21:05:39.844384+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:39.844384+0000","last_undegraded":"2024-04-18T21:05:39.844384+0000","last_fullsized":"2024-04-18T21:05:39.844384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842504+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:39.842504+0000","last_peered":"2024-04-18T21:05:39.842504+0000","last_clean":"2024-04-18T21:05:39.842504+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:39.842504+0000","last_undegraded":"2024-04-18T21:05:39.842504+0000","last_fullsized":"2024-04-18T21:05:39.842504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844994+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:39.844994+0000","last_peered":"2024-04-18T21:05:39.844994+0000","last_clean":"2024-04-18T21:05:39.844994+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:39.844994+0000","last_undegraded":"2024-04-18T21:05:39.844994+0000","last_fullsized":"2024-04-18T21:05:39.844994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843319+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:39.843319+0000","last_peered":"2024-04-18T21:05:39.843319+0000","last_clean":"2024-04-18T21:05:39.843319+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:39.843319+0000","last_undegraded":"2024-04-18T21:05:39.843319+0000","last_fullsized":"2024-04-18T21:05:39.843319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844354+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:39.844354+0000","last_peered":"2024-04-18T21:05:39.844354+0000","last_clean":"2024-04-18T21:05:39.844354+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:39.844354+0000","last_undegraded":"2024-04-18T21:05:39.844354+0000","last_fullsized":"2024-04-18T21:05:39.844354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841901+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:39.841901+0000","last_peered":"2024-04-18T21:05:39.841901+0000","last_clean":"2024-04-18T21:05:39.841901+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:39.841901+0000","last_undegraded":"2024-04-18T21:05:39.841901+0000","last_fullsized":"2024-04-18T21:05:39.841901+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842032+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:39.842032+0000","last_peered":"2024-04-18T21:05:39.842032+0000","last_clean":"2024-04-18T21:05:39.842032+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:39.842032+0000","last_undegraded":"2024-04-18T21:05:39.842032+0000","last_fullsized":"2024-04-18T21:05:39.842032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843891+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:39.843891+0000","last_peered":"2024-04-18T21:05:39.843891+0000","last_clean":"2024-04-18T21:05:39.843891+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:39.843891+0000","last_undegraded":"2024-04-18T21:05:39.843891+0000","last_fullsized":"2024-04-18T21:05:39.843891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843867+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:39.843867+0000","last_peered":"2024-04-18T21:05:39.843867+0000","last_clean":"2024-04-18T21:05:39.843867+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:39.843867+0000","last_undegraded":"2024-04-18T21:05:39.843867+0000","last_fullsized":"2024-04-18T21:05:39.843867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844724+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:39.844724+0000","last_peered":"2024-04-18T21:05:39.844724+0000","last_clean":"2024-04-18T21:05:39.844724+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:39.844724+0000","last_undegraded":"2024-04-18T21:05:39.844724+0000","last_fullsized":"2024-04-18T21:05:39.844724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842870+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:39.842870+0000","last_peered":"2024-04-18T21:05:39.842870+0000","last_clean":"2024-04-18T21:05:39.842870+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:39.842870+0000","last_undegraded":"2024-04-18T21:05:39.842870+0000","last_fullsized":"2024-04-18T21:05:39.842870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844936+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:39.844936+0000","last_peered":"2024-04-18T21:05:39.844936+0000","last_clean":"2024-04-18T21:05:39.844936+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:39.844936+0000","last_undegraded":"2024-04-18T21:05:39.844936+0000","last_fullsized":"2024-04-18T21:05:39.844936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842584+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:39.842584+0000","last_peered":"2024-04-18T21:05:39.842584+0000","last_clean":"2024-04-18T21:05:39.842584+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:39.842584+0000","last_undegraded":"2024-04-18T21:05:39.842584+0000","last_fullsized":"2024-04-18T21:05:39.842584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842694+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:39.842694+0000","last_peered":"2024-04-18T21:05:39.842694+0000","last_clean":"2024-04-18T21:05:39.842694+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:39.842694+0000","last_undegraded":"2024-04-18T21:05:39.842694+0000","last_fullsized":"2024-04-18T21:05:39.842694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843757+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:39.843757+0000","last_peered":"2024-04-18T21:05:39.843757+0000","last_clean":"2024-04-18T21:05:39.843757+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:39.843757+0000","last_undegraded":"2024-04-18T21:05:39.843757+0000","last_fullsized":"2024-04-18T21:05:39.843757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844825+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:39.844825+0000","last_peered":"2024-04-18T21:05:39.844825+0000","last_clean":"2024-04-18T21:05:39.844825+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:39.844825+0000","last_undegraded":"2024-04-18T21:05:39.844825+0000","last_fullsized":"2024-04-18T21:05:39.844825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841908+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:39.841908+0000","last_peered":"2024-04-18T21:05:39.841908+0000","last_clean":"2024-04-18T21:05:39.841908+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:39.841908+0000","last_undegraded":"2024-04-18T21:05:39.841908+0000","last_fullsized":"2024-04-18T21:05:39.841908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844788+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:39.844788+0000","last_peered":"2024-04-18T21:05:39.844788+0000","last_clean":"2024-04-18T21:05:39.844788+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:39.844788+0000","last_undegraded":"2024-04-18T21:05:39.844788+0000","last_fullsized":"2024-04-18T21:05:39.844788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843263+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:39.843263+0000","last_peered":"2024-04-18T21:05:39.843263+0000","last_clean":"2024-04-18T21:05:39.843263+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:39.843263+0000","last_undegraded":"2024-04-18T21:05:39.843263+0000","last_fullsized":"2024-04-18T21:05:39.843263+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841573+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:39.841573+0000","last_peered":"2024-04-18T21:05:39.841573+0000","last_clean":"2024-04-18T21:05:39.841573+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:39.841573+0000","last_undegraded":"2024-04-18T21:05:39.841573+0000","last_fullsized":"2024-04-18T21:05:39.841573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844271+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:39.844271+0000","last_peered":"2024-04-18T21:05:39.844271+0000","last_clean":"2024-04-18T21:05:39.844271+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:39.844271+0000","last_undegraded":"2024-04-18T21:05:39.844271+0000","last_fullsized":"2024-04-18T21:05:39.844271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841797+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:39.841797+0000","last_peered":"2024-04-18T21:05:39.841797+0000","last_clean":"2024-04-18T21:05:39.841797+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:39.841797+0000","last_undegraded":"2024-04-18T21:05:39.841797+0000","last_fullsized":"2024-04-18T21:05:39.841797+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842886+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:39.842886+0000","last_peered":"2024-04-18T21:05:39.842886+0000","last_clean":"2024-04-18T21:05:39.842886+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:39.842886+0000","last_undegraded":"2024-04-18T21:05:39.842886+0000","last_fullsized":"2024-04-18T21:05:39.842886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842744+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:39.842744+0000","last_peered":"2024-04-18T21:05:39.842744+0000","last_clean":"2024-04-18T21:05:39.842744+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:39.842744+0000","last_undegraded":"2024-04-18T21:05:39.842744+0000","last_fullsized":"2024-04-18T21:05:39.842744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844050+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:39.844050+0000","last_peered":"2024-04-18T21:05:39.844050+0000","last_clean":"2024-04-18T21:05:39.844050+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:39.844050+0000","last_undegraded":"2024-04-18T21:05:39.844050+0000","last_fullsized":"2024-04-18T21:05:39.844050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844692+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:39.844692+0000","last_peered":"2024-04-18T21:05:39.844692+0000","last_clean":"2024-04-18T21:05:39.844692+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:39.844692+0000","last_undegraded":"2024-04-18T21:05:39.844692+0000","last_fullsized":"2024-04-18T21:05:39.844692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842336+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:39.842336+0000","last_peered":"2024-04-18T21:05:39.842336+0000","last_clean":"2024-04-18T21:05:39.842336+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:39.842336+0000","last_undegraded":"2024-04-18T21:05:39.842336+0000","last_fullsized":"2024-04-18T21:05:39.842336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.845104+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:39.845104+0000","last_peered":"2024-04-18T21:05:39.845104+0000","last_clean":"2024-04-18T21:05:39.845104+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:39.845104+0000","last_undegraded":"2024-04-18T21:05:39.845104+0000","last_fullsized":"2024-04-18T21:05:39.845104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842435+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:39.842435+0000","last_peered":"2024-04-18T21:05:39.842435+0000","last_clean":"2024-04-18T21:05:39.842435+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:39.842435+0000","last_undegraded":"2024-04-18T21:05:39.842435+0000","last_fullsized":"2024-04-18T21:05:39.842435+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842993+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:39.842993+0000","last_peered":"2024-04-18T21:05:39.842993+0000","last_clean":"2024-04-18T21:05:39.842993+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:39.842993+0000","last_undegraded":"2024-04-18T21:05:39.842993+0000","last_fullsized":"2024-04-18T21:05:39.842993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842350+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:39.842350+0000","last_peered":"2024-04-18T21:05:39.842350+0000","last_clean":"2024-04-18T21:05:39.842350+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:39.842350+0000","last_undegraded":"2024-04-18T21:05:39.842350+0000","last_fullsized":"2024-04-18T21:05:39.842350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844620+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:39.844620+0000","last_peered":"2024-04-18T21:05:39.844620+0000","last_clean":"2024-04-18T21:05:39.844620+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:39.844620+0000","last_undegraded":"2024-04-18T21:05:39.844620+0000","last_fullsized":"2024-04-18T21:05:39.844620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843520+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:39.843520+0000","last_peered":"2024-04-18T21:05:39.843520+0000","last_clean":"2024-04-18T21:05:39.843520+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:39.843520+0000","last_undegraded":"2024-04-18T21:05:39.843520+0000","last_fullsized":"2024-04-18T21:05:39.843520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842970+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:39.842970+0000","last_peered":"2024-04-18T21:05:39.842970+0000","last_clean":"2024-04-18T21:05:39.842970+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:39.842970+0000","last_undegraded":"2024-04-18T21:05:39.842970+0000","last_fullsized":"2024-04-18T21:05:39.842970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842850+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:39.842850+0000","last_peered":"2024-04-18T21:05:39.842850+0000","last_clean":"2024-04-18T21:05:39.842850+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:39.842850+0000","last_undegraded":"2024-04-18T21:05:39.842850+0000","last_fullsized":"2024-04-18T21:05:39.842850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841469+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:39.841469+0000","last_peered":"2024-04-18T21:05:39.841469+0000","last_clean":"2024-04-18T21:05:39.841469+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:39.841469+0000","last_undegraded":"2024-04-18T21:05:39.841469+0000","last_fullsized":"2024-04-18T21:05:39.841469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842798+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:39.842798+0000","last_peered":"2024-04-18T21:05:39.842798+0000","last_clean":"2024-04-18T21:05:39.842798+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:39.842798+0000","last_undegraded":"2024-04-18T21:05:39.842798+0000","last_fullsized":"2024-04-18T21:05:39.842798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.845406+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:39.845406+0000","last_peered":"2024-04-18T21:05:39.845406+0000","last_clean":"2024-04-18T21:05:39.845406+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:39.845406+0000","last_undegraded":"2024-04-18T21:05:39.845406+0000","last_fullsized":"2024-04-18T21:05:39.845406+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842506+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:39.842506+0000","last_peered":"2024-04-18T21:05:39.842506+0000","last_clean":"2024-04-18T21:05:39.842506+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:39.842506+0000","last_undegraded":"2024-04-18T21:05:39.842506+0000","last_fullsized":"2024-04-18T21:05:39.842506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844043+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:39.844043+0000","last_peered":"2024-04-18T21:05:39.844043+0000","last_clean":"2024-04-18T21:05:39.844043+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:39.844043+0000","last_undegraded":"2024-04-18T21:05:39.844043+0000","last_fullsized":"2024-04-18T21:05:39.844043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844183+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:39.844183+0000","last_peered":"2024-04-18T21:05:39.844183+0000","last_clean":"2024-04-18T21:05:39.844183+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:39.844183+0000","last_undegraded":"2024-04-18T21:05:39.844183+0000","last_fullsized":"2024-04-18T21:05:39.844183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841418+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:39.841418+0000","last_peered":"2024-04-18T21:05:39.841418+0000","last_clean":"2024-04-18T21:05:39.841418+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:39.841418+0000","last_undegraded":"2024-04-18T21:05:39.841418+0000","last_fullsized":"2024-04-18T21:05:39.841418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844382+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:39.844382+0000","last_peered":"2024-04-18T21:05:39.844382+0000","last_clean":"2024-04-18T21:05:39.844382+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:39.844382+0000","last_undegraded":"2024-04-18T21:05:39.844382+0000","last_fullsized":"2024-04-18T21:05:39.844382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.845130+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:39.845130+0000","last_peered":"2024-04-18T21:05:39.845130+0000","last_clean":"2024-04-18T21:05:39.845130+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:39.845130+0000","last_undegraded":"2024-04-18T21:05:39.845130+0000","last_fullsized":"2024-04-18T21:05:39.845130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841363+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:39.841363+0000","last_peered":"2024-04-18T21:05:39.841363+0000","last_clean":"2024-04-18T21:05:39.841363+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:39.841363+0000","last_undegraded":"2024-04-18T21:05:39.841363+0000","last_fullsized":"2024-04-18T21:05:39.841363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842884+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:39.842884+0000","last_peered":"2024-04-18T21:05:39.842884+0000","last_clean":"2024-04-18T21:05:39.842884+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:39.842884+0000","last_undegraded":"2024-04-18T21:05:39.842884+0000","last_fullsized":"2024-04-18T21:05:39.842884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841409+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:39.841409+0000","last_peered":"2024-04-18T21:05:39.841409+0000","last_clean":"2024-04-18T21:05:39.841409+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:39.841409+0000","last_undegraded":"2024-04-18T21:05:39.841409+0000","last_fullsized":"2024-04-18T21:05:39.841409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844792+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:39.844792+0000","last_peered":"2024-04-18T21:05:39.844792+0000","last_clean":"2024-04-18T21:05:39.844792+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:39.844792+0000","last_undegraded":"2024-04-18T21:05:39.844792+0000","last_fullsized":"2024-04-18T21:05:39.844792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841610+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:39.841610+0000","last_peered":"2024-04-18T21:05:39.841610+0000","last_clean":"2024-04-18T21:05:39.841610+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:39.841610+0000","last_undegraded":"2024-04-18T21:05:39.841610+0000","last_fullsized":"2024-04-18T21:05:39.841610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842542+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:39.842542+0000","last_peered":"2024-04-18T21:05:39.842542+0000","last_clean":"2024-04-18T21:05:39.842542+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:39.842542+0000","last_undegraded":"2024-04-18T21:05:39.842542+0000","last_fullsized":"2024-04-18T21:05:39.842542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.841674+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:39.841674+0000","last_peered":"2024-04-18T21:05:39.841674+0000","last_clean":"2024-04-18T21:05:39.841674+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:39.841674+0000","last_undegraded":"2024-04-18T21:05:39.841674+0000","last_fullsized":"2024-04-18T21:05:39.841674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843642+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:39.843642+0000","last_peered":"2024-04-18T21:05:39.843642+0000","last_clean":"2024-04-18T21:05:39.843642+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:39.843642+0000","last_undegraded":"2024-04-18T21:05:39.843642+0000","last_fullsized":"2024-04-18T21:05:39.843642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843322+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:39.843322+0000","last_peered":"2024-04-18T21:05:39.843322+0000","last_clean":"2024-04-18T21:05:39.843322+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:39.843322+0000","last_undegraded":"2024-04-18T21:05:39.843322+0000","last_fullsized":"2024-04-18T21:05:39.843322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843359+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:39.843359+0000","last_peered":"2024-04-18T21:05:39.843359+0000","last_clean":"2024-04-18T21:05:39.843359+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:39.843359+0000","last_undegraded":"2024-04-18T21:05:39.843359+0000","last_fullsized":"2024-04-18T21:05:39.843359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844047+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:39.844047+0000","last_peered":"2024-04-18T21:05:39.844047+0000","last_clean":"2024-04-18T21:05:39.844047+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:39.844047+0000","last_undegraded":"2024-04-18T21:05:39.844047+0000","last_fullsized":"2024-04-18T21:05:39.844047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843697+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:39.843697+0000","last_peered":"2024-04-18T21:05:39.843697+0000","last_clean":"2024-04-18T21:05:39.843697+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:39.843697+0000","last_undegraded":"2024-04-18T21:05:39.843697+0000","last_fullsized":"2024-04-18T21:05:39.843697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.844039+0000","last_change":"2024-04-18T21:05:07.595915+0000","last_active":"2024-04-18T21:05:39.844039+0000","last_peered":"2024-04-18T21:05:39.844039+0000","last_clean":"2024-04-18T21:05:39.844039+0000","last_became_active":"2024-04-18T21:05:07.594940+0000","last_became_peered":"2024-04-18T21:05:07.594940+0000","last_unstale":"2024-04-18T21:05:39.844039+0000","last_undegraded":"2024-04-18T21:05:39.844039+0000","last_fullsized":"2024-04-18T21:05:39.844039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843702+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:39.843702+0000","last_peered":"2024-04-18T21:05:39.843702+0000","last_clean":"2024-04-18T21:05:39.843702+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:39.843702+0000","last_undegraded":"2024-04-18T21:05:39.843702+0000","last_fullsized":"2024-04-18T21:05:39.843702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843922+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:39.843922+0000","last_peered":"2024-04-18T21:05:39.843922+0000","last_clean":"2024-04-18T21:05:39.843922+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:39.843922+0000","last_undegraded":"2024-04-18T21:05:39.843922+0000","last_fullsized":"2024-04-18T21:05:39.843922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843291+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:39.843291+0000","last_peered":"2024-04-18T21:05:39.843291+0000","last_clean":"2024-04-18T21:05:39.843291+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:39.843291+0000","last_undegraded":"2024-04-18T21:05:39.843291+0000","last_fullsized":"2024-04-18T21:05:39.843291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842664+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:39.842664+0000","last_peered":"2024-04-18T21:05:39.842664+0000","last_clean":"2024-04-18T21:05:39.842664+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:39.842664+0000","last_undegraded":"2024-04-18T21:05:39.842664+0000","last_fullsized":"2024-04-18T21:05:39.842664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.843126+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:39.843126+0000","last_peered":"2024-04-18T21:05:39.843126+0000","last_clean":"2024-04-18T21:05:39.843126+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:39.843126+0000","last_undegraded":"2024-04-18T21:05:39.843126+0000","last_fullsized":"2024-04-18T21:05:39.843126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.842771+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:39.842771+0000","last_peered":"2024-04-18T21:05:39.842771+0000","last_clean":"2024-04-18T21:05:39.842771+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:39.842771+0000","last_undegraded":"2024-04-18T21:05:39.842771+0000","last_fullsized":"2024-04-18T21:05:39.842771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":677487,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":81000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":307200,"data_stored":678103,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:41.942 INFO:tasks.thrashosds.thrasher:Setting 3.1c to [0, 2] 2024-04-18T21:05:41.943 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1c', '0', '2'] 2024-04-18T21:05:41.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1c 0 2 2024-04-18T21:05:42.021 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:42.025 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:42.024+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:42.053 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455638569999998, 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455517569000001, 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455444655000001, 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455375142000001, 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455340219999997, 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:42.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:42.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:42.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:42.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455295241000002, 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:42.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.085 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455229869999997, 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:42.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:42.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455180480999999, 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:42.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:42.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:42.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:42.095 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.455126272000001, 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:42.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:42.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:42.099 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.443348708000002, 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:42.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.443113511, 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:42.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.442647094999998, 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.107 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.442387908000001, 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.442230352000003, 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:42.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:42.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.442145824000001, 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:42.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:42.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.441829771000002, 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:42.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.128 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.439863268000003, 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:42.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.439748516999998, 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:42.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:42.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.437751591000001, 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:42.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:42.141 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.437045224000002, 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:42.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:42.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:42.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:42.145 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:42.146 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:42.147 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:42.148+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:42.147 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:42.160 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:42.181 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:42.181 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:42.201 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:42.248 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:42.246+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:42.277 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:42.277 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:42.291 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:42.377 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:42.378+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:42.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:42.452+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:42.453 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:42.454 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:42.467 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:42.551 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:42.552+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:42.630 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:42.630 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:42.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:42.690 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:42.692+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:42.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:42.752+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:42.776 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:42.776 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:42.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:42.854 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:42.854+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:set 3.1c pg_upmap mapping to [0,2] 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:05:42.955 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:42.956+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:42.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:43.056 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:43.054+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:43.088 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.088 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:43.156 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:43.156+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:43.234 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.235 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:43.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:43.260+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:43.358 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:43.356+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:43.416 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.416 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.431 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:43.459 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:43.458+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:43.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:43.560+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:43.601 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.602 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.616 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:43.660 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:43.660+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:43.747 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.747 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:43.761 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:43.758+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:43.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:43.864+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.933 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:43.963 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:43.964+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:44.064 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:44.064+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:44.064 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.064 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:44.165 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:44.164+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:44.211 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.211 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.217 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:44.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:44.266 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:44.266+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:44.347 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.347 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:44.366 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:44.366+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:44.375 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:44.395 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:44.395 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:44.416 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:44.416 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:44.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:44.468+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:44.487 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:44.487 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:44.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:44.487 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:44.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.487 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.894349542999997, 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:44.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.894248535999999, 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.894147562999997, 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.502 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.893463556999997, 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.893373779999997, 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:44.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:44.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.512 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.893227781, 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:44.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.89313318, 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:44.521 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.893028237000003, 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.892953286000001, 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:44.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.885619224999999, 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:44.532 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.881471171999998, 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:44.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.881362535999997, 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:44.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.881228806000003, 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:44.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.881083807000003, 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:44.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:44.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:44.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.873181279999997, 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.555 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.872925727999998, 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:44.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:44.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.872869887, 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:44.562 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.898542611000003, 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:44.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:44.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:44.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.567 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.896011235000003, 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:44.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.893676773999999, 2024-04-18T21:05:44.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:44.576 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:44.578 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:44.578 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:44.576+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:44.679 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:44.680+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:44.711 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:44.711 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:44.711 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:44.711 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:44.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:44.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:44.780+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:44.880 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:44.882+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:44.883 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:05:44.888 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:44.888 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:44.888 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:44.888 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:44.888 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:44.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:44.980 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:44.982+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:45.026 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428931208000002, 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428810206999998, 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:45.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428737292999998, 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428667779999998, 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:45.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:45.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:45.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:45.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428632858, 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:45.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:45.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428587878999998, 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:45.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:45.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:45.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.056 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428522508, 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:45.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:45.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:45.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428473119000003, 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.065 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.428418909999998, 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:45.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.416641345999999, 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:45.072 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.416406148999997, 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:45.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:45.076 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.415939733000002, 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:45.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.415680545999997, 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:45.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:45.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:45.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.084 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.415522989999999, 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.415438461999997, 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:45.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.415122408999999, 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:45.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:45.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:45.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.413155906, 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.413041155000002, 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:45.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.411044228999998, 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:45.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:45.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:45.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.108 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.410337861999999, 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:45.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:45.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:45.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:45.113 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.113 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.113 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.113 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:45.113 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:45.113 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:45.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:45.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:45.116+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:45.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:45.216+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:45.246 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:45.247 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:45.247 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:45.247 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:45.262 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:45.316 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:45.316+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:45.384 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:45.385 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:45.385 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:45.385 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:45.385 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:45.399 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:45.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:45.416+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:45.516 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:45.516 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.388627935000002, 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:45.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:45.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.388594363000003, 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.388562100000001, 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.528 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.533 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.388446549000001, 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:45.534 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:45.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:45.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:45.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.921012623999999, 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:45.540 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:45.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:45.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:45.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920899499999997, 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:45.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:45.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920820417999998, 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:45.559 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920717214, 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920627441999997, 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:45.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:45.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920541403999998, 2024-04-18T21:05:45.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:45.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:45.581 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920477319, 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:45.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:45.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:45.587 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920391721000001, 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:45.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920325527999999, 2024-04-18T21:05:45.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:45.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.92025615, 2024-04-18T21:05:45.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:45.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.605 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.920093446999999, 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:45.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:45.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:45.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.919942483, 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.612 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:45.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:45.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.919892974, 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.618 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:45.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.919827712, 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:45.624 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:45.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:45.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.919693531999997, 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:45.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:45.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:45.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.636 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.919590067000001, 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:45.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:45.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:45.641 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:45.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:45.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:45.644+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:45.743 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:45.742+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:45.777 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:45.778 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:45.778 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:45.778 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:45.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:45.844 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:45.844+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:45.878 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:05:45.907 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:45.908 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:45.908 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:45.908 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:45.908 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:45.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:45.945 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:45.948+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:46.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:46.048+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:46.088 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.493438347000001, 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:46.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:46.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:46.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.493337339999997, 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.493236367000002, 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:46.099 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.492552361000001, 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:46.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:46.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:46.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.492462584000002, 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.492316584999998, 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:46.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:46.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.492221983999997, 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:46.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.123 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.492117041, 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.492042089999998, 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:46.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.484708028999997, 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:46.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:46.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:46.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.480559976000002, 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:46.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:46.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.480451340000002, 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.48031761, 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:46.146 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.480172611, 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:46.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:46.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:46.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.472270084000002, 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:46.151 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.472014532000003, 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:46.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:46.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:46.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.471958690999998, 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:46.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.497631415000001, 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:46.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.166 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.495100039, 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:46.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:46.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.492765578, 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:46.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:46.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:46.175 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:46.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:46.177 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:46.176+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:46.278 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:46.276+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:46.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:46.411 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:46.412+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:46.433 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:46.479 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:46.482+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:46.487 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:46.487 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:46.487 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:46.487 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:46.487 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:46.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:46.591 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:46.591 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:46.591 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:46.592+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:46.614 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:46.614 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:46.633 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:46.633 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:46.667 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:46.668 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:46.681 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:46.682+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:46.682 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:46.782 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:46.782+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:46.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:46.917 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:46.918+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:46.984 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:46.982+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:46.996 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:46.996 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:47.010 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:47.085 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:47.084+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:47.176 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:47.177 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:47.186 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:47.186+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:47.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:47.287 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:47.288+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:47.321 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:47.321 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:47.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:47.388 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:47.388+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:47.452 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:47.452 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:47.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:47.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:47.512+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:47.588 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:47.588+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:47.598 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:47.690 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:47.692+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:47.727 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:47.728 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:47.742 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:47.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:47.792+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:47.878 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:47.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:47.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:47.882 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:05:47.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:05:47.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:47.892+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:47.901 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:05:47.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:47.992+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.009 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:48.093 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:48.094+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:48.140 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.140 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.154 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:48.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:48.196+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:48.206 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:48.206 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:05:48.206 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 27, 2024-04-18T21:05:48.206 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:05:48.206 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:05:48.206 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:05:45.867415+0000", 2024-04-18T21:05:48.206 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5799936, 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:05:48.207 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:48.208 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:48.210 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:48.211 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:48.213 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:48.214 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:48.215 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:48.216 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:48.217 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:05:48.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:05:48.219 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:48.221 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:48.222 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:48.223 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:48.224 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:05:48.225 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:05:48.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:48.227 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:48.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:48.229 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:48.230 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:48.231 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 25, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.232 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:05:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:05:48.234 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:05:48.235 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:48.237 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.237 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.237 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:05:48.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:48.238 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.239 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:48.243 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:05:48.244 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.245 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:48.248 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.249 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.1c", 2024-04-18T21:05:48.250 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:05:48.251 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:05:48.252 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:05:48.253 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:48.253 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:05:48.254 INFO:tasks.thrashosds.thrasher:j is {'epoch': 27, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:05:45.867415+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 25, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.1c', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:05:48.254 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:48.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:48.296+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:48.322 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.322 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.336 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:48.396 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:48.394+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:48.456 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.457 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:48.497 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:48.496+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:48.555 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:48.557 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-18T21:05:47.616787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":209,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90232,"kb_used_data":848,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025288,"statfs":{"total":289910292480,"available":289817894912,"internally_reserved":0,"allocated":868352,"data_stored":1462147,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001909"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872900+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:43.872900+0000","last_peered":"2024-04-18T21:05:43.872900+0000","last_clean":"2024-04-18T21:05:43.872900+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:43.872900+0000","last_undegraded":"2024-04-18T21:05:43.872900+0000","last_fullsized":"2024-04-18T21:05:43.872900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872234+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:43.872234+0000","last_peered":"2024-04-18T21:05:43.872234+0000","last_clean":"2024-04-18T21:05:43.872234+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:43.872234+0000","last_undegraded":"2024-04-18T21:05:43.872234+0000","last_fullsized":"2024-04-18T21:05:43.872234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869446+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:43.869446+0000","last_peered":"2024-04-18T21:05:43.869446+0000","last_clean":"2024-04-18T21:05:43.869446+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:43.869446+0000","last_undegraded":"2024-04-18T21:05:43.869446+0000","last_fullsized":"2024-04-18T21:05:43.869446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868835+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:43.868835+0000","last_peered":"2024-04-18T21:05:43.868835+0000","last_clean":"2024-04-18T21:05:43.868835+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:43.868835+0000","last_undegraded":"2024-04-18T21:05:43.868835+0000","last_fullsized":"2024-04-18T21:05:43.868835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871084+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:43.871084+0000","last_peered":"2024-04-18T21:05:43.871084+0000","last_clean":"2024-04-18T21:05:43.871084+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:43.871084+0000","last_undegraded":"2024-04-18T21:05:43.871084+0000","last_fullsized":"2024-04-18T21:05:43.871084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868629+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:43.868629+0000","last_peered":"2024-04-18T21:05:43.868629+0000","last_clean":"2024-04-18T21:05:43.868629+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:43.868629+0000","last_undegraded":"2024-04-18T21:05:43.868629+0000","last_fullsized":"2024-04-18T21:05:43.868629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868932+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:43.868932+0000","last_peered":"2024-04-18T21:05:43.868932+0000","last_clean":"2024-04-18T21:05:43.868932+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:43.868932+0000","last_undegraded":"2024-04-18T21:05:43.868932+0000","last_fullsized":"2024-04-18T21:05:43.868932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868307+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:43.868307+0000","last_peered":"2024-04-18T21:05:43.868307+0000","last_clean":"2024-04-18T21:05:43.868307+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:43.868307+0000","last_undegraded":"2024-04-18T21:05:43.868307+0000","last_fullsized":"2024-04-18T21:05:43.868307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872035+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:43.872035+0000","last_peered":"2024-04-18T21:05:43.872035+0000","last_clean":"2024-04-18T21:05:43.872035+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:43.872035+0000","last_undegraded":"2024-04-18T21:05:43.872035+0000","last_fullsized":"2024-04-18T21:05:43.872035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872242+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:43.872242+0000","last_peered":"2024-04-18T21:05:43.872242+0000","last_clean":"2024-04-18T21:05:43.872242+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:43.872242+0000","last_undegraded":"2024-04-18T21:05:43.872242+0000","last_fullsized":"2024-04-18T21:05:43.872242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869438+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:43.869438+0000","last_peered":"2024-04-18T21:05:43.869438+0000","last_clean":"2024-04-18T21:05:43.869438+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:43.869438+0000","last_undegraded":"2024-04-18T21:05:43.869438+0000","last_fullsized":"2024-04-18T21:05:43.869438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871768+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:43.871768+0000","last_peered":"2024-04-18T21:05:43.871768+0000","last_clean":"2024-04-18T21:05:43.871768+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:43.871768+0000","last_undegraded":"2024-04-18T21:05:43.871768+0000","last_fullsized":"2024-04-18T21:05:43.871768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870773+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:43.870773+0000","last_peered":"2024-04-18T21:05:43.870773+0000","last_clean":"2024-04-18T21:05:43.870773+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:43.870773+0000","last_undegraded":"2024-04-18T21:05:43.870773+0000","last_fullsized":"2024-04-18T21:05:43.870773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868766+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:43.868766+0000","last_peered":"2024-04-18T21:05:43.868766+0000","last_clean":"2024-04-18T21:05:43.868766+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:43.868766+0000","last_undegraded":"2024-04-18T21:05:43.868766+0000","last_fullsized":"2024-04-18T21:05:43.868766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869027+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:43.869027+0000","last_peered":"2024-04-18T21:05:43.869027+0000","last_clean":"2024-04-18T21:05:43.869027+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:43.869027+0000","last_undegraded":"2024-04-18T21:05:43.869027+0000","last_fullsized":"2024-04-18T21:05:43.869027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868376+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:43.868376+0000","last_peered":"2024-04-18T21:05:43.868376+0000","last_clean":"2024-04-18T21:05:43.868376+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:43.868376+0000","last_undegraded":"2024-04-18T21:05:43.868376+0000","last_fullsized":"2024-04-18T21:05:43.868376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.873163+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:43.873163+0000","last_peered":"2024-04-18T21:05:43.873163+0000","last_clean":"2024-04-18T21:05:43.873163+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:43.873163+0000","last_undegraded":"2024-04-18T21:05:43.873163+0000","last_fullsized":"2024-04-18T21:05:43.873163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872616+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:43.872616+0000","last_peered":"2024-04-18T21:05:43.872616+0000","last_clean":"2024-04-18T21:05:43.872616+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:43.872616+0000","last_undegraded":"2024-04-18T21:05:43.872616+0000","last_fullsized":"2024-04-18T21:05:43.872616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871565+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:43.871565+0000","last_peered":"2024-04-18T21:05:43.871565+0000","last_clean":"2024-04-18T21:05:43.871565+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:43.871565+0000","last_undegraded":"2024-04-18T21:05:43.871565+0000","last_fullsized":"2024-04-18T21:05:43.871565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868944+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:43.868944+0000","last_peered":"2024-04-18T21:05:43.868944+0000","last_clean":"2024-04-18T21:05:43.868944+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:43.868944+0000","last_undegraded":"2024-04-18T21:05:43.868944+0000","last_fullsized":"2024-04-18T21:05:43.868944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869171+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:43.869171+0000","last_peered":"2024-04-18T21:05:43.869171+0000","last_clean":"2024-04-18T21:05:43.869171+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:43.869171+0000","last_undegraded":"2024-04-18T21:05:43.869171+0000","last_fullsized":"2024-04-18T21:05:43.869171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870608+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:43.870608+0000","last_peered":"2024-04-18T21:05:43.870608+0000","last_clean":"2024-04-18T21:05:43.870608+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:43.870608+0000","last_undegraded":"2024-04-18T21:05:43.870608+0000","last_fullsized":"2024-04-18T21:05:43.870608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870355+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:43.870355+0000","last_peered":"2024-04-18T21:05:43.870355+0000","last_clean":"2024-04-18T21:05:43.870355+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:43.870355+0000","last_undegraded":"2024-04-18T21:05:43.870355+0000","last_fullsized":"2024-04-18T21:05:43.870355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870095+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:43.870095+0000","last_peered":"2024-04-18T21:05:43.870095+0000","last_clean":"2024-04-18T21:05:43.870095+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:43.870095+0000","last_undegraded":"2024-04-18T21:05:43.870095+0000","last_fullsized":"2024-04-18T21:05:43.870095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872999+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:43.872999+0000","last_peered":"2024-04-18T21:05:43.872999+0000","last_clean":"2024-04-18T21:05:43.872999+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:43.872999+0000","last_undegraded":"2024-04-18T21:05:43.872999+0000","last_fullsized":"2024-04-18T21:05:43.872999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872090+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:43.872090+0000","last_peered":"2024-04-18T21:05:43.872090+0000","last_clean":"2024-04-18T21:05:43.872090+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:43.872090+0000","last_undegraded":"2024-04-18T21:05:43.872090+0000","last_fullsized":"2024-04-18T21:05:43.872090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869584+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:43.869584+0000","last_peered":"2024-04-18T21:05:43.869584+0000","last_clean":"2024-04-18T21:05:43.869584+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:43.869584+0000","last_undegraded":"2024-04-18T21:05:43.869584+0000","last_fullsized":"2024-04-18T21:05:43.869584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872607+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:43.872607+0000","last_peered":"2024-04-18T21:05:43.872607+0000","last_clean":"2024-04-18T21:05:43.872607+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:43.872607+0000","last_undegraded":"2024-04-18T21:05:43.872607+0000","last_fullsized":"2024-04-18T21:05:43.872607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871923+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:43.871923+0000","last_peered":"2024-04-18T21:05:43.871923+0000","last_clean":"2024-04-18T21:05:43.871923+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:43.871923+0000","last_undegraded":"2024-04-18T21:05:43.871923+0000","last_fullsized":"2024-04-18T21:05:43.871923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871182+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:43.871182+0000","last_peered":"2024-04-18T21:05:43.871182+0000","last_clean":"2024-04-18T21:05:43.871182+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:43.871182+0000","last_undegraded":"2024-04-18T21:05:43.871182+0000","last_fullsized":"2024-04-18T21:05:43.871182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870525+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:43.870525+0000","last_peered":"2024-04-18T21:05:43.870525+0000","last_clean":"2024-04-18T21:05:43.870525+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:43.870525+0000","last_undegraded":"2024-04-18T21:05:43.870525+0000","last_fullsized":"2024-04-18T21:05:43.870525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868562+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:43.868562+0000","last_peered":"2024-04-18T21:05:43.868562+0000","last_clean":"2024-04-18T21:05:43.868562+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:43.868562+0000","last_undegraded":"2024-04-18T21:05:43.868562+0000","last_fullsized":"2024-04-18T21:05:43.868562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872176+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:43.872176+0000","last_peered":"2024-04-18T21:05:43.872176+0000","last_clean":"2024-04-18T21:05:43.872176+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:43.872176+0000","last_undegraded":"2024-04-18T21:05:43.872176+0000","last_fullsized":"2024-04-18T21:05:43.872176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869228+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:43.869228+0000","last_peered":"2024-04-18T21:05:43.869228+0000","last_clean":"2024-04-18T21:05:43.869228+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:43.869228+0000","last_undegraded":"2024-04-18T21:05:43.869228+0000","last_fullsized":"2024-04-18T21:05:43.869228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872234+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:43.872234+0000","last_peered":"2024-04-18T21:05:43.872234+0000","last_clean":"2024-04-18T21:05:43.872234+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:43.872234+0000","last_undegraded":"2024-04-18T21:05:43.872234+0000","last_fullsized":"2024-04-18T21:05:43.872234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871518+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:43.871518+0000","last_peered":"2024-04-18T21:05:43.871518+0000","last_clean":"2024-04-18T21:05:43.871518+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:43.871518+0000","last_undegraded":"2024-04-18T21:05:43.871518+0000","last_fullsized":"2024-04-18T21:05:43.871518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872572+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:43.872572+0000","last_peered":"2024-04-18T21:05:43.872572+0000","last_clean":"2024-04-18T21:05:43.872572+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:43.872572+0000","last_undegraded":"2024-04-18T21:05:43.872572+0000","last_fullsized":"2024-04-18T21:05:43.872572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870640+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:43.870640+0000","last_peered":"2024-04-18T21:05:43.870640+0000","last_clean":"2024-04-18T21:05:43.870640+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:43.870640+0000","last_undegraded":"2024-04-18T21:05:43.870640+0000","last_fullsized":"2024-04-18T21:05:43.870640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872133+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:43.872133+0000","last_peered":"2024-04-18T21:05:43.872133+0000","last_clean":"2024-04-18T21:05:43.872133+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:43.872133+0000","last_undegraded":"2024-04-18T21:05:43.872133+0000","last_fullsized":"2024-04-18T21:05:43.872133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868624+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:43.868624+0000","last_peered":"2024-04-18T21:05:43.868624+0000","last_clean":"2024-04-18T21:05:43.868624+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:43.868624+0000","last_undegraded":"2024-04-18T21:05:43.868624+0000","last_fullsized":"2024-04-18T21:05:43.868624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869822+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:43.869822+0000","last_peered":"2024-04-18T21:05:43.869822+0000","last_clean":"2024-04-18T21:05:43.869822+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:43.869822+0000","last_undegraded":"2024-04-18T21:05:43.869822+0000","last_fullsized":"2024-04-18T21:05:43.869822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870208+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:43.870208+0000","last_peered":"2024-04-18T21:05:43.870208+0000","last_clean":"2024-04-18T21:05:43.870208+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:43.870208+0000","last_undegraded":"2024-04-18T21:05:43.870208+0000","last_fullsized":"2024-04-18T21:05:43.870208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.873134+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:43.873134+0000","last_peered":"2024-04-18T21:05:43.873134+0000","last_clean":"2024-04-18T21:05:43.873134+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:43.873134+0000","last_undegraded":"2024-04-18T21:05:43.873134+0000","last_fullsized":"2024-04-18T21:05:43.873134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870458+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:43.870458+0000","last_peered":"2024-04-18T21:05:43.870458+0000","last_clean":"2024-04-18T21:05:43.870458+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:43.870458+0000","last_undegraded":"2024-04-18T21:05:43.870458+0000","last_fullsized":"2024-04-18T21:05:43.870458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869860+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:43.869860+0000","last_peered":"2024-04-18T21:05:43.869860+0000","last_clean":"2024-04-18T21:05:43.869860+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:43.869860+0000","last_undegraded":"2024-04-18T21:05:43.869860+0000","last_fullsized":"2024-04-18T21:05:43.869860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869105+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:43.869105+0000","last_peered":"2024-04-18T21:05:43.869105+0000","last_clean":"2024-04-18T21:05:43.869105+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:43.869105+0000","last_undegraded":"2024-04-18T21:05:43.869105+0000","last_fullsized":"2024-04-18T21:05:43.869105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869648+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:43.869648+0000","last_peered":"2024-04-18T21:05:43.869648+0000","last_clean":"2024-04-18T21:05:43.869648+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:43.869648+0000","last_undegraded":"2024-04-18T21:05:43.869648+0000","last_fullsized":"2024-04-18T21:05:43.869648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872390+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:43.872390+0000","last_peered":"2024-04-18T21:05:43.872390+0000","last_clean":"2024-04-18T21:05:43.872390+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:43.872390+0000","last_undegraded":"2024-04-18T21:05:43.872390+0000","last_fullsized":"2024-04-18T21:05:43.872390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872760+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:43.872760+0000","last_peered":"2024-04-18T21:05:43.872760+0000","last_clean":"2024-04-18T21:05:43.872760+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:43.872760+0000","last_undegraded":"2024-04-18T21:05:43.872760+0000","last_fullsized":"2024-04-18T21:05:43.872760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869065+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:43.869065+0000","last_peered":"2024-04-18T21:05:43.869065+0000","last_clean":"2024-04-18T21:05:43.869065+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:43.869065+0000","last_undegraded":"2024-04-18T21:05:43.869065+0000","last_fullsized":"2024-04-18T21:05:43.869065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869030+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:43.869030+0000","last_peered":"2024-04-18T21:05:43.869030+0000","last_clean":"2024-04-18T21:05:43.869030+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:43.869030+0000","last_undegraded":"2024-04-18T21:05:43.869030+0000","last_fullsized":"2024-04-18T21:05:43.869030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869709+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:43.869709+0000","last_peered":"2024-04-18T21:05:43.869709+0000","last_clean":"2024-04-18T21:05:43.869709+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:43.869709+0000","last_undegraded":"2024-04-18T21:05:43.869709+0000","last_fullsized":"2024-04-18T21:05:43.869709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870703+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:43.870703+0000","last_peered":"2024-04-18T21:05:43.870703+0000","last_clean":"2024-04-18T21:05:43.870703+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:43.870703+0000","last_undegraded":"2024-04-18T21:05:43.870703+0000","last_fullsized":"2024-04-18T21:05:43.870703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869806+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:43.869806+0000","last_peered":"2024-04-18T21:05:43.869806+0000","last_clean":"2024-04-18T21:05:43.869806+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:43.869806+0000","last_undegraded":"2024-04-18T21:05:43.869806+0000","last_fullsized":"2024-04-18T21:05:43.869806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870371+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:43.870371+0000","last_peered":"2024-04-18T21:05:43.870371+0000","last_clean":"2024-04-18T21:05:43.870371+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:43.870371+0000","last_undegraded":"2024-04-18T21:05:43.870371+0000","last_fullsized":"2024-04-18T21:05:43.870371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872814+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:43.872814+0000","last_peered":"2024-04-18T21:05:43.872814+0000","last_clean":"2024-04-18T21:05:43.872814+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:43.872814+0000","last_undegraded":"2024-04-18T21:05:43.872814+0000","last_fullsized":"2024-04-18T21:05:43.872814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868853+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:43.868853+0000","last_peered":"2024-04-18T21:05:43.868853+0000","last_clean":"2024-04-18T21:05:43.868853+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:43.868853+0000","last_undegraded":"2024-04-18T21:05:43.868853+0000","last_fullsized":"2024-04-18T21:05:43.868853+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869333+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:43.869333+0000","last_peered":"2024-04-18T21:05:43.869333+0000","last_clean":"2024-04-18T21:05:43.869333+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:43.869333+0000","last_undegraded":"2024-04-18T21:05:43.869333+0000","last_fullsized":"2024-04-18T21:05:43.869333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872114+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:43.872114+0000","last_peered":"2024-04-18T21:05:43.872114+0000","last_clean":"2024-04-18T21:05:43.872114+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:43.872114+0000","last_undegraded":"2024-04-18T21:05:43.872114+0000","last_fullsized":"2024-04-18T21:05:43.872114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869710+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:43.869710+0000","last_peered":"2024-04-18T21:05:43.869710+0000","last_clean":"2024-04-18T21:05:43.869710+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:43.869710+0000","last_undegraded":"2024-04-18T21:05:43.869710+0000","last_fullsized":"2024-04-18T21:05:43.869710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868775+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:43.868775+0000","last_peered":"2024-04-18T21:05:43.868775+0000","last_clean":"2024-04-18T21:05:43.868775+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:43.868775+0000","last_undegraded":"2024-04-18T21:05:43.868775+0000","last_fullsized":"2024-04-18T21:05:43.868775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870991+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:43.870991+0000","last_peered":"2024-04-18T21:05:43.870991+0000","last_clean":"2024-04-18T21:05:43.870991+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:43.870991+0000","last_undegraded":"2024-04-18T21:05:43.870991+0000","last_fullsized":"2024-04-18T21:05:43.870991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.873041+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:43.873041+0000","last_peered":"2024-04-18T21:05:43.873041+0000","last_clean":"2024-04-18T21:05:43.873041+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:43.873041+0000","last_undegraded":"2024-04-18T21:05:43.873041+0000","last_fullsized":"2024-04-18T21:05:43.873041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871253+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:43.871253+0000","last_peered":"2024-04-18T21:05:43.871253+0000","last_clean":"2024-04-18T21:05:43.871253+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:43.871253+0000","last_undegraded":"2024-04-18T21:05:43.871253+0000","last_fullsized":"2024-04-18T21:05:43.871253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870501+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:43.870501+0000","last_peered":"2024-04-18T21:05:43.870501+0000","last_clean":"2024-04-18T21:05:43.870501+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:43.870501+0000","last_undegraded":"2024-04-18T21:05:43.870501+0000","last_fullsized":"2024-04-18T21:05:43.870501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872380+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:43.872380+0000","last_peered":"2024-04-18T21:05:43.872380+0000","last_clean":"2024-04-18T21:05:43.872380+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:43.872380+0000","last_undegraded":"2024-04-18T21:05:43.872380+0000","last_fullsized":"2024-04-18T21:05:43.872380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869133+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:43.869133+0000","last_peered":"2024-04-18T21:05:43.869133+0000","last_clean":"2024-04-18T21:05:43.869133+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:43.869133+0000","last_undegraded":"2024-04-18T21:05:43.869133+0000","last_fullsized":"2024-04-18T21:05:43.869133+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869294+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:43.869294+0000","last_peered":"2024-04-18T21:05:43.869294+0000","last_clean":"2024-04-18T21:05:43.869294+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:43.869294+0000","last_undegraded":"2024-04-18T21:05:43.869294+0000","last_fullsized":"2024-04-18T21:05:43.869294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872330+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:43.872330+0000","last_peered":"2024-04-18T21:05:43.872330+0000","last_clean":"2024-04-18T21:05:43.872330+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:43.872330+0000","last_undegraded":"2024-04-18T21:05:43.872330+0000","last_fullsized":"2024-04-18T21:05:43.872330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869869+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:43.869869+0000","last_peered":"2024-04-18T21:05:43.869869+0000","last_clean":"2024-04-18T21:05:43.869869+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:43.869869+0000","last_undegraded":"2024-04-18T21:05:43.869869+0000","last_fullsized":"2024-04-18T21:05:43.869869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872592+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:43.872592+0000","last_peered":"2024-04-18T21:05:43.872592+0000","last_clean":"2024-04-18T21:05:43.872592+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:43.872592+0000","last_undegraded":"2024-04-18T21:05:43.872592+0000","last_fullsized":"2024-04-18T21:05:43.872592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870902+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:43.870902+0000","last_peered":"2024-04-18T21:05:43.870902+0000","last_clean":"2024-04-18T21:05:43.870902+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:43.870902+0000","last_undegraded":"2024-04-18T21:05:43.870902+0000","last_fullsized":"2024-04-18T21:05:43.870902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872392+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:43.872392+0000","last_peered":"2024-04-18T21:05:43.872392+0000","last_clean":"2024-04-18T21:05:43.872392+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:43.872392+0000","last_undegraded":"2024-04-18T21:05:43.872392+0000","last_fullsized":"2024-04-18T21:05:43.872392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872954+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:43.872954+0000","last_peered":"2024-04-18T21:05:43.872954+0000","last_clean":"2024-04-18T21:05:43.872954+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:43.872954+0000","last_undegraded":"2024-04-18T21:05:43.872954+0000","last_fullsized":"2024-04-18T21:05:43.872954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870971+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:43.870971+0000","last_peered":"2024-04-18T21:05:43.870971+0000","last_clean":"2024-04-18T21:05:43.870971+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:43.870971+0000","last_undegraded":"2024-04-18T21:05:43.870971+0000","last_fullsized":"2024-04-18T21:05:43.870971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.873206+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:43.873206+0000","last_peered":"2024-04-18T21:05:43.873206+0000","last_clean":"2024-04-18T21:05:43.873206+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:43.873206+0000","last_undegraded":"2024-04-18T21:05:43.873206+0000","last_fullsized":"2024-04-18T21:05:43.873206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872830+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:43.872830+0000","last_peered":"2024-04-18T21:05:43.872830+0000","last_clean":"2024-04-18T21:05:43.872830+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:43.872830+0000","last_undegraded":"2024-04-18T21:05:43.872830+0000","last_fullsized":"2024-04-18T21:05:43.872830+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870634+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:43.870634+0000","last_peered":"2024-04-18T21:05:43.870634+0000","last_clean":"2024-04-18T21:05:43.870634+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:43.870634+0000","last_undegraded":"2024-04-18T21:05:43.870634+0000","last_fullsized":"2024-04-18T21:05:43.870634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872778+0000","last_change":"2024-04-18T21:05:07.590201+0000","last_active":"2024-04-18T21:05:43.872778+0000","last_peered":"2024-04-18T21:05:43.872778+0000","last_clean":"2024-04-18T21:05:43.872778+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:43.872778+0000","last_undegraded":"2024-04-18T21:05:43.872778+0000","last_fullsized":"2024-04-18T21:05:43.872778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:27.593818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869841+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:43.869841+0000","last_peered":"2024-04-18T21:05:43.869841+0000","last_clean":"2024-04-18T21:05:43.869841+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:43.869841+0000","last_undegraded":"2024-04-18T21:05:43.869841+0000","last_fullsized":"2024-04-18T21:05:43.869841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870379+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:43.870379+0000","last_peered":"2024-04-18T21:05:43.870379+0000","last_clean":"2024-04-18T21:05:43.870379+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:43.870379+0000","last_undegraded":"2024-04-18T21:05:43.870379+0000","last_fullsized":"2024-04-18T21:05:43.870379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869058+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:43.869058+0000","last_peered":"2024-04-18T21:05:43.869058+0000","last_clean":"2024-04-18T21:05:43.869058+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:43.869058+0000","last_undegraded":"2024-04-18T21:05:43.869058+0000","last_fullsized":"2024-04-18T21:05:43.869058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869499+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:43.869499+0000","last_peered":"2024-04-18T21:05:43.869499+0000","last_clean":"2024-04-18T21:05:43.869499+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:43.869499+0000","last_undegraded":"2024-04-18T21:05:43.869499+0000","last_fullsized":"2024-04-18T21:05:43.869499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870813+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:43.870813+0000","last_peered":"2024-04-18T21:05:43.870813+0000","last_clean":"2024-04-18T21:05:43.870813+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:43.870813+0000","last_undegraded":"2024-04-18T21:05:43.870813+0000","last_fullsized":"2024-04-18T21:05:43.870813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872716+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:43.872716+0000","last_peered":"2024-04-18T21:05:43.872716+0000","last_clean":"2024-04-18T21:05:43.872716+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:43.872716+0000","last_undegraded":"2024-04-18T21:05:43.872716+0000","last_fullsized":"2024-04-18T21:05:43.872716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.869939+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:43.869939+0000","last_peered":"2024-04-18T21:05:43.869939+0000","last_clean":"2024-04-18T21:05:43.869939+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:43.869939+0000","last_undegraded":"2024-04-18T21:05:43.869939+0000","last_fullsized":"2024-04-18T21:05:43.869939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870625+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:43.870625+0000","last_peered":"2024-04-18T21:05:43.870625+0000","last_clean":"2024-04-18T21:05:43.870625+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:43.870625+0000","last_undegraded":"2024-04-18T21:05:43.870625+0000","last_fullsized":"2024-04-18T21:05:43.870625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.873037+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:43.873037+0000","last_peered":"2024-04-18T21:05:43.873037+0000","last_clean":"2024-04-18T21:05:43.873037+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:43.873037+0000","last_undegraded":"2024-04-18T21:05:43.873037+0000","last_fullsized":"2024-04-18T21:05:43.873037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870537+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:43.870537+0000","last_peered":"2024-04-18T21:05:43.870537+0000","last_clean":"2024-04-18T21:05:43.870537+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:43.870537+0000","last_undegraded":"2024-04-18T21:05:43.870537+0000","last_fullsized":"2024-04-18T21:05:43.870537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.873236+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:43.873236+0000","last_peered":"2024-04-18T21:05:43.873236+0000","last_clean":"2024-04-18T21:05:43.873236+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:43.873236+0000","last_undegraded":"2024-04-18T21:05:43.873236+0000","last_fullsized":"2024-04-18T21:05:43.873236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870918+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:43.870918+0000","last_peered":"2024-04-18T21:05:43.870918+0000","last_clean":"2024-04-18T21:05:43.870918+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:43.870918+0000","last_undegraded":"2024-04-18T21:05:43.870918+0000","last_fullsized":"2024-04-18T21:05:43.870918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872287+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:43.872287+0000","last_peered":"2024-04-18T21:05:43.872287+0000","last_clean":"2024-04-18T21:05:43.872287+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:43.872287+0000","last_undegraded":"2024-04-18T21:05:43.872287+0000","last_fullsized":"2024-04-18T21:05:43.872287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.870887+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:43.870887+0000","last_peered":"2024-04-18T21:05:43.870887+0000","last_clean":"2024-04-18T21:05:43.870887+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:43.870887+0000","last_undegraded":"2024-04-18T21:05:43.870887+0000","last_fullsized":"2024-04-18T21:05:43.870887+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872095+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:43.872095+0000","last_peered":"2024-04-18T21:05:43.872095+0000","last_clean":"2024-04-18T21:05:43.872095+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:43.872095+0000","last_undegraded":"2024-04-18T21:05:43.872095+0000","last_fullsized":"2024-04-18T21:05:43.872095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871377+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:43.871377+0000","last_peered":"2024-04-18T21:05:43.871377+0000","last_clean":"2024-04-18T21:05:43.871377+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:43.871377+0000","last_undegraded":"2024-04-18T21:05:43.871377+0000","last_fullsized":"2024-04-18T21:05:43.871377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871937+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:43.871937+0000","last_peered":"2024-04-18T21:05:43.871937+0000","last_clean":"2024-04-18T21:05:43.871937+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:43.871937+0000","last_undegraded":"2024-04-18T21:05:43.871937+0000","last_fullsized":"2024-04-18T21:05:43.871937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871240+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:43.871240+0000","last_peered":"2024-04-18T21:05:43.871240+0000","last_clean":"2024-04-18T21:05:43.871240+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:43.871240+0000","last_undegraded":"2024-04-18T21:05:43.871240+0000","last_fullsized":"2024-04-18T21:05:43.871240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868903+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:43.868903+0000","last_peered":"2024-04-18T21:05:43.868903+0000","last_clean":"2024-04-18T21:05:43.868903+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:43.868903+0000","last_undegraded":"2024-04-18T21:05:43.868903+0000","last_fullsized":"2024-04-18T21:05:43.868903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.881788+0000","last_change":"2024-04-18T21:05:43.881788+0000","last_active":"2024-04-18T21:05:43.881788+0000","last_peered":"2024-04-18T21:05:43.881788+0000","last_clean":"2024-04-18T21:05:43.881788+0000","last_became_active":"2024-04-18T21:05:43.876120+0000","last_became_peered":"2024-04-18T21:05:43.876120+0000","last_unstale":"2024-04-18T21:05:43.881788+0000","last_undegraded":"2024-04-18T21:05:43.881788+0000","last_fullsized":"2024-04-18T21:05:43.881788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:35:01.546433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868957+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:43.868957+0000","last_peered":"2024-04-18T21:05:43.868957+0000","last_clean":"2024-04-18T21:05:43.868957+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:43.868957+0000","last_undegraded":"2024-04-18T21:05:43.868957+0000","last_fullsized":"2024-04-18T21:05:43.868957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872391+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:43.872391+0000","last_peered":"2024-04-18T21:05:43.872391+0000","last_clean":"2024-04-18T21:05:43.872391+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:43.872391+0000","last_undegraded":"2024-04-18T21:05:43.872391+0000","last_fullsized":"2024-04-18T21:05:43.872391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.871141+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:43.871141+0000","last_peered":"2024-04-18T21:05:43.871141+0000","last_clean":"2024-04-18T21:05:43.871141+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:43.871141+0000","last_undegraded":"2024-04-18T21:05:43.871141+0000","last_fullsized":"2024-04-18T21:05:43.871141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872506+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:43.872506+0000","last_peered":"2024-04-18T21:05:43.872506+0000","last_clean":"2024-04-18T21:05:43.872506+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:43.872506+0000","last_undegraded":"2024-04-18T21:05:43.872506+0000","last_fullsized":"2024-04-18T21:05:43.872506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.868711+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:43.868711+0000","last_peered":"2024-04-18T21:05:43.868711+0000","last_clean":"2024-04-18T21:05:43.868711+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:43.868711+0000","last_undegraded":"2024-04-18T21:05:43.868711+0000","last_fullsized":"2024-04-18T21:05:43.868711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T21:05:43.872634+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:43.872634+0000","last_peered":"2024-04-18T21:05:43.872634+0000","last_clean":"2024-04-18T21:05:43.872634+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:43.872634+0000","last_undegraded":"2024-04-18T21:05:43.872634+0000","last_fullsized":"2024-04-18T21:05:43.872634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":686006,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":89519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738382,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":686622,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:48.576 INFO:tasks.thrashosds.thrasher:Setting 3.6 to [2, 1] 2024-04-18T21:05:48.576 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.6', '2', '1'] 2024-04-18T21:05:48.576 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.6 2 1 2024-04-18T21:05:48.597 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:48.598+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:48.605 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.605 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:48.650 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:48.699 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:48.700+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:48.741 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.741 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:48.799 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:48.800 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:48.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:48.808+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:48.816 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:48.816 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:48.835 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:48.835 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:05:48.883 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:48.883 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:48.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.289120644999997, 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:48.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:48.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.289019637999999, 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:48.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:48.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:48.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.288918664999997, 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:48.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:48.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:48.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:48.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.288234658999997, 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.288144881999997, 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.905 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:48.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:48.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.287998883, 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.287904282, 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:48.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.919 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.287799339000003, 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:48.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:48.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.287724388000001, 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:48.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.280390326999999, 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.276242273999998, 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.931 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:48.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:48.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.276133637999997, 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:48.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:48.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.275999908000003, 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:48.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.275854909000003, 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.267952381999997, 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:48.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.267696829999998, 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.267640989, 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.293313713000003, 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.290782337000003, 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.288447875999999, 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:48.973 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:48.975 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:48.976 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:48.974+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:49.076 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:49.076+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:49.107 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:49.108 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:49.121 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:49.211 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:49.212+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:49.277 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:49.278+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:49.287 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:49.287 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:49.287 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:49.287 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:49.287 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:49.302 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:49.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:49.380+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.872299646999998, 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.469 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:49.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:49.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:49.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.872178646000002, 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:49.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.872105732000001, 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:49.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:49.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.872036219000002, 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:49.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:49.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.489 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.872001296999997, 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:49.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:49.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.871956318000002, 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.495 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:49.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:49.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.871890946999997, 2024-04-18T21:05:49.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:49.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:49.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:49.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.505 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.871841558, 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:49.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.509 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.871787349000002, 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:49.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:49.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:49.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.860009785000003, 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.513 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:49.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:49.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:49.516 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.859774588000001, 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.859308171999999, 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:49.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:49.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.859048985000001, 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.858891429000003, 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:49.528 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:49.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.858806901000001, 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.858490848000002, 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.536 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:49.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:49.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.856524344999997, 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.540 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:49.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:49.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.856409593999999, 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:49.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:49.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.854412668000002, 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:49.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:49.551 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.853706301000003, 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:49.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:49.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:49.556 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:49.556 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:49.557 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:49.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:49.556+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:49.658 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:49.658+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:49.690 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:49.690 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:49.690 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:49.690 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:49.704 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:49.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:49.760+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:49.860 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:49.858+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:49.869 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:49.870 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:49.870 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:49.884 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:49.891 INFO:teuthology.orchestra.run.smithi096.stderr:set 3.6 pg_upmap mapping to [2,1] 2024-04-18T21:05:49.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:49.960+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:50.052 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:50.052 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.922794492000001, 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:50.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.922760920000002, 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:50.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:50.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.922728657, 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.064 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:50.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:50.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:50.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:50.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.922613106, 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:50.069 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:50.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:50.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.075 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.075 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:50.075 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.455179180999998, 2024-04-18T21:05:50.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:50.077 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.077 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.077 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.077 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:50.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.082 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.455066057000003, 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:50.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454986974999997, 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.093 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454883770999999, 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:50.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454793999000003, 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.099 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.104 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454707960999997, 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:50.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:50.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:50.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:50.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:50.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454643875999999, 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.110 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:50.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454558278, 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:50.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454492084999998, 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:50.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454422706999999, 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.125 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:50.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:50.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:50.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:50.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454260003999998, 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.130 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:50.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454109039999999, 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.135 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:50.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:50.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:50.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.454059530999999, 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.140 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.453994268999999, 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.145 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:50.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.453860089000003, 2024-04-18T21:05:50.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:50.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:50.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.453756624, 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:50.155 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:50.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:50.159 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:50.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:50.160 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:50.158+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:50.261 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:50.260+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:50.295 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:50.295 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:50.295 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:50.295 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:50.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:50.362 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:50.362+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:50.432 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:50.432 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:50.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:50.463 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:50.462+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:50.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:50.564+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.978942564999997, 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.978841557999999, 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.978740584999997, 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.978056578999997, 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.977966801999997, 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.977820803, 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.977726201999999, 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.977621259000003, 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.977546308000001, 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.970212246999999, 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.966064193999998, 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.965955557999997, 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.965821828000003, 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.965676829000003, 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.957774301999997, 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.957518749999998, 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.957462909, 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.983135633000003, 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.980604257000003, 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.978269795999999, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:50.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:50.665 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:50.664+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:50.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:50.764+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:50.794 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:50.794 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:50.794 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:50.794 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:50.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:50.851 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:50.866 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:50.866+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:50.934 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:50.934 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:50.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:50.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:50.968+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:50.976 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:05:51.010 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:51.010 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:51.030 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:51.030 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:51.049 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:51.049 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:51.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:51.068+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:51.072 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:51.072 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:51.086 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:51.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:51.168+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:51.232 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:51.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:51.268+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:51.353 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:51.354 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:51.367 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:51.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:51.372+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:51.470 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:51.468+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:51.487 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:51.487 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:51.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:51.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:51.572+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:51.632 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:51.632 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:51.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:51.672 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:51.670+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:51.772 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:51.770+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:51.814 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:51.814 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:51.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:51.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:51.876+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:51.908 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:05:51.953 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:51.953 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:51.968 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:52.015 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:52.016+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:52.076 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:52.076+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:52.100 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.100 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:52.177 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:52.174+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:52.278 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:52.278+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.296 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:52.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:52.380+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.427 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:52.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:52.480+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:52.559 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.560 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.573 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:52.581 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:52.580+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:52.682 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:52.682+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:52.697 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.697 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.711 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:52.801 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:52.802+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:52.879 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.879 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.884 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:52.882+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:52.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:52.985 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:52.984+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:53.030 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.030 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:53.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:53.086 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:53.088+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:53.161 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.161 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.177 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:53.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:53.222 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:53.226 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:53.228+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:53.239 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:53.240 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:53.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:53.260 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:53.287 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:53.290+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.707516147, 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.307 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.707415140000002, 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:53.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:53.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:53.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.707314167, 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.706630161, 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.318 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:53.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:53.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.706540384, 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:53.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:53.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:53.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:53.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.706394385000003, 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:53.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.706299784000002, 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:53.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:53.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:53.337 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.706194840999999, 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.706119889999997, 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.341 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:53.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.698785829000002, 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.694637776, 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.69452914, 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.694395409999998, 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.694250410999999, 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.686347884, 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.686092332000001, 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.686036491000003, 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.711709214999999, 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.709177838999999, 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.706843377999999, 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:53.390 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:53.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:53.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:53.392+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:53.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:53.492+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:53.523 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:53.523 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:53.523 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:53.523 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:53.537 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:53.592 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:53.591+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:53.657 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:53.657 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:53.657 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:53.657 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:53.658 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:53.671 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:53.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:53.692+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:53.793 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:53.794+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:53.842 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.244297924000001, 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.244176922999998, 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.244104008999997, 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.244034495999998, 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.243999574, 2024-04-18T21:05:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.243954594999998, 2024-04-18T21:05:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.243889224, 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.243839835000003, 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.243785625999998, 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.232008061999998, 2024-04-18T21:05:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.231772865000003, 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.231306449000002, 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.231047261999997, 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.230889705999999, 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:53.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:53.905 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.230805177999997, 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:53.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.230489124999998, 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.228522622, 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.914 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:53.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:53.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.228407871000002, 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.918 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:53.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:53.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:53.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.226410944999998, 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.922 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:53.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:53.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:53.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 45.225704577999998, 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:53.926 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:53.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:53.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:53.930 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:53.932 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:53.931+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:53.932 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:53.932 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:05:54.032 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:54.031+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:54.063 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:54.063 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:54.063 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:54.063 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:54.078 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:54.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:54.136+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:54.195 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:54.195 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:54.196 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:54.196 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:54.196 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:54.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:54.253 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:54.253+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:54.332 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:54.332 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:54.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.202525072999997, 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.202491500999997, 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.202459238000003, 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.202343687000003, 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:54.354 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734909762000001, 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:54.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.359 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734796637999999, 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:54.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:54.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:54.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:54.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734717556, 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:54.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.369 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734614352000001, 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:54.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:54.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:54.374 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734524579999999, 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:54.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:54.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:54.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:54.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.380 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734438541999999, 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.385 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734374457000001, 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:54.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734288859000003, 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:54.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734222666000001, 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.734153288000002, 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.733990585000001, 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.733839621000001, 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:54.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.733790112000001, 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.416 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.733724850000002, 2024-04-18T21:05:54.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:54.426 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.733590669999998, 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:54.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:54.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.733487205000003, 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:54.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:54.435 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:54.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:54.437 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:54.433+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:54.537 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:54.539+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:54.569 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:54.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:54.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:54.636+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:54.706 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:54.706 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:54.706 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:54.706 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:54.706 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:54.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:54.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:54.768+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:54.839 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:54.837+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.295319986000003, 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:54.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:54.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.295218978999998, 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:54.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:54.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:54.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:54.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.295118006000003, 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:54.900 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.294434000000003, 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:54.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.294344223000003, 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:54.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:54.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.294198223999999, 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:54.916 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:54.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.294103622999998, 2024-04-18T21:05:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.293998680000001, 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:54.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:54.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.293923728999999, 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:54.929 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:54.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.286589667999998, 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.282441615000003, 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.282332979000003, 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.282199249000001, 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:54.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:54.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.282054250000002, 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:54.949 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:54.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:54.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.274151723000003, 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.273896170999997, 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:54.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.273840329999999, 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.299513054000002, 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:54.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:54.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:54.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.296981678000002, 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:54.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:54.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:54.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.973 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.294647217000001, 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:54.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:54.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:54.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:54.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:54.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:54.979 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:54.979 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:54.979 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:54.979 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:05:54.979 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:05:54.982 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:05:54.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:54.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:54.980+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:55.082 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:55.079+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:55.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:55.218 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:55.219+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:55.277 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:55.284 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:55.285+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:55.294 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:55.294 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:55.294 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:55.294 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:55.294 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:55.308 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:55.312 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 32, 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:05:54.920396+0000", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5804032, 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "nodeep-scrub", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:05:55.313 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.314 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:55.315 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.316 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:55.317 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:55.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.319 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.320 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:05:55.321 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:55.322 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:55.323 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:55.324 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:05:55.325 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:55.326 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:55.327 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:55.328 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:55.329 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:55.330 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:05:55.331 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.0299999713897705, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.0299999713897705, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.332 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:05:55.333 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:55.334 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:05:55.335 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:55.336 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:55.337 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:05:55.338 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 25, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.341 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:55.343 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.344 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.347 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:55.348 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 29, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.350 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:05:55.351 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:05:55.352 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:05:55.353 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:05:55.355 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.6", 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: 2, 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.1c", 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:05:55.357 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:05:55.358 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:05:55.359 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:05:55.359 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:05:55.359 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:05:55.359 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:05:55.359 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:05:55.359 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:05:55.360 INFO:tasks.thrashosds.thrasher:j is {'epoch': 32, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:05:54.920396+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 25, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 29, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.6', 'osds': [2, 1]}, {'pgid': '3.1c', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:05:55.361 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:55.407 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:55.407+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:55.414 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:55.415 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:55.451 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:55.451 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:55.485 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:55.485 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:55.485 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:55.485 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:55.483+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:55.486 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:55.499 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:55.586 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:55.585+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:55.647 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:55.687 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:55.687+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:55.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:05:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:05:55.754 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-18T21:05:55.619032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90296,"kb_used_data":912,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025224,"statfs":{"total":289910292480,"available":289817829376,"internally_reserved":0,"allocated":933888,"data_stored":1496191,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.728869"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.896572+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:05:49.896572+0000","last_peered":"2024-04-18T21:05:49.896572+0000","last_clean":"2024-04-18T21:05:49.896572+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:05:49.896572+0000","last_undegraded":"2024-04-18T21:05:49.896572+0000","last_fullsized":"2024-04-18T21:05:49.896572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.896659+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:05:49.896659+0000","last_peered":"2024-04-18T21:05:49.896659+0000","last_clean":"2024-04-18T21:05:49.896659+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:05:49.896659+0000","last_undegraded":"2024-04-18T21:05:49.896659+0000","last_fullsized":"2024-04-18T21:05:49.896659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893388+0000","last_change":"2024-04-18T21:05:08.611588+0000","last_active":"2024-04-18T21:05:49.893388+0000","last_peered":"2024-04-18T21:05:49.893388+0000","last_clean":"2024-04-18T21:05:49.893388+0000","last_became_active":"2024-04-18T21:05:08.604011+0000","last_became_peered":"2024-04-18T21:05:08.604011+0000","last_unstale":"2024-04-18T21:05:49.893388+0000","last_undegraded":"2024-04-18T21:05:49.893388+0000","last_fullsized":"2024-04-18T21:05:49.893388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892948+0000","last_change":"2024-04-18T21:05:08.613807+0000","last_active":"2024-04-18T21:05:49.892948+0000","last_peered":"2024-04-18T21:05:49.892948+0000","last_clean":"2024-04-18T21:05:49.892948+0000","last_became_active":"2024-04-18T21:05:08.608164+0000","last_became_peered":"2024-04-18T21:05:08.608164+0000","last_unstale":"2024-04-18T21:05:49.892948+0000","last_undegraded":"2024-04-18T21:05:49.892948+0000","last_fullsized":"2024-04-18T21:05:49.892948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:41:10.708967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894096+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:05:49.894096+0000","last_peered":"2024-04-18T21:05:49.894096+0000","last_clean":"2024-04-18T21:05:49.894096+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:05:49.894096+0000","last_undegraded":"2024-04-18T21:05:49.894096+0000","last_fullsized":"2024-04-18T21:05:49.894096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892665+0000","last_change":"2024-04-18T21:05:08.608512+0000","last_active":"2024-04-18T21:05:49.892665+0000","last_peered":"2024-04-18T21:05:49.892665+0000","last_clean":"2024-04-18T21:05:49.892665+0000","last_became_active":"2024-04-18T21:05:08.606773+0000","last_became_peered":"2024-04-18T21:05:08.606773+0000","last_unstale":"2024-04-18T21:05:49.892665+0000","last_undegraded":"2024-04-18T21:05:49.892665+0000","last_fullsized":"2024-04-18T21:05:49.892665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892929+0000","last_change":"2024-04-18T21:05:08.597092+0000","last_active":"2024-04-18T21:05:49.892929+0000","last_peered":"2024-04-18T21:05:49.892929+0000","last_clean":"2024-04-18T21:05:49.892929+0000","last_became_active":"2024-04-18T21:05:08.596007+0000","last_became_peered":"2024-04-18T21:05:08.596007+0000","last_unstale":"2024-04-18T21:05:49.892929+0000","last_undegraded":"2024-04-18T21:05:49.892929+0000","last_fullsized":"2024-04-18T21:05:49.892929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892365+0000","last_change":"2024-04-18T21:05:08.611071+0000","last_active":"2024-04-18T21:05:49.892365+0000","last_peered":"2024-04-18T21:05:49.892365+0000","last_clean":"2024-04-18T21:05:49.892365+0000","last_became_active":"2024-04-18T21:05:08.608733+0000","last_became_peered":"2024-04-18T21:05:08.608733+0000","last_unstale":"2024-04-18T21:05:49.892365+0000","last_undegraded":"2024-04-18T21:05:49.892365+0000","last_fullsized":"2024-04-18T21:05:49.892365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894425+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:05:49.894425+0000","last_peered":"2024-04-18T21:05:49.894425+0000","last_clean":"2024-04-18T21:05:49.894425+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:05:49.894425+0000","last_undegraded":"2024-04-18T21:05:49.894425+0000","last_fullsized":"2024-04-18T21:05:49.894425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.896710+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:05:49.896710+0000","last_peered":"2024-04-18T21:05:49.896710+0000","last_clean":"2024-04-18T21:05:49.896710+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:05:49.896710+0000","last_undegraded":"2024-04-18T21:05:49.896710+0000","last_fullsized":"2024-04-18T21:05:49.896710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893478+0000","last_change":"2024-04-18T21:05:08.613053+0000","last_active":"2024-04-18T21:05:49.893478+0000","last_peered":"2024-04-18T21:05:49.893478+0000","last_clean":"2024-04-18T21:05:49.893478+0000","last_became_active":"2024-04-18T21:05:08.612136+0000","last_became_peered":"2024-04-18T21:05:08.612136+0000","last_unstale":"2024-04-18T21:05:49.893478+0000","last_undegraded":"2024-04-18T21:05:49.893478+0000","last_fullsized":"2024-04-18T21:05:49.893478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894371+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:05:49.894371+0000","last_peered":"2024-04-18T21:05:49.894371+0000","last_clean":"2024-04-18T21:05:49.894371+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:05:49.894371+0000","last_undegraded":"2024-04-18T21:05:49.894371+0000","last_fullsized":"2024-04-18T21:05:49.894371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893626+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:05:49.893626+0000","last_peered":"2024-04-18T21:05:49.893626+0000","last_clean":"2024-04-18T21:05:49.893626+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:05:49.893626+0000","last_undegraded":"2024-04-18T21:05:49.893626+0000","last_fullsized":"2024-04-18T21:05:49.893626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892728+0000","last_change":"2024-04-18T21:05:08.600975+0000","last_active":"2024-04-18T21:05:49.892728+0000","last_peered":"2024-04-18T21:05:49.892728+0000","last_clean":"2024-04-18T21:05:49.892728+0000","last_became_active":"2024-04-18T21:05:08.600199+0000","last_became_peered":"2024-04-18T21:05:08.600199+0000","last_unstale":"2024-04-18T21:05:49.892728+0000","last_undegraded":"2024-04-18T21:05:49.892728+0000","last_fullsized":"2024-04-18T21:05:49.892728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893015+0000","last_change":"2024-04-18T21:05:08.600815+0000","last_active":"2024-04-18T21:05:49.893015+0000","last_peered":"2024-04-18T21:05:49.893015+0000","last_clean":"2024-04-18T21:05:49.893015+0000","last_became_active":"2024-04-18T21:05:08.599970+0000","last_became_peered":"2024-04-18T21:05:08.599970+0000","last_unstale":"2024-04-18T21:05:49.893015+0000","last_undegraded":"2024-04-18T21:05:49.893015+0000","last_fullsized":"2024-04-18T21:05:49.893015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892432+0000","last_change":"2024-04-18T21:05:08.607016+0000","last_active":"2024-04-18T21:05:49.892432+0000","last_peered":"2024-04-18T21:05:49.892432+0000","last_clean":"2024-04-18T21:05:49.892432+0000","last_became_active":"2024-04-18T21:05:08.604119+0000","last_became_peered":"2024-04-18T21:05:08.604119+0000","last_unstale":"2024-04-18T21:05:49.892432+0000","last_undegraded":"2024-04-18T21:05:49.892432+0000","last_fullsized":"2024-04-18T21:05:49.892432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895861+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:05:49.895861+0000","last_peered":"2024-04-18T21:05:49.895861+0000","last_clean":"2024-04-18T21:05:49.895861+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:05:49.895861+0000","last_undegraded":"2024-04-18T21:05:49.895861+0000","last_fullsized":"2024-04-18T21:05:49.895861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.896916+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:05:49.896916+0000","last_peered":"2024-04-18T21:05:49.896916+0000","last_clean":"2024-04-18T21:05:49.896916+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:05:49.896916+0000","last_undegraded":"2024-04-18T21:05:49.896916+0000","last_fullsized":"2024-04-18T21:05:49.896916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894435+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:05:49.894435+0000","last_peered":"2024-04-18T21:05:49.894435+0000","last_clean":"2024-04-18T21:05:49.894435+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:05:49.894435+0000","last_undegraded":"2024-04-18T21:05:49.894435+0000","last_fullsized":"2024-04-18T21:05:49.894435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893197+0000","last_change":"2024-04-18T21:05:08.612883+0000","last_active":"2024-04-18T21:05:49.893197+0000","last_peered":"2024-04-18T21:05:49.893197+0000","last_clean":"2024-04-18T21:05:49.893197+0000","last_became_active":"2024-04-18T21:05:08.606145+0000","last_became_peered":"2024-04-18T21:05:08.606145+0000","last_unstale":"2024-04-18T21:05:49.893197+0000","last_undegraded":"2024-04-18T21:05:49.893197+0000","last_fullsized":"2024-04-18T21:05:49.893197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:30.365595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893182+0000","last_change":"2024-04-18T21:05:08.608847+0000","last_active":"2024-04-18T21:05:49.893182+0000","last_peered":"2024-04-18T21:05:49.893182+0000","last_clean":"2024-04-18T21:05:49.893182+0000","last_became_active":"2024-04-18T21:05:08.606918+0000","last_became_peered":"2024-04-18T21:05:08.606918+0000","last_unstale":"2024-04-18T21:05:49.893182+0000","last_undegraded":"2024-04-18T21:05:49.893182+0000","last_fullsized":"2024-04-18T21:05:49.893182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:55:44.326395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893281+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:05:49.893281+0000","last_peered":"2024-04-18T21:05:49.893281+0000","last_clean":"2024-04-18T21:05:49.893281+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:05:49.893281+0000","last_undegraded":"2024-04-18T21:05:49.893281+0000","last_fullsized":"2024-04-18T21:05:49.893281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893087+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:05:49.893087+0000","last_peered":"2024-04-18T21:05:49.893087+0000","last_clean":"2024-04-18T21:05:49.893087+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:05:49.893087+0000","last_undegraded":"2024-04-18T21:05:49.893087+0000","last_fullsized":"2024-04-18T21:05:49.893087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892864+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:05:49.892864+0000","last_peered":"2024-04-18T21:05:49.892864+0000","last_clean":"2024-04-18T21:05:49.892864+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:05:49.892864+0000","last_undegraded":"2024-04-18T21:05:49.892864+0000","last_fullsized":"2024-04-18T21:05:49.892864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.896729+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:05:49.896729+0000","last_peered":"2024-04-18T21:05:49.896729+0000","last_clean":"2024-04-18T21:05:49.896729+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:05:49.896729+0000","last_undegraded":"2024-04-18T21:05:49.896729+0000","last_fullsized":"2024-04-18T21:05:49.896729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894775+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:05:49.894775+0000","last_peered":"2024-04-18T21:05:49.894775+0000","last_clean":"2024-04-18T21:05:49.894775+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:05:49.894775+0000","last_undegraded":"2024-04-18T21:05:49.894775+0000","last_fullsized":"2024-04-18T21:05:49.894775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893578+0000","last_change":"2024-04-18T21:05:08.611311+0000","last_active":"2024-04-18T21:05:49.893578+0000","last_peered":"2024-04-18T21:05:49.893578+0000","last_clean":"2024-04-18T21:05:49.893578+0000","last_became_active":"2024-04-18T21:05:08.603027+0000","last_became_peered":"2024-04-18T21:05:08.603027+0000","last_unstale":"2024-04-18T21:05:49.893578+0000","last_undegraded":"2024-04-18T21:05:49.893578+0000","last_fullsized":"2024-04-18T21:05:49.893578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894870+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:05:49.894870+0000","last_peered":"2024-04-18T21:05:49.894870+0000","last_clean":"2024-04-18T21:05:49.894870+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:05:49.894870+0000","last_undegraded":"2024-04-18T21:05:49.894870+0000","last_fullsized":"2024-04-18T21:05:49.894870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894676+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:05:49.894676+0000","last_peered":"2024-04-18T21:05:49.894676+0000","last_clean":"2024-04-18T21:05:49.894676+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:05:49.894676+0000","last_undegraded":"2024-04-18T21:05:49.894676+0000","last_fullsized":"2024-04-18T21:05:49.894676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893758+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:05:49.893758+0000","last_peered":"2024-04-18T21:05:49.893758+0000","last_clean":"2024-04-18T21:05:49.893758+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:05:49.893758+0000","last_undegraded":"2024-04-18T21:05:49.893758+0000","last_fullsized":"2024-04-18T21:05:49.893758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893246+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:05:49.893246+0000","last_peered":"2024-04-18T21:05:49.893246+0000","last_clean":"2024-04-18T21:05:49.893246+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:05:49.893246+0000","last_undegraded":"2024-04-18T21:05:49.893246+0000","last_fullsized":"2024-04-18T21:05:49.893246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892519+0000","last_change":"2024-04-18T21:05:08.605808+0000","last_active":"2024-04-18T21:05:49.892519+0000","last_peered":"2024-04-18T21:05:49.892519+0000","last_clean":"2024-04-18T21:05:49.892519+0000","last_became_active":"2024-04-18T21:05:08.602727+0000","last_became_peered":"2024-04-18T21:05:08.602727+0000","last_unstale":"2024-04-18T21:05:49.892519+0000","last_undegraded":"2024-04-18T21:05:49.892519+0000","last_fullsized":"2024-04-18T21:05:49.892519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894624+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:05:49.894624+0000","last_peered":"2024-04-18T21:05:49.894624+0000","last_clean":"2024-04-18T21:05:49.894624+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:05:49.894624+0000","last_undegraded":"2024-04-18T21:05:49.894624+0000","last_fullsized":"2024-04-18T21:05:49.894624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893243+0000","last_change":"2024-04-18T21:05:07.596786+0000","last_active":"2024-04-18T21:05:49.893243+0000","last_peered":"2024-04-18T21:05:49.893243+0000","last_clean":"2024-04-18T21:05:49.893243+0000","last_became_active":"2024-04-18T21:05:07.595970+0000","last_became_peered":"2024-04-18T21:05:07.595970+0000","last_unstale":"2024-04-18T21:05:49.893243+0000","last_undegraded":"2024-04-18T21:05:49.893243+0000","last_fullsized":"2024-04-18T21:05:49.893243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894991+0000","last_change":"2024-04-18T21:05:08.616648+0000","last_active":"2024-04-18T21:05:49.894991+0000","last_peered":"2024-04-18T21:05:49.894991+0000","last_clean":"2024-04-18T21:05:49.894991+0000","last_became_active":"2024-04-18T21:05:08.612380+0000","last_became_peered":"2024-04-18T21:05:08.612380+0000","last_unstale":"2024-04-18T21:05:49.894991+0000","last_undegraded":"2024-04-18T21:05:49.894991+0000","last_fullsized":"2024-04-18T21:05:49.894991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893971+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:05:49.893971+0000","last_peered":"2024-04-18T21:05:49.893971+0000","last_clean":"2024-04-18T21:05:49.893971+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:05:49.893971+0000","last_undegraded":"2024-04-18T21:05:49.893971+0000","last_fullsized":"2024-04-18T21:05:49.893971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895207+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:05:49.895207+0000","last_peered":"2024-04-18T21:05:49.895207+0000","last_clean":"2024-04-18T21:05:49.895207+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:05:49.895207+0000","last_undegraded":"2024-04-18T21:05:49.895207+0000","last_fullsized":"2024-04-18T21:05:49.895207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893487+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:05:49.893487+0000","last_peered":"2024-04-18T21:05:49.893487+0000","last_clean":"2024-04-18T21:05:49.893487+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:05:49.893487+0000","last_undegraded":"2024-04-18T21:05:49.893487+0000","last_fullsized":"2024-04-18T21:05:49.893487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894708+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:05:49.894708+0000","last_peered":"2024-04-18T21:05:49.894708+0000","last_clean":"2024-04-18T21:05:49.894708+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:05:49.894708+0000","last_undegraded":"2024-04-18T21:05:49.894708+0000","last_fullsized":"2024-04-18T21:05:49.894708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892593+0000","last_change":"2024-04-18T21:05:07.592467+0000","last_active":"2024-04-18T21:05:49.892593+0000","last_peered":"2024-04-18T21:05:49.892593+0000","last_clean":"2024-04-18T21:05:49.892593+0000","last_became_active":"2024-04-18T21:05:07.591625+0000","last_became_peered":"2024-04-18T21:05:07.591625+0000","last_unstale":"2024-04-18T21:05:49.892593+0000","last_undegraded":"2024-04-18T21:05:49.892593+0000","last_fullsized":"2024-04-18T21:05:49.892593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893723+0000","last_change":"2024-04-18T21:05:07.592060+0000","last_active":"2024-04-18T21:05:49.893723+0000","last_peered":"2024-04-18T21:05:49.893723+0000","last_clean":"2024-04-18T21:05:49.893723+0000","last_became_active":"2024-04-18T21:05:07.590905+0000","last_became_peered":"2024-04-18T21:05:07.590905+0000","last_unstale":"2024-04-18T21:05:49.893723+0000","last_undegraded":"2024-04-18T21:05:49.893723+0000","last_fullsized":"2024-04-18T21:05:49.893723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893019+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:05:49.893019+0000","last_peered":"2024-04-18T21:05:49.893019+0000","last_clean":"2024-04-18T21:05:49.893019+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:05:49.893019+0000","last_undegraded":"2024-04-18T21:05:49.893019+0000","last_fullsized":"2024-04-18T21:05:49.893019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.897163+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:05:49.897163+0000","last_peered":"2024-04-18T21:05:49.897163+0000","last_clean":"2024-04-18T21:05:49.897163+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:05:49.897163+0000","last_undegraded":"2024-04-18T21:05:49.897163+0000","last_fullsized":"2024-04-18T21:05:49.897163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893172+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:05:49.893172+0000","last_peered":"2024-04-18T21:05:49.893172+0000","last_clean":"2024-04-18T21:05:49.893172+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:05:49.893172+0000","last_undegraded":"2024-04-18T21:05:49.893172+0000","last_fullsized":"2024-04-18T21:05:49.893172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893769+0000","last_change":"2024-04-18T21:05:07.592097+0000","last_active":"2024-04-18T21:05:49.893769+0000","last_peered":"2024-04-18T21:05:49.893769+0000","last_clean":"2024-04-18T21:05:49.893769+0000","last_became_active":"2024-04-18T21:05:07.591488+0000","last_became_peered":"2024-04-18T21:05:07.591488+0000","last_unstale":"2024-04-18T21:05:49.893769+0000","last_undegraded":"2024-04-18T21:05:49.893769+0000","last_fullsized":"2024-04-18T21:05:49.893769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892783+0000","last_change":"2024-04-18T21:05:08.608325+0000","last_active":"2024-04-18T21:05:49.892783+0000","last_peered":"2024-04-18T21:05:49.892783+0000","last_clean":"2024-04-18T21:05:49.892783+0000","last_became_active":"2024-04-18T21:05:08.606842+0000","last_became_peered":"2024-04-18T21:05:08.606842+0000","last_unstale":"2024-04-18T21:05:49.892783+0000","last_undegraded":"2024-04-18T21:05:49.892783+0000","last_fullsized":"2024-04-18T21:05:49.892783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893489+0000","last_change":"2024-04-18T21:05:07.595780+0000","last_active":"2024-04-18T21:05:49.893489+0000","last_peered":"2024-04-18T21:05:49.893489+0000","last_clean":"2024-04-18T21:05:49.893489+0000","last_became_active":"2024-04-18T21:05:07.594359+0000","last_became_peered":"2024-04-18T21:05:07.594359+0000","last_unstale":"2024-04-18T21:05:49.893489+0000","last_undegraded":"2024-04-18T21:05:49.893489+0000","last_fullsized":"2024-04-18T21:05:49.893489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894716+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:05:49.894716+0000","last_peered":"2024-04-18T21:05:49.894716+0000","last_clean":"2024-04-18T21:05:49.894716+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:05:49.894716+0000","last_undegraded":"2024-04-18T21:05:49.894716+0000","last_fullsized":"2024-04-18T21:05:49.894716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895003+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:05:49.895003+0000","last_peered":"2024-04-18T21:05:49.895003+0000","last_clean":"2024-04-18T21:05:49.895003+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:05:49.895003+0000","last_undegraded":"2024-04-18T21:05:49.895003+0000","last_fullsized":"2024-04-18T21:05:49.895003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893205+0000","last_change":"2024-04-18T21:05:08.599455+0000","last_active":"2024-04-18T21:05:49.893205+0000","last_peered":"2024-04-18T21:05:49.893205+0000","last_clean":"2024-04-18T21:05:49.893205+0000","last_became_active":"2024-04-18T21:05:08.597931+0000","last_became_peered":"2024-04-18T21:05:08.597931+0000","last_unstale":"2024-04-18T21:05:49.893205+0000","last_undegraded":"2024-04-18T21:05:49.893205+0000","last_fullsized":"2024-04-18T21:05:49.893205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:40.271396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893021+0000","last_change":"2024-04-18T21:05:07.594675+0000","last_active":"2024-04-18T21:05:49.893021+0000","last_peered":"2024-04-18T21:05:49.893021+0000","last_clean":"2024-04-18T21:05:49.893021+0000","last_became_active":"2024-04-18T21:05:07.593886+0000","last_became_peered":"2024-04-18T21:05:07.593886+0000","last_unstale":"2024-04-18T21:05:49.893021+0000","last_undegraded":"2024-04-18T21:05:49.893021+0000","last_fullsized":"2024-04-18T21:05:49.893021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893657+0000","last_change":"2024-04-18T21:05:08.601212+0000","last_active":"2024-04-18T21:05:49.893657+0000","last_peered":"2024-04-18T21:05:49.893657+0000","last_clean":"2024-04-18T21:05:49.893657+0000","last_became_active":"2024-04-18T21:05:08.600378+0000","last_became_peered":"2024-04-18T21:05:08.600378+0000","last_unstale":"2024-04-18T21:05:49.893657+0000","last_undegraded":"2024-04-18T21:05:49.893657+0000","last_fullsized":"2024-04-18T21:05:49.893657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:01.595626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893603+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:05:49.893603+0000","last_peered":"2024-04-18T21:05:49.893603+0000","last_clean":"2024-04-18T21:05:49.893603+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:05:49.893603+0000","last_undegraded":"2024-04-18T21:05:49.893603+0000","last_fullsized":"2024-04-18T21:05:49.893603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893768+0000","last_change":"2024-04-18T21:05:08.597803+0000","last_active":"2024-04-18T21:05:49.893768+0000","last_peered":"2024-04-18T21:05:49.893768+0000","last_clean":"2024-04-18T21:05:49.893768+0000","last_became_active":"2024-04-18T21:05:08.597024+0000","last_became_peered":"2024-04-18T21:05:08.597024+0000","last_unstale":"2024-04-18T21:05:49.893768+0000","last_undegraded":"2024-04-18T21:05:49.893768+0000","last_fullsized":"2024-04-18T21:05:49.893768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893063+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:05:49.893063+0000","last_peered":"2024-04-18T21:05:49.893063+0000","last_clean":"2024-04-18T21:05:49.893063+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:05:49.893063+0000","last_undegraded":"2024-04-18T21:05:49.893063+0000","last_fullsized":"2024-04-18T21:05:49.893063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895228+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:05:49.895228+0000","last_peered":"2024-04-18T21:05:49.895228+0000","last_clean":"2024-04-18T21:05:49.895228+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:05:49.895228+0000","last_undegraded":"2024-04-18T21:05:49.895228+0000","last_fullsized":"2024-04-18T21:05:49.895228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892794+0000","last_change":"2024-04-18T21:04:57.506217+0000","last_active":"2024-04-18T21:05:49.892794+0000","last_peered":"2024-04-18T21:05:49.892794+0000","last_clean":"2024-04-18T21:05:49.892794+0000","last_became_active":"2024-04-18T21:04:57.505695+0000","last_became_peered":"2024-04-18T21:04:57.505695+0000","last_unstale":"2024-04-18T21:05:49.892794+0000","last_undegraded":"2024-04-18T21:05:49.892794+0000","last_fullsized":"2024-04-18T21:05:49.892794+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:17:35.595547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893420+0000","last_change":"2024-04-18T21:05:03.546358+0000","last_active":"2024-04-18T21:05:49.893420+0000","last_peered":"2024-04-18T21:05:49.893420+0000","last_clean":"2024-04-18T21:05:49.893420+0000","last_became_active":"2024-04-18T21:05:03.545419+0000","last_became_peered":"2024-04-18T21:05:03.545419+0000","last_unstale":"2024-04-18T21:05:49.893420+0000","last_undegraded":"2024-04-18T21:05:49.893420+0000","last_fullsized":"2024-04-18T21:05:49.893420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:51.012131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894316+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:05:49.894316+0000","last_peered":"2024-04-18T21:05:49.894316+0000","last_clean":"2024-04-18T21:05:49.894316+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:05:49.894316+0000","last_undegraded":"2024-04-18T21:05:49.894316+0000","last_fullsized":"2024-04-18T21:05:49.894316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893716+0000","last_change":"2024-04-18T21:05:08.612076+0000","last_active":"2024-04-18T21:05:49.893716+0000","last_peered":"2024-04-18T21:05:49.893716+0000","last_clean":"2024-04-18T21:05:49.893716+0000","last_became_active":"2024-04-18T21:05:08.606118+0000","last_became_peered":"2024-04-18T21:05:08.606118+0000","last_unstale":"2024-04-18T21:05:49.893716+0000","last_undegraded":"2024-04-18T21:05:49.893716+0000","last_fullsized":"2024-04-18T21:05:49.893716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:18.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892730+0000","last_change":"2024-04-18T21:05:03.547848+0000","last_active":"2024-04-18T21:05:49.892730+0000","last_peered":"2024-04-18T21:05:49.892730+0000","last_clean":"2024-04-18T21:05:49.892730+0000","last_became_active":"2024-04-18T21:05:03.547099+0000","last_became_peered":"2024-04-18T21:05:03.547099+0000","last_unstale":"2024-04-18T21:05:49.892730+0000","last_undegraded":"2024-04-18T21:05:49.892730+0000","last_fullsized":"2024-04-18T21:05:49.892730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893716+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:05:49.893716+0000","last_peered":"2024-04-18T21:05:49.893716+0000","last_clean":"2024-04-18T21:05:49.893716+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:05:49.893716+0000","last_undegraded":"2024-04-18T21:05:49.893716+0000","last_fullsized":"2024-04-18T21:05:49.893716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.897150+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:05:49.897150+0000","last_peered":"2024-04-18T21:05:49.897150+0000","last_clean":"2024-04-18T21:05:49.897150+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:05:49.897150+0000","last_undegraded":"2024-04-18T21:05:49.897150+0000","last_fullsized":"2024-04-18T21:05:49.897150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893985+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:05:49.893985+0000","last_peered":"2024-04-18T21:05:49.893985+0000","last_clean":"2024-04-18T21:05:49.893985+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:05:49.893985+0000","last_undegraded":"2024-04-18T21:05:49.893985+0000","last_fullsized":"2024-04-18T21:05:49.893985+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893623+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:05:49.893623+0000","last_peered":"2024-04-18T21:05:49.893623+0000","last_clean":"2024-04-18T21:05:49.893623+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:05:49.893623+0000","last_undegraded":"2024-04-18T21:05:49.893623+0000","last_fullsized":"2024-04-18T21:05:49.893623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895419+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:05:49.895419+0000","last_peered":"2024-04-18T21:05:49.895419+0000","last_clean":"2024-04-18T21:05:49.895419+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:05:49.895419+0000","last_undegraded":"2024-04-18T21:05:49.895419+0000","last_fullsized":"2024-04-18T21:05:49.895419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893098+0000","last_change":"2024-04-18T21:05:03.546359+0000","last_active":"2024-04-18T21:05:49.893098+0000","last_peered":"2024-04-18T21:05:49.893098+0000","last_clean":"2024-04-18T21:05:49.893098+0000","last_became_active":"2024-04-18T21:05:03.545574+0000","last_became_peered":"2024-04-18T21:05:03.545574+0000","last_unstale":"2024-04-18T21:05:49.893098+0000","last_undegraded":"2024-04-18T21:05:49.893098+0000","last_fullsized":"2024-04-18T21:05:49.893098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:40:43.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893304+0000","last_change":"2024-04-18T21:05:07.598074+0000","last_active":"2024-04-18T21:05:49.893304+0000","last_peered":"2024-04-18T21:05:49.893304+0000","last_clean":"2024-04-18T21:05:49.893304+0000","last_became_active":"2024-04-18T21:05:07.596597+0000","last_became_peered":"2024-04-18T21:05:07.596597+0000","last_unstale":"2024-04-18T21:05:49.893304+0000","last_undegraded":"2024-04-18T21:05:49.893304+0000","last_fullsized":"2024-04-18T21:05:49.893304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894713+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:05:49.894713+0000","last_peered":"2024-04-18T21:05:49.894713+0000","last_clean":"2024-04-18T21:05:49.894713+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:05:49.894713+0000","last_undegraded":"2024-04-18T21:05:49.894713+0000","last_fullsized":"2024-04-18T21:05:49.894713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893853+0000","last_change":"2024-04-18T21:05:07.594584+0000","last_active":"2024-04-18T21:05:49.893853+0000","last_peered":"2024-04-18T21:05:49.893853+0000","last_clean":"2024-04-18T21:05:49.893853+0000","last_became_active":"2024-04-18T21:05:07.593494+0000","last_became_peered":"2024-04-18T21:05:07.593494+0000","last_unstale":"2024-04-18T21:05:49.893853+0000","last_undegraded":"2024-04-18T21:05:49.893853+0000","last_fullsized":"2024-04-18T21:05:49.893853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:12.924250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895240+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:05:49.895240+0000","last_peered":"2024-04-18T21:05:49.895240+0000","last_clean":"2024-04-18T21:05:49.895240+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:05:49.895240+0000","last_undegraded":"2024-04-18T21:05:49.895240+0000","last_fullsized":"2024-04-18T21:05:49.895240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893720+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:05:49.893720+0000","last_peered":"2024-04-18T21:05:49.893720+0000","last_clean":"2024-04-18T21:05:49.893720+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:05:49.893720+0000","last_undegraded":"2024-04-18T21:05:49.893720+0000","last_fullsized":"2024-04-18T21:05:49.893720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895030+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:05:49.895030+0000","last_peered":"2024-04-18T21:05:49.895030+0000","last_clean":"2024-04-18T21:05:49.895030+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:05:49.895030+0000","last_undegraded":"2024-04-18T21:05:49.895030+0000","last_fullsized":"2024-04-18T21:05:49.895030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895723+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:05:49.895723+0000","last_peered":"2024-04-18T21:05:49.895723+0000","last_clean":"2024-04-18T21:05:49.895723+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:05:49.895723+0000","last_undegraded":"2024-04-18T21:05:49.895723+0000","last_fullsized":"2024-04-18T21:05:49.895723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893741+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:05:49.893741+0000","last_peered":"2024-04-18T21:05:49.893741+0000","last_clean":"2024-04-18T21:05:49.893741+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:05:49.893741+0000","last_undegraded":"2024-04-18T21:05:49.893741+0000","last_fullsized":"2024-04-18T21:05:49.893741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895858+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:05:49.895858+0000","last_peered":"2024-04-18T21:05:49.895858+0000","last_clean":"2024-04-18T21:05:49.895858+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:05:49.895858+0000","last_undegraded":"2024-04-18T21:05:49.895858+0000","last_fullsized":"2024-04-18T21:05:49.895858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895441+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:05:49.895441+0000","last_peered":"2024-04-18T21:05:49.895441+0000","last_clean":"2024-04-18T21:05:49.895441+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:05:49.895441+0000","last_undegraded":"2024-04-18T21:05:49.895441+0000","last_fullsized":"2024-04-18T21:05:49.895441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893289+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:05:49.893289+0000","last_peered":"2024-04-18T21:05:49.893289+0000","last_clean":"2024-04-18T21:05:49.893289+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:05:49.893289+0000","last_undegraded":"2024-04-18T21:05:49.893289+0000","last_fullsized":"2024-04-18T21:05:49.893289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":2,"reported_epoch":29,"state":"peering","last_fresh":"2024-04-18T21:05:30.801379+0000","last_change":"2024-04-18T21:05:50.696938+0000","last_active":"2024-04-18T21:05:50.696938+0000","last_peered":"2024-04-18T21:05:30.801379+0000","last_clean":"2024-04-18T21:05:30.801379+0000","last_became_active":"2024-04-18T21:05:07.589234+0000","last_became_peered":"2024-04-18T21:05:07.589234+0000","last_unstale":"2024-04-18T21:05:30.801379+0000","last_undegraded":"2024-04-18T21:05:30.801379+0000","last_fullsized":"2024-04-18T21:05:30.801379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893756+0000","last_change":"2024-04-18T21:05:03.547871+0000","last_active":"2024-04-18T21:05:49.893756+0000","last_peered":"2024-04-18T21:05:49.893756+0000","last_clean":"2024-04-18T21:05:49.893756+0000","last_became_active":"2024-04-18T21:05:03.547267+0000","last_became_peered":"2024-04-18T21:05:03.547267+0000","last_unstale":"2024-04-18T21:05:49.893756+0000","last_undegraded":"2024-04-18T21:05:49.893756+0000","last_fullsized":"2024-04-18T21:05:49.893756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:19.219647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893177+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:05:49.893177+0000","last_peered":"2024-04-18T21:05:49.893177+0000","last_clean":"2024-04-18T21:05:49.893177+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:05:49.893177+0000","last_undegraded":"2024-04-18T21:05:49.893177+0000","last_fullsized":"2024-04-18T21:05:49.893177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893039+0000","last_change":"2024-04-18T21:05:08.602676+0000","last_active":"2024-04-18T21:05:49.893039+0000","last_peered":"2024-04-18T21:05:49.893039+0000","last_clean":"2024-04-18T21:05:49.893039+0000","last_became_active":"2024-04-18T21:05:08.601032+0000","last_became_peered":"2024-04-18T21:05:08.601032+0000","last_unstale":"2024-04-18T21:05:49.893039+0000","last_undegraded":"2024-04-18T21:05:49.893039+0000","last_fullsized":"2024-04-18T21:05:49.893039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893360+0000","last_change":"2024-04-18T21:05:07.591415+0000","last_active":"2024-04-18T21:05:49.893360+0000","last_peered":"2024-04-18T21:05:49.893360+0000","last_clean":"2024-04-18T21:05:49.893360+0000","last_became_active":"2024-04-18T21:05:07.590583+0000","last_became_peered":"2024-04-18T21:05:07.590583+0000","last_unstale":"2024-04-18T21:05:49.893360+0000","last_undegraded":"2024-04-18T21:05:49.893360+0000","last_fullsized":"2024-04-18T21:05:49.893360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893487+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:05:49.893487+0000","last_peered":"2024-04-18T21:05:49.893487+0000","last_clean":"2024-04-18T21:05:49.893487+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:05:49.893487+0000","last_undegraded":"2024-04-18T21:05:49.893487+0000","last_fullsized":"2024-04-18T21:05:49.893487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895440+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:05:49.895440+0000","last_peered":"2024-04-18T21:05:49.895440+0000","last_clean":"2024-04-18T21:05:49.895440+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:05:49.895440+0000","last_undegraded":"2024-04-18T21:05:49.895440+0000","last_fullsized":"2024-04-18T21:05:49.895440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893984+0000","last_change":"2024-04-18T21:05:07.594850+0000","last_active":"2024-04-18T21:05:49.893984+0000","last_peered":"2024-04-18T21:05:49.893984+0000","last_clean":"2024-04-18T21:05:49.893984+0000","last_became_active":"2024-04-18T21:05:07.593951+0000","last_became_peered":"2024-04-18T21:05:07.593951+0000","last_unstale":"2024-04-18T21:05:49.893984+0000","last_undegraded":"2024-04-18T21:05:49.893984+0000","last_fullsized":"2024-04-18T21:05:49.893984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893340+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:05:49.893340+0000","last_peered":"2024-04-18T21:05:49.893340+0000","last_clean":"2024-04-18T21:05:49.893340+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:05:49.893340+0000","last_undegraded":"2024-04-18T21:05:49.893340+0000","last_fullsized":"2024-04-18T21:05:49.893340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895698+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:05:49.895698+0000","last_peered":"2024-04-18T21:05:49.895698+0000","last_clean":"2024-04-18T21:05:49.895698+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:05:49.895698+0000","last_undegraded":"2024-04-18T21:05:49.895698+0000","last_fullsized":"2024-04-18T21:05:49.895698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893212+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:05:49.893212+0000","last_peered":"2024-04-18T21:05:49.893212+0000","last_clean":"2024-04-18T21:05:49.893212+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:05:49.893212+0000","last_undegraded":"2024-04-18T21:05:49.893212+0000","last_fullsized":"2024-04-18T21:05:49.893212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.896828+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:05:49.896828+0000","last_peered":"2024-04-18T21:05:49.896828+0000","last_clean":"2024-04-18T21:05:49.896828+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:05:49.896828+0000","last_undegraded":"2024-04-18T21:05:49.896828+0000","last_fullsized":"2024-04-18T21:05:49.896828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893588+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:05:49.893588+0000","last_peered":"2024-04-18T21:05:49.893588+0000","last_clean":"2024-04-18T21:05:49.893588+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:05:49.893588+0000","last_undegraded":"2024-04-18T21:05:49.893588+0000","last_fullsized":"2024-04-18T21:05:49.893588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894845+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:05:49.894845+0000","last_peered":"2024-04-18T21:05:49.894845+0000","last_clean":"2024-04-18T21:05:49.894845+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:05:49.894845+0000","last_undegraded":"2024-04-18T21:05:49.894845+0000","last_fullsized":"2024-04-18T21:05:49.894845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893688+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:05:49.893688+0000","last_peered":"2024-04-18T21:05:49.893688+0000","last_clean":"2024-04-18T21:05:49.893688+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:05:49.893688+0000","last_undegraded":"2024-04-18T21:05:49.893688+0000","last_fullsized":"2024-04-18T21:05:49.893688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894725+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:05:49.894725+0000","last_peered":"2024-04-18T21:05:49.894725+0000","last_clean":"2024-04-18T21:05:49.894725+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:05:49.894725+0000","last_undegraded":"2024-04-18T21:05:49.894725+0000","last_fullsized":"2024-04-18T21:05:49.894725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893985+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:05:49.893985+0000","last_peered":"2024-04-18T21:05:49.893985+0000","last_clean":"2024-04-18T21:05:49.893985+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:05:49.893985+0000","last_undegraded":"2024-04-18T21:05:49.893985+0000","last_fullsized":"2024-04-18T21:05:49.893985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894458+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:05:49.894458+0000","last_peered":"2024-04-18T21:05:49.894458+0000","last_clean":"2024-04-18T21:05:49.894458+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:05:49.894458+0000","last_undegraded":"2024-04-18T21:05:49.894458+0000","last_fullsized":"2024-04-18T21:05:49.894458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894240+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:05:49.894240+0000","last_peered":"2024-04-18T21:05:49.894240+0000","last_clean":"2024-04-18T21:05:49.894240+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:05:49.894240+0000","last_undegraded":"2024-04-18T21:05:49.894240+0000","last_fullsized":"2024-04-18T21:05:49.894240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892948+0000","last_change":"2024-04-18T21:05:08.609479+0000","last_active":"2024-04-18T21:05:49.892948+0000","last_peered":"2024-04-18T21:05:49.892948+0000","last_clean":"2024-04-18T21:05:49.892948+0000","last_became_active":"2024-04-18T21:05:08.608689+0000","last_became_peered":"2024-04-18T21:05:08.608689+0000","last_unstale":"2024-04-18T21:05:49.892948+0000","last_undegraded":"2024-04-18T21:05:49.892948+0000","last_fullsized":"2024-04-18T21:05:49.892948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.893361+0000","last_change":"2024-04-18T21:05:43.881788+0000","last_active":"2024-04-18T21:05:49.893361+0000","last_peered":"2024-04-18T21:05:49.893361+0000","last_clean":"2024-04-18T21:05:49.893361+0000","last_became_active":"2024-04-18T21:05:43.876120+0000","last_became_peered":"2024-04-18T21:05:43.876120+0000","last_unstale":"2024-04-18T21:05:49.893361+0000","last_undegraded":"2024-04-18T21:05:49.893361+0000","last_fullsized":"2024-04-18T21:05:49.893361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:35:01.546433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892989+0000","last_change":"2024-04-18T21:05:08.598803+0000","last_active":"2024-04-18T21:05:49.892989+0000","last_peered":"2024-04-18T21:05:49.892989+0000","last_clean":"2024-04-18T21:05:49.892989+0000","last_became_active":"2024-04-18T21:05:08.598071+0000","last_became_peered":"2024-04-18T21:05:08.598071+0000","last_unstale":"2024-04-18T21:05:49.892989+0000","last_undegraded":"2024-04-18T21:05:49.892989+0000","last_fullsized":"2024-04-18T21:05:49.892989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:54.356076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895385+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:05:49.895385+0000","last_peered":"2024-04-18T21:05:49.895385+0000","last_clean":"2024-04-18T21:05:49.895385+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:05:49.895385+0000","last_undegraded":"2024-04-18T21:05:49.895385+0000","last_fullsized":"2024-04-18T21:05:49.895385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.894082+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:05:49.894082+0000","last_peered":"2024-04-18T21:05:49.894082+0000","last_clean":"2024-04-18T21:05:49.894082+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:05:49.894082+0000","last_undegraded":"2024-04-18T21:05:49.894082+0000","last_fullsized":"2024-04-18T21:05:49.894082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895105+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:05:49.895105+0000","last_peered":"2024-04-18T21:05:49.895105+0000","last_clean":"2024-04-18T21:05:49.895105+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:05:49.895105+0000","last_undegraded":"2024-04-18T21:05:49.895105+0000","last_fullsized":"2024-04-18T21:05:49.895105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.892666+0000","last_change":"2024-04-18T21:05:08.597139+0000","last_active":"2024-04-18T21:05:49.892666+0000","last_peered":"2024-04-18T21:05:49.892666+0000","last_clean":"2024-04-18T21:05:49.892666+0000","last_became_active":"2024-04-18T21:05:08.596015+0000","last_became_peered":"2024-04-18T21:05:08.596015+0000","last_unstale":"2024-04-18T21:05:49.892666+0000","last_undegraded":"2024-04-18T21:05:49.892666+0000","last_fullsized":"2024-04-18T21:05:49.892666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-18T21:05:49.895480+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:05:49.895480+0000","last_peered":"2024-04-18T21:05:49.895480+0000","last_clean":"2024-04-18T21:05:49.895480+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:05:49.895480+0000","last_undegraded":"2024-04-18T21:05:49.895480+0000","last_fullsized":"2024-04-18T21:05:49.895480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":339968,"data_stored":698787,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":102300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":339968,"data_stored":695104,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:55.758 INFO:tasks.thrashosds.thrasher:Setting 4.15 to [2, 0] 2024-04-18T21:05:55.758 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.15', '2', '0'] 2024-04-18T21:05:55.759 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.15 2 0 2024-04-18T21:05:55.787 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:55.787+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:55.812 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:55.812 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:55.826 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:55.888 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:55.885+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:55.952 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:55.952 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:55.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:56.009 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:56.009+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:56.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:56.088+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:56.098 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:56.098 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:56.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:56.190 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:56.189+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:56.278 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:56.278 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:56.290 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:56.291+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:56.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:56.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:56.392+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:56.412 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:56.412 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:56.426 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:56.492 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:56.491+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:56.559 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:56.559 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:56.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:56.615 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:56.615+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:56.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:56.696+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:56.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:56.794 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:56.796+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:56.865 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:56.865 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:56.879 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:56.895 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:56.895+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:56.953 INFO:teuthology.orchestra.run.smithi096.stderr:set 4.15 pg_upmap mapping to [2,0] 2024-04-18T21:05:56.983 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:05:56.996 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:56.993+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:57.013 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.013 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.027 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:57.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:57.096+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:57.191 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.191 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:57.200+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:57.205 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:57.299 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:57.297+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:57.323 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.323 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:57.400 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:57.399+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:57.469 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.469 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:57.501 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:57.501+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:57.508 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:57.602 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:57.601+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:57.606 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.606 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:57.667 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:57.667 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:57.685 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:57.685 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:57.702 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:57.701+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:57.706 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:57.706 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:57.743 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.150522467999998, 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.150421461000001, 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.150320487999998, 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.149636481999998, 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.149546704999999, 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.149400706000002, 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.149306105000001, 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.149201161999997, 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.149126211000002, 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.141792150000001, 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.137644096999999, 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.137535460999999, 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.137401730999997, 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:57.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.137256731999997, 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:57.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.129354204999999, 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.129098653, 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.129042812000002, 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:57.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.154715535999998, 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.152184159999997, 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.149849699000001, 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:57.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:57.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:57.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:57.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:57.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:57.833 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:57.834 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:57.835 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:57.835+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:57.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:57.936+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:57.966 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:57.966 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:57.966 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:57.966 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:57.975 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:05:57.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:58.036 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:58.033+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:58.096 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:58.096 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:58.096 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:58.096 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:58.097 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:58.110 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:58.137 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:58.137+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:58.229 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:58.229 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:58.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:58.229 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632970211, 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:58.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:58.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:58.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632849210000003, 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:58.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:58.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632776296000003, 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632706783000003, 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632671860999999, 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632626881999997, 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632561510999999, 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632512122000001, 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.632457913000003, 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.620680348999997, 2024-04-18T21:05:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.620445152000002, 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.619978736, 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.619719549000003, 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.619561992999998, 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.619477465000003, 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.619161411999997, 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.617194908999998, 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.617080158, 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.615083232000003, 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.614376864999997, 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:58.324 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:58.325 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:58.326 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:58.325+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:58.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:58.428+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:58.457 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:58.457 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:58.457 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:05:58.457 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:58.471 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:58.527 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:58.525+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:58.586 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:58.587 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:05:58.587 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:05:58.587 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:05:58.587 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:58.601 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:58.641 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:58.641+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:58.729 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:58.727+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:58.764 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:05:58.764 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:05:58.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:05:58.764 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:05:58.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.764 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.636243720000003, 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:05:58.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:05:58.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:05:58.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:05:58.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.636210148000004, 2024-04-18T21:05:58.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.636177885000002, 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:58.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.636062334000002, 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:05:58.782 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.787 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168628409, 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.792 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168515284999998, 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168436202999999, 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:05:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:05:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:05:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168332999, 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:05:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:05:58.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:05:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168243226999998, 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168157188999999, 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.814 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:05:58.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:58.819 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168093104, 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:05:58.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.824 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.168007506000002, 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:58.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:05:58.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:05:58.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167941313, 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.830 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:05:58.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:05:58.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.835 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167871935000001, 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:05:58.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:05:58.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:05:58.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.840 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167709232, 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:05:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:05:58.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:05:58.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167558268000001, 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:05:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:05:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:05:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:05:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167508759, 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167443497000001, 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.861 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167309316999997, 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:05:58.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:05:58.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.167205852000002, 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:58.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:05:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:05:58.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:05:58.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:05:58.871 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:05:58.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:58.873 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:58.869+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:58.973 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:58.973+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:59.003 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:05:59.004 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:59.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:59.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:59.076+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:59.142 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:05:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:05:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:05:59.142 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:59.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:59.175 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:59.173+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:59.275 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:59.275+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.72941162, 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:05:59.324 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:05:59.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.729310613000003, 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:05:59.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.729209640000001, 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:05:59.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:05:59.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.728525634, 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:59.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:05:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:05:59.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.728435857000001, 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.728289857999997, 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:05:59.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:05:59.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:05:59.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:05:59.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.728195257000003, 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:05:59.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.728090313999999, 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.728015362999997, 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:05:59.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:05:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.720681302000003, 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:05:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.716533249000001, 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:05:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:05:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.716424613000001, 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:05:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:05:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.716290882999999, 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:05:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:05:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:05:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.716145883999999, 2024-04-18T21:05:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:05:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.708243357000001, 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:05:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:05:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:05:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:05:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.707987805000002, 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.707931963999997, 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.733604688, 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:05:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:05:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:05:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.731073311999999, 2024-04-18T21:05:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:05:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:05:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.728738850999999, 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:05:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:05:59.411 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:05:59.413 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:59.413 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:59.411+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:59.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:59.516+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:59.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:59.615 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:05:59.613+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:05:59.672 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:59.672 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:05:59.672 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:05:59.672 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:05:59.672 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:59.686 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:59.715 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:05:59.716+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:05:59.724 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:59.813 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:05:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:05:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215610781999999, 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:05:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:05:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:05:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:05:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215489781000002, 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:05:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:05:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:05:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:05:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215416867000002, 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215347354000002, 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215312431999998, 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:05:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:05:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:05:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:05:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215267453000003, 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:05:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215202081999998, 2024-04-18T21:05:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215152693, 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:05:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:05:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:05:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.215098484000002, 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:05:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.203320920000003, 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:05:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:05:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:05:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.203085723000001, 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.202619306999999, 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:05:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:05:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:05:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.202360120000002, 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.202202563999997, 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.202118036000002, 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:05:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:05:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:05:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.201801983000003, 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.199835479999997, 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:05:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:05:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:05:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.199720728999999, 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.197723803000002, 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:05:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:05:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.197017436000003, 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:05:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:05:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:05:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:05:59.902 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:05:59.903 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:05:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:59.904 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:05:59.904 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:59.905 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:05:59.903+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:05:59.905 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:59.911 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:05:59.911 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:00.000 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:00.004 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:00.003+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:00.052 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:00.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:00.104+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:00.168 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:00.168 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:00.182 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:00.225 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:00.225+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:00.298 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:00.298 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:00.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:00.308+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:00.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:00.407 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:00.407+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:00.442 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:00.442 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:00.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:00.508 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:00.507+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:00.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:00.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:00.640+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:00.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:00.708+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:00.715 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:00.715 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:00.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:00.810 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:00.811+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:00.860 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:00.860 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:00.874 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:00.912 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:00.913+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:00.987 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:06:01.013 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:01.013+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:01.037 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.037 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:01.113 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:01.111+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.186 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:01.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:01.216+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:01.315 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:01.313+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:01.317 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.317 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.331 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:01.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:01.416+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:01.494 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.494 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.508 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:01.557 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:01.557+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:01.617 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:01.619+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:01.630 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.630 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:01.718 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:01.720+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:01.778 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.778 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:01.819 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:01.821+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:01.920 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:01.919+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:01.927 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:01.950 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.950 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:01.980 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:01.980 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:01.980 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:06:01.980 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:06:02.021 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:02.019+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:02.079 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.079 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.092 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:02.093 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:02.094 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:02.117 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:02.117 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:02.122 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:02.121+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:02.137 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:02.137 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:02.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:02.224+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:02.228 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:02.228 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:02.228 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:02.228 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:02.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 35, 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:06:00.974572+0000", 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5801984, 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:06:02.286 INFO:teuthology.orchestra.run.smithi096.stdout: "noscrub", 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:06:02.287 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:02.288 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:02.289 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:02.290 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:02.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:06:02.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:02.294 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:02.295 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:02.296 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:02.297 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:06:02.298 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:02.299 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:02.300 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:02.301 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:02.302 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:02.303 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.0299999713897705, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.0299999713897705, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-18T21:06:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:02.305 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:02.306 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:02.307 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.308 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:06:02.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:06:02.310 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:02.311 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 25, 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.312 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:06:02.313 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.314 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:02.316 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.317 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:06:02.318 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.319 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:02.321 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 33, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.323 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:06:02.324 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:02.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.326 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:02.327 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:02.328 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.6", 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: 2, 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.1c", 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "4.15", 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2, 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: 0 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:06:02.330 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:06:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:06:02.332 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:02.332 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:06:02.333 INFO:tasks.thrashosds.thrasher:j is {'epoch': 35, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:06:00.974572+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 25, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.6', 'osds': [2, 1]}, {'pgid': '3.1c', 'osds': [0, 2]}, {'pgid': '4.15', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:06:02.333 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.15 2024-04-18T21:06:02.333 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 4.15 2024-04-18T21:06:02.334 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:02.331+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:02.366 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:02.366 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:02.380 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:02.467 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:02.467+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:02.534 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:02.533+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.949083098999999, 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.547 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:02.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:02.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948962098000003, 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:02.552 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.557 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948889184000002, 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:02.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:02.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:02.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948819671000003, 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:02.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:02.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:02.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:02.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:02.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948784748999998, 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.570 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:02.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:02.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:02.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948739770000003, 2024-04-18T21:06:02.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:02.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:02.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948674398999998, 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948625010000001, 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:02.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.948570801000002, 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:02.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.936793237000003, 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:02.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:02.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:02.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.936558040000001, 2024-04-18T21:06:02.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:02.601 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.936091623999999, 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:02.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.935832437000002, 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.935674880999997, 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.935590353000002, 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:02.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:02.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:02.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.617 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.935274300000003, 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:02.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:02.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:02.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.933307796999998, 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:02.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:02.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:02.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.933193046, 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:02.626 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.630 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.931196120000003, 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.634 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.930489753000003, 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:02.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:02.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:02.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:02.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:02.640 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:02.639+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:02.641 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:02.742 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:02.743+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:02.773 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:02.773 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:02.773 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:02.774 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:02.787 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:02.843 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:02.844+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:02.903 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:02.903 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:02.904 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:02.904 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:02.904 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:02.917 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:02.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:02.944+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:02.996 INFO:teuthology.orchestra.run.smithi096.stderr:clear 4.15 pg_upmap mapping 2024-04-18T21:06:03.008 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:03.040 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:03.040 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:03.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:03.040 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:03.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.040 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.910599718, 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.910566145999994, 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.046 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.051 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.910533882999999, 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:03.052 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:03.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:03.057 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 64.910418332000006, 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:03.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:03.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:03.063 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442984406999997, 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:03.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442871283000002, 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.069 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:03.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442792201000003, 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:03.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:03.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442688996999998, 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442599225000002, 2024-04-18T21:06:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442513187000003, 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:03.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:03.096 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442449101999998, 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:03.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:03.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:03.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442363503999999, 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442297310999997, 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.112 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442227932999998, 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:03.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:03.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.117 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.442065229999997, 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.122 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.441914265999998, 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:03.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.441864756999998, 2024-04-18T21:06:03.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:03.132 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.441799494999998, 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:03.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.441665315000002, 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:03.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:03.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:03.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.142 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.441561849999999, 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:03.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:03.146 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:03.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:03.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:03.148+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:03.249 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:03.251+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:03.281 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:03.281 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:03.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:03.350 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:03.349+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:03.419 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:03.420 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:03.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:03.451 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:03.449+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.958719719000001, 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:03.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.557 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.958618712000003, 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:03.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.958517739000001, 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:03.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.957833733000001, 2024-04-18T21:06:03.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.957743956000002, 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:03.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:03.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:03.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:03.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.957597956999997, 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:03.579 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:03.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:03.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:03.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.957503355999997, 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:03.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.957398413, 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.957323461999998, 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:03.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.949989401000003, 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:03.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.945841348000002, 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:03.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:03.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.945732712000002, 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:03.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:03.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.945598982, 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:03.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.945453983, 2024-04-18T21:06:03.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:03.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:03.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.937551456000001, 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.937295904000003, 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:03.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:03.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.937240062999997, 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.962912787, 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:03.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.960381411, 2024-04-18T21:06:03.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:03.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.958046949999996, 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:03.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:03.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:03.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:03.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:03.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:03.645 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:03.645 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:03.553+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:03.646 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:03.695 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:03.695+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:03.754 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:03.756+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:03.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:03.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:03.856+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:03.956 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:03.955+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:03.960 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:03.960 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:03.960 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:03.960 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:03.960 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:03.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:03.998 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:06:04.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:04.056+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:04.150 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:04.150 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:04.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:04.150 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:04.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.150 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.150 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.552126307999998, 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:04.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:04.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:04.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:04.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.552005307000002, 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:04.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:04.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.551932393000001, 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.551862880000002, 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:04.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:04.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:04.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:04.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:04.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.551827957999997, 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:04.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:04.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.551782979000002, 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:04.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.551717607999997, 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:04.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.551668219, 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:04.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:04.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:04.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.551614010000002, 2024-04-18T21:06:04.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:04.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.539836446000002, 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.194 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.539601249, 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:04.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:04.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:04.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:04.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.539134832999999, 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.538875646000001, 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:04.210 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.538718090000003, 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.538633562000001, 2024-04-18T21:06:04.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:04.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:04.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:04.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.538317509000002, 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:04.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.536351005999997, 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.536236254999999, 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:04.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:04.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.534239329000002, 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.231 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:04.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.533532962000002, 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:04.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:04.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:04.239 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:04.240 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:04.242 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:04.239+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:04.242 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:04.342 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:04.341+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:04.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:04.440 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:04.440 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:04.442 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:04.443+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:04.544 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:04.543+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:04.555 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:04.555 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:04.569 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:04.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:04.648+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:04.688 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:04.689 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:04.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:04.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:04.752+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:04.835 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:04.835 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:04.848 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:04.849+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:04.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:04.949 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:04.947+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:05.012 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.012 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:05.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:05.072+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:05.150 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:05.151+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:05.151 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.151 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:05.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:05.252+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:05.296 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.296 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:05.353 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:05.353+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.450 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:05.453 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:05.453+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:05.554 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:05.551+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:05.572 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.572 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:05.655 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:05.655+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:05.716 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.717 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.731 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:05.756 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:05.755+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:05.852 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.852 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.857 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:05.856+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:05.866 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:05.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:05.956+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:05.982 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.982 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.996 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:06.018 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:06.058 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:06.059+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:06.130 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.130 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:06.159 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:06.159+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:06.260 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:06.259+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:06.266 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.266 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:06.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:06.360+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:06.398 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.398 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.414 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:06.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:06.461 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:06.459+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:06.544 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.544 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:06.562 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:06.561+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:06.604 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:06.624 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:06.624 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:06.644 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:06.644 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:06.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:06.664+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:06.725 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:06.725 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:06.739 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:06.763 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:06.761+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260496404000001, 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260375402999998, 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260302488999997, 2024-04-18T21:06:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260232975999998, 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260198054, 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260153074999998, 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260087704, 2024-04-18T21:06:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.260038315000003, 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.259984105999997, 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.248206541999998, 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.247971345000003, 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.247504929000002, 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.247245741999997, 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.247088185999999, 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.247003657999997, 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.246687604999998, 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.244721102, 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.244606351000002, 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.242609424999998, 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.241903057999998, 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:06.950 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:06.952 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:06.951+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:06.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:07.014 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:06:07.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:07.052+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:07.087 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:07.087 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:07.101 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:07.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:07.156+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:07.219 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:07.220 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:07.220 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:07.220 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:07.220 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:07.233 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:07.254 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:07.251+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:07.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:07.356+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:07.355 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.225813338999998, 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:07.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:07.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.225779767000006, 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:07.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:07.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.225747503999997, 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:07.367 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:07.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.225631953000004, 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:07.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.758198028000002, 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:07.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.758084904, 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:07.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:07.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.758005822000001, 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:07.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:07.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.394 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757902618000003, 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:07.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:07.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757812846, 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:07.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:07.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.405 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757726808000001, 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:07.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:07.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757662723000003, 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:07.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757577124999997, 2024-04-18T21:06:07.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:07.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:07.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:07.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.421 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757510932000002, 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:07.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:07.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:07.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757441554000003, 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:07.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:07.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:07.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:07.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757278851000002, 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:07.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757127887000003, 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757078378000003, 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.757013116000003, 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.756878936, 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 58.756775470999997, 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:07.461 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:07.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:07.463 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:07.461+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:07.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:07.564+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:07.596 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:07.596 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:07.597 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:07.597 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:07.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:07.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:07.704+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:07.764 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:07.765+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:07.778 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:07.778 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:07.778 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:07.778 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:07.779 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:07.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:07.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:07.888+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:07.966 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:07.966 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:07.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:07.966 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.371345304000002, 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:07.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:07.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:07.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.371244296999997, 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:07.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:07.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:07.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:07.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.371143324000002, 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.370459318000002, 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:07.982 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:07.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:07.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:07.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:07.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.370369541000002, 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:07.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:07.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:07.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.370223541999998, 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:07.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:07.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.370128940999997, 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:07.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:07.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:08.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.001 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.370023998000001, 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.369949046999999, 2024-04-18T21:06:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.362614985999997, 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.358466933000003, 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.358358297000002, 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.358224567000001, 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.358079568000001, 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.350177041000002, 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.349921489000003, 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.349865647999998, 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.375538372000001, 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.373006996000001, 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.370672534999997, 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:08.053 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:08.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:07.968+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:08.055 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:08.055 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:08.055 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:08.055 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-18T21:06:08.056 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:06:08.056 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:06:08.056 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-18T21:06:08.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:08.100+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:08.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:08.168+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:08.182 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:08.183 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-18T21:06:08.183 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:08.184 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:08.185 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:08.185 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:08.185 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:08.201 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:08.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:08.268+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:08.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:08.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:08.372+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:08.471 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:08.471+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:08.497 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:08.497 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:08.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:08.497 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:08.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.497 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898987478999999, 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:08.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898866478000002, 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:08.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:08.508 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898793564000002, 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:08.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:08.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:08.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:08.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:08.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898724051000002, 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.516 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:08.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.521 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898689128999997, 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:08.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:08.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898644150000003, 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.527 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:08.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:08.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:08.532 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898578778999997, 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:08.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.89852939, 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:08.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:08.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.898475181000002, 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:08.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.886697617000003, 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:08.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:08.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.886462420000001, 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.549 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:08.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.885996003999999, 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:08.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:08.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.557 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.885736817000002, 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.885579260999997, 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:08.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:08.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:08.565 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.885494733000002, 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.885178680000003, 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:08.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:08.574 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.883212176999997, 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:08.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.578 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.883097425999999, 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:08.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.582 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.881100500000002, 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:08.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:08.586 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.880394133000003, 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:08.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:08.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:08.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:08.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:08.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:08.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.591 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:08.591 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:08.591 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:08.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:08.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:08.592+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:08.660 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:08.693 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:08.693+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:08.725 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:08.726 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:08.726 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:08.726 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:08.740 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:08.794 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:08.795+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:08.895 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:08.895+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:08.897 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:08.897 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:08.911 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:08.996 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:08.995+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:09.027 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:09.027 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:09.034 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:09.043 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:09.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:09.096+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:09.176 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:09.176 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:09.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:09.197 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:09.197+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:09.299 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:09.297+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:09.354 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:09.354 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:09.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:09.400 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:09.399+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:09.490 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:09.490 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:09.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:09.500+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:09.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:09.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:09.600+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:09.635 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:09.635 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:09.649 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:09.702 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:09.701+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:09.773 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:09.774 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:09.787 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:09.803 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:09.801+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:09.903 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:09.905+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:09.908 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:09.908 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:09.923 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:10.005 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:10.003+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:10.035 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:06:10.060 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.060 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.075 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:10.106 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:10.107+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:10.196 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.196 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.206 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:10.207+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:10.212 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:10.308 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:10.307+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:10.332 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.333 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:10.408 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:10.405+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.481 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:10.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:10.544+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:10.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:10.608+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:10.619 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.619 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:10.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:10.728+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:10.802 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.802 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.811 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:10.811+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:10.817 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:10.859 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:10.912 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:10.913+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.963 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:11.007 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:11.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:11.012+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:11.049 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:11.081 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:11.081 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:11.081 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:11.081 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:11.081 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:11.095 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:11.113 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:11.113+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:11.214 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:11.211+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623565937000002, 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.220 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:11.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623444935999999, 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:11.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:11.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:11.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:11.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623372021999998, 2024-04-18T21:06:11.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:11.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623302508999998, 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:11.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:11.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623267587000001, 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623222607999999, 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623157237000001, 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623107847999997, 2024-04-18T21:06:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.623053638999998, 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.611276074999999, 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.611040877999997, 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.610574462000002, 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.610315274999998, 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.610157719, 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.610073190999998, 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.609757137999999, 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.607790635000001, 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.607675884000002, 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.605678957999999, 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.604972590999999, 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:11.333 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:11.335 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:11.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:11.336+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:11.435 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:11.433+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:11.469 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:11.469 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:11.469 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:11.469 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:11.484 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:11.536 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:11.535+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:11.637 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:11.637+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:11.648 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:11.649 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:11.662 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:11.749 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:11.749+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:11.830 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.702570586999997, 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:11.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:11.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:11.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.702537015000004, 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:11.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:11.842 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.702504751999996, 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:11.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.848 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 73.702389201000003, 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:11.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:11.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.854 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234955276000001, 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:11.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234842151999999, 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.23476307, 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:11.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:11.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234659866000001, 2024-04-18T21:06:11.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:11.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234570093999999, 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:11.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:11.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234484055999999, 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:11.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:11.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:11.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:11.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:11.886 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234419971000001, 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:11.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.891 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234334373000003, 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:11.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234268180000001, 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.897 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.902 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234198802000002, 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:11.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:11.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:11.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.234036099000001, 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:11.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:11.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:11.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:11.913 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.233885135000001, 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:11.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:11.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:11.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.233835626000001, 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:11.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:11.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.233770364000002, 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.233636183999998, 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.929 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.934 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.233532719000003, 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:11.938 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:11.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:11.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:11.939+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:12.041 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:12.041+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:12.059 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:12.070 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:12.071 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:12.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:12.142 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:12.143+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:12.240 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:12.240 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:12.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:12.242 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:12.243+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:12.343 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:12.345+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.764989135, 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:12.358 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:12.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:12.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:12.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.363 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.764888128000003, 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.764787155, 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:12.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:12.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:12.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.764103149, 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:12.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.764013372000001, 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.763867372999997, 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.763772772000003, 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:12.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:12.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.763667828999999, 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:12.395 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.763592877999997, 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.756258817000003, 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:12.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.752110764000001, 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:12.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.752002128000001, 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:12.410 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:12.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.751868397999999, 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:12.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.751723398999999, 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.422 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.743820872000001, 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:12.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:12.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:12.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.743565320000002, 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.743509478999997, 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:12.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:12.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.769182203, 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:12.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:12.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:12.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.766650826999999, 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:12.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.764316366000003, 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:12.442 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:12.447 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:12.449 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:12.449 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:12.447+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:12.550 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:12.547+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:12.580 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:12.580 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:12.580 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:12.580 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:12.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:12.687 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:12.687+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:12.751 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:12.749+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:12.763 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:12.763 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:12.763 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:12.763 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:12.763 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:12.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:12.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:12.851+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347918749000002, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347797748000005, 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347724834000005, 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:12.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347655321000005, 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:12.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:12.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347620398999993, 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:12.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:12.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:12.971 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347575419999998, 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347510048999993, 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:12.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347460659999996, 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:12.982 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.347406450999998, 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.335628886999999, 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:12.989 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.335393690000004, 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:12.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.334927273999995, 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:12.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:12.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:13.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:13.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:13.002 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.334668086999997, 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:13.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:13.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.334510531000006, 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:13.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:13.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:13.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.334426003000004, 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.011 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:13.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.334109949999998, 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.015 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:13.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:13.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:13.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.019 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.332143446999993, 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:13.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.332028695999995, 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.027 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.330031770000005, 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:13.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:13.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 64.329325402999999, 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:13.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:13.036 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:13.037 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.035+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:13.038 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:13.042 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:06:13.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:13.138 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:13.137+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:13.169 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:13.169 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:13.169 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:13.170 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:13.183 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:13.200 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:13.200 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:13.200 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:06:13.200 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:06:13.239 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.239+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:13.240 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:13.240 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:13.260 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:13.260 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:13.291 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:13.292 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:13.340 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.339+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:13.348 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:13.348 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:13.362 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:13.441 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.443+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:13.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:13.514 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:06:13.514 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:06:13.514 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 40, 2024-04-18T21:06:13.514 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:06:13.514 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:06:13.033982+0000", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5801984, 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "noscrub", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:06:13.515 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:06:13.516 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:06:13.517 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:13.518 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:13.519 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:13.520 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.521 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:06:13.522 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:06:13.523 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:13.524 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:13.525 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:13.526 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:06:13.527 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:13.528 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:13.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:13.530 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:13.531 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:13.532 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:13.533 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.0299999713897705, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.0299999713897705, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:06:13.534 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:06:13.535 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:13.536 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:13.537 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:13.538 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:06:13.539 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.540 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 25, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:13.541 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.542 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.544 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:13.545 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:13.546 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.547 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.548 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.549 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.550 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 36, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:13.552 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:13.556 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:13.558 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.6", 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: 2, 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.1c", 2024-04-18T21:06:13.559 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:06:13.560 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:13.561 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:06:13.563 INFO:tasks.thrashosds.thrasher:j is {'epoch': 40, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:06:13.033982+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 25, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.6', 'osds': [2, 1]}, {'pgid': '3.1c', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:06:13.563 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.1c 2024-04-18T21:06:13.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.1c 2024-04-18T21:06:13.564 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.563+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:13.630 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:13.630 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:13.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:13.663 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.663+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:13.761 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:13.761 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:13.764 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.763+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:13.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:13.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:13.863+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:13.899 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:13.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:13.966 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:13.963+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi096.stderr:clear 3.1c pg_upmap mapping 2024-04-18T21:06:14.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:14.066 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:14.065+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:14.167 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:14.169+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:14.227 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.227 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.241 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:14.287 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:14.287+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:14.364 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.364 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:14.367+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:14.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:14.469 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:14.467+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.531 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:14.570 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:14.571+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:14.651 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.652 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.665 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:14.709 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:14.709+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:14.771 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:14.771+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:14.784 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.784 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:14.872 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:14.869+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:14.930 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.930 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.944 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:14.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:14.991+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:15.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:15.069 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.070 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.073 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:15.071+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:15.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:15.173 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:15.173+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:15.249 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.249 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:15.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:15.271+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:15.313 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:15.374 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:15.375+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:15.395 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.395 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.410 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:15.443 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:15.463 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:15.475 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:15.473+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:15.483 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:15.483 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:15.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:15.575+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:15.585 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:15.585 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:15.599 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:15.677 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:15.677+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:15.722 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124546309999999, 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124425309000003, 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124352395000003, 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124282882000003, 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124247960000005, 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124202980999996, 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124137610000005, 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124088220999994, 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.124034011999996, 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.112256447999997, 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.112021251000002, 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.111554835000007, 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.111295647999995, 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.111138092000004, 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.111053564000002, 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.110737510999996, 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:15.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:15.796 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.108771008000005, 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:15.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:15.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.108656257000007, 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:15.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.106659331000003, 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.805 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:15.809 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.105952963999997, 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:15.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:15.813 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:15.815 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:15.815+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:15.815 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:15.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:15.919+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:15.950 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:15.950 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:15.964 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:16.017 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:16.015+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:16.065 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:06:16.090 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:16.091 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:16.091 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:16.091 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:16.091 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:16.106 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:16.153 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:16.153+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:16.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:16.219+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.101753649000003, 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.232 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:16.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:16.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:16.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.101720076999996, 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.238 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:16.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:16.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:16.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.101687814000002, 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.249 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 78.101572262999994, 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:16.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:16.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.255 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.634138338, 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:16.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:16.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.634025214000005, 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:16.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633946132000005, 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:16.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:16.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:16.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:16.272 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633842928000007, 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:16.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:16.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:16.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:16.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633753155999997, 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:16.278 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:16.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:16.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633667118000005, 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:16.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633603033, 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:16.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633517435000002, 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:16.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:16.299 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633451242000007, 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:16.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633381864, 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:16.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633219161, 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.310 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.315 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633068197, 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:16.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:16.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.633018688000007, 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.321 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:16.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.632953426, 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.327 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:16.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:16.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.632819245999997, 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.332 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:16.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.337 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 67.632715781000002, 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:16.341 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:16.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:16.343 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:16.343+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:16.444 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:16.443+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:16.475 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:16.477 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:16.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:16.544 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:16.543+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:16.606 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:16.606 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:16.606 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:16.606 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:16.606 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:16.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:16.645 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:16.645+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.151980257000005, 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:16.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.151879249999993, 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:16.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:16.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.151778277000005, 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:16.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.763 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.151094271000005, 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:16.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:16.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:16.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.151004494000006, 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:16.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.150858494999994, 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:16.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:16.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:16.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.150763893999994, 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:16.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.150658950999997, 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.786 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.150583999999995, 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.143249939, 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:16.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:16.794 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.139101886000006, 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:16.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:16.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:16.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.138993249999999, 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.138859519999997, 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:16.803 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:16.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.138714520999997, 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.130811993999998, 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:16.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:16.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:16.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.130556442, 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:16.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:16.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.130500600999994, 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.156173324999997, 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:16.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.153641949000004, 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.832 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.151307488, 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:16.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:16.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:16.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:16.839 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:16.839 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:16.747+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:16.840 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:16.847 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:16.845+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:16.948 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:16.947+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:16.970 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:16.970 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:16.970 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:16.970 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:16.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:17.049 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:17.047+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:17.108 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:17.108 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:17.109 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:17.109 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:17.109 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:17.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:17.150 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:17.149+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:17.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:17.251+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:17.294 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:17.294 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:17.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.696341540999995, 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:17.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:17.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.696220539999999, 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:17.300 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:17.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:17.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.305 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.696147625999998, 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:17.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:17.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:17.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.696078112999999, 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:17.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:17.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:17.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:17.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.696043191000001, 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:17.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:17.321 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.695998212000006, 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:17.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.695932841000001, 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:17.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:17.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:17.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:17.331 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.695883452000004, 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:17.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:17.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.695829243000006, 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:17.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:17.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.339 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.684051679000007, 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.683816481999997, 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.683350066000003, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.683090879000005, 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.682933323, 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.682848794999998, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.682532742000006, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.680566239000001, 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.680451488000003, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.678454561999999, 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.677748195000007, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:17.386 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:17.387 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:17.385+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:17.486 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:17.485+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:17.501 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:17.519 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:17.519 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:17.519 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:17.519 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:17.533 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:17.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:17.587+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:17.688 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:17.685+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:17.695 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:17.696 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:17.705 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:17.705 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:17.718 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:17.729 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:17.762 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:17.762 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:17.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:17.787+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:17.890 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:17.889+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:17.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:17.991 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:17.991+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:18.026 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:18.026 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:18.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:18.080 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:18.091 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:18.091+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:18.165 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:18.165 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:18.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:18.193 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:18.193+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:18.294 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:18.291+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:18.296 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:18.297 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:18.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:18.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:18.395+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:18.461 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:18.507 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:18.507+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:18.583 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:18.583 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:18.597 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:18.597 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:18.595+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:18.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:18.699+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:18.762 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:18.762 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:18.776 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:18.825 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:18.825+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:18.900 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:18.899+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:18.925 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:19.013 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:19.013+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:19.069 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:19.069 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:19.069 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:06:19.069 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:06:19.071 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:06:19.094 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.094 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:19.099+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:19.109 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:19.202 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:19.201+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:19.274 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.274 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:19.329 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:19.329+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:19.404 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:19.405+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:19.420 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.420 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:19.505 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:19.507+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:19.558 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.558 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 44, 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:06:19.067064+0000", 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5804032, 2024-04-18T21:06:19.559 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "nodeep-scrub", 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:06:19.560 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:19.561 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:19.562 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:19.563 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:19.564 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.565 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.566 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:06:19.567 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:19.568 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:19.569 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:19.570 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:19.572 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:06:19.573 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:19.574 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:19.575 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:19.576 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:19.577 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.0299999713897705, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.0299999713897705, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.578 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:19.579 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:06:19.580 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:19.581 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:19.582 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:19.584 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 41, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:19.585 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:19.586 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.588 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:06:19.589 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:19.590 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.593 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:06:19.594 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:06:19.595 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:19.596 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 36, 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:06:19.597 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.598 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:06:19.600 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:19.601 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.6", 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: 2, 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:19.603 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:06:19.604 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:19.605 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:06:19.607 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:19.608 INFO:tasks.thrashosds.thrasher:j is {'epoch': 44, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:06:19.067064+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.6', 'osds': [2, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:06:19.608 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-18T21:06:19.608 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:19.607+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:19.707 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:19.707+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:19.730 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.730 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:19.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:19.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:19.807+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:19.876 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.876 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.890 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:19.934 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:19.935+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:19.980 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:19.980 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:20.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:20.007+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:20.011 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:20.011 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:20.013 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:20.013 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:20.025 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:20.044 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:20.044 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:20.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:20.111+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:20.192 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594543565999999, 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594422565000002, 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594349651000002, 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:20.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:20.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:20.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594280138000002, 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594245216000004, 2024-04-18T21:06:20.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594200236999995, 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:20.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594134866000005, 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594085476999993, 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.594031267999995, 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.582253703999996, 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.582018507000001, 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.581552091000006, 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.581292903999994, 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.581135348000004, 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.581050820000002, 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.580734766999996, 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.578768264000004, 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.578653513000006, 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.576656587000002, 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.575950219999996, 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:20.277 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:20.279 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:20.279+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:20.279 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:20.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:20.379+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:20.411 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:20.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:20.411 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:20.411 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:20.425 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:20.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:20.479+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:20.548 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:20.548 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:20.548 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:20.548 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:20.549 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:20.563 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:20.582 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:20.579+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:20.682 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:20.683+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.557970069000007, 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:20.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:20.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.693 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.557936497, 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:20.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:20.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:20.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:20.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:20.699 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.557904234000006, 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:20.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:20.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.557788682999998, 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.705 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.710 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.090354758000004, 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:20.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:20.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:20.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.715 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.090241633999995, 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.090162551999995, 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.090059347999997, 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089969576000001, 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.736 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089883537999995, 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:20.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089819453000004, 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:20.742 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:20.747 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089733855000006, 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:20.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:20.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.752 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089667661999997, 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:20.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:20.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089598284000004, 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.758 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:20.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:20.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:20.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089435581000004, 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.763 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:20.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.768 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089284617000004, 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:20.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089235107999997, 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:20.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:20.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089169846000004, 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.781 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:20.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.089035666000001, 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:20.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:20.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:20.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:20.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:20.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.088932201000006, 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:20.791 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:20.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:20.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:20.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:20.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:20.795 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:20.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:20.797 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:20.797+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:20.897 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:20.897+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:20.928 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:20.928 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:20.928 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:20.928 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:20.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:20.998 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:20.997+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:21.066 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:21.066 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:21.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:21.099 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:21.101+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:21.102 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:21.199 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:21.199+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:21.203 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:21.203 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:21.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:21.203 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.610327898999998, 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.610226892, 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:21.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.610125918999998, 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.214 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:21.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.609441912999998, 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:21.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:21.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:21.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:21.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:21.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.609352135999998, 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:21.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:21.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.609206137000001, 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:21.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:21.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.609111536, 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:21.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.609006593000004, 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.608931642000002, 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:21.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:21.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.601597580999993, 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:21.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:21.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.597449527999999, 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:21.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.597340892000005, 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.597207162000004, 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:21.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:21.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.597062163000004, 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:21.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.589159636000005, 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:21.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:21.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:21.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.588904084000006, 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:21.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:21.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.588848243000001, 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.614520967000004, 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 71.611989590999997, 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.60965513, 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:21.291 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:21.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:21.339 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:21.339+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:21.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:21.403+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:21.424 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:21.424 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:21.424 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:21.424 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:21.438 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:21.502 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:21.501+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:21.603 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:21.603 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:21.603 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:21.603 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:21.603 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:21.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:21.603+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:21.617 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:21.662 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:06:21.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:21.703+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:21.736 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:21.736 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:21.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:21.736 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138524039000004, 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:21.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138403038000007, 2024-04-18T21:06:21.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:21.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138330124000007, 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:21.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:21.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:21.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.752 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138260611000007, 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:21.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138225688999995, 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:21.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:21.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:21.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.13818071, 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:21.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:21.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.768 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138115338999995, 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:21.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:21.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:21.773 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138065949999998, 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:21.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.138011741, 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.781 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.126234177000001, 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.125998980000006, 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:21.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.125532563999997, 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:21.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.125273376999999, 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.125115820999994, 2024-04-18T21:06:21.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.125031293000006, 2024-04-18T21:06:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.12471524, 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:21.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.122748736999995, 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.122633985999997, 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:21.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.120637060000007, 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:21.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:21.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.119930693000001, 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:21.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:21.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:21.828 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:21.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:21.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:21.831+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:21.931 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:21.929+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:21.965 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:21.965 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:21.980 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:22.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:22.031+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:22.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:22.133 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:22.129+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:22.159 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:22.234 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:22.235+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:22.261 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:22.261 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:22.294 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:22.295 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:22.323 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:22.323 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:22.327 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:22.327 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:22.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:22.335+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:22.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:22.436 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:22.433+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:22.468 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:22.468 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:22.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:22.537 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:22.535+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:22.605 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:22.605 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:22.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:22.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:22.667+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:22.738 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:22.739+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:22.757 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:22.839 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:22.841+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:22.888 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:22.888 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:22.903 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:22.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:22.939+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:23.025 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:23.025 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:23.038 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:23.040 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:23.039+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:23.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:23.139+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:23.169 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:23.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:23.243+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:23.301 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:23.301 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:23.316 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:23.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:23.343+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:23.437 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:23.437 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:23.444 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:23.443+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:23.451 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:23.545 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:23.541+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:23.569 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:23.569 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:23.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:23.645 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:23.643+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:23.688 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:23.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:23.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:23.779+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:23.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:23.847+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:23.856 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:23.857 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:23.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:23.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:23.963+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:24.036 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.036 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.048 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:24.047+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:24.050 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:24.149 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:24.145+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:24.180 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.180 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.194 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:24.250 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:24.247+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:24.315 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.315 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.329 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:24.350 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:24.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:24.351+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:24.454 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:24.453+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:24.487 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.487 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.501 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:24.546 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:24.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:24.555+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:24.579 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:24.579 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:24.609 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:24.609 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:24.609 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-18T21:06:24.609 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:06:24.609 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:06:24.610 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-18T21:06:24.611 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:24.611 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:24.632 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:24.632 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:24.632 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:24.632 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:24.647 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:24.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:24.655+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:06:24.737 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "" 2024-04-18T21:06:24.737 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:24.756 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:24.759+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:24.771 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:24.771 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:24.771 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:24.771 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:24.772 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:24.785 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:24.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:24.855+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:24.907 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:24.907 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:24.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:24.907 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:24.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.777637787000003, 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:24.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:24.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.913 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.777604214999997, 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:24.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:24.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.777571952000002, 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.919 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:24.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:24.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:24.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.777456400999995, 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:24.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.930 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.310022476, 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309909352000005, 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:24.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309830270000006, 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.941 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309727065999994, 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:24.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:24.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:24.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309637293999998, 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:24.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:24.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309551256000006, 2024-04-18T21:06:24.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:24.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:24.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309487171000001, 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:24.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:24.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:24.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309401573000002, 2024-04-18T21:06:24.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:24.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:24.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309335379999993, 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309266002000001, 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:24.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:24.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:24.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.309103299, 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.984 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:24.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:24.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.308952335000001, 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.308902825999994, 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:24.995 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:24.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:24.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:25.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.308837564000001, 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:25.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.308703383999998, 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:25.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:25.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:25.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.308599919000002, 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:25.011 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:25.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:25.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:25.015 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:25.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:25.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:25.015+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:25.118 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:25.115+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:25.147 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:25.148 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:25.148 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:25.148 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:25.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:25.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:25.219+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:25.279 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:25.279 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:25.279 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:25.279 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:25.279 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:25.292 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:25.319 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:25.321+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:25.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:25.419+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.860945650999994, 2024-04-18T21:06:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.860844643999997, 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.860743670999994, 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.860059664999994, 2024-04-18T21:06:25.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:25.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:25.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.859969887999995, 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:25.477 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.859823888999998, 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:25.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:25.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:25.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.859729287999997, 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:25.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.859624345, 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.859549393999998, 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:25.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:25.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.499 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.852215333000004, 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:25.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:25.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:25.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.503 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.848067279999995, 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.847958644000002, 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:25.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:25.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.847824914, 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:25.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.847679915000001, 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:25.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:25.519 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.839777388000002, 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.839521836000003, 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:25.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 76.839465994999998, 2024-04-18T21:06:25.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:25.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:25.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:25.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.865138719000001, 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:25.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 75.862607342999993, 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:25.535 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:25.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:25.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:25.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.860272881999997, 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:25.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:25.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:25.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:25.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:25.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:25.544 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:25.545 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:25.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:25.543+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:25.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:25.647+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:25.678 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:25.678 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:25.678 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:25.678 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:25.692 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:25.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:25.747+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:25.807 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:25.807 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:25.808 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:25.808 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:25.808 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:25.822 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:25.849 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:25.851+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:25.947 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:25.947 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:25.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:25.947 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:25.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.349326938000004, 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.349205936999994, 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.349133022999993, 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.349063509999993, 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:25.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:25.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.349028587999996, 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.348983609000001, 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:25.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.348918237999996, 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:25.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.982 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.348868848999999, 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:25.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.348814640000001, 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.337037076000001, 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:25.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.336801879000006, 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:25.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.996 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.336335462999998, 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:25.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:25.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:25.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.000 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.336076276, 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.335918719999995, 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.335834191999993, 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.009 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:26.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:26.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:26.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.335518139000001, 2024-04-18T21:06:26.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.333551635999996, 2024-04-18T21:06:26.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:26.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:26.021 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.333436884999998, 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:26.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:26.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:26.025 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.331439958999994, 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.330733592000001, 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:26.029 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:26.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:26.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:26.033 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:26.034 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:26.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:26.035+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:26.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:26.135+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:26.165 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:26.165 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:26.165 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:26.165 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:26.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:26.237 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:26.235+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:26.301 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:26.301 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:26.301 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:26.301 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:26.301 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:26.315 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:26.361 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:26.361+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:26.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:26.439+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.311341096000007, 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.311307524, 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.311275261000006, 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 88.311159709999998, 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843725785000004, 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843612660999995, 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843533578999995, 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843430374999997, 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843340603000001, 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843254564999995, 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843190480000004, 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843104882000006, 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.843038688999997, 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.842969311000004, 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.842806608000004, 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.842655644000004, 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.842606134999997, 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.842540873000004, 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.842406693000001, 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.842303228000006, 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:26.542 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:26.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:26.543 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:26.543+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:26.633 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:26.644 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:26.645+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:26.673 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:26.673 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:26.674 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:26.674 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:26.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:26.692 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:26.744 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:26.741+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:26.809 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:26.809 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:26.809 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:26.810 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:26.810 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:26.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:26.832 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:26.845 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:26.843+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:26.864 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:26.864 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:26.898 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:26.898 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:26.941 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:26.941 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:26.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:26.943+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:26.956 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:27.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:27.047+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:27.088 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:27.088 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:27.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:27.154 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:27.155+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:27.224 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:27.224 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:27.238 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:27.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:27.247+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:27.349 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:27.347+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:27.405 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:27.405 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:27.419 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:27.463 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:27.463+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:27.551 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:27.551+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:27.553 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:27.553 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:27.568 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:27.651 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:27.649+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:27.683 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:06:27.691 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:27.691 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:27.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:27.793 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:27.793+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:27.853 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:27.849+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:27.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:27.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:27.955+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:28.016 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.016 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:28.055 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:28.053+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:28.156 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:28.155+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:28.192 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.192 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:28.256 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:28.257+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:28.333 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.333 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:28.391 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:28.391+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:28.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:28.455+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:28.477 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.477 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.491 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:28.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:28.559+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:28.657 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.658 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.659 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:28.659+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:28.672 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:28.759 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:28.759+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:28.838 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.839 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.853 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:28.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:28.859+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:28.920 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:28.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:28.963+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:28.987 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.988 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.001 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:29.062 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:29.063+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:29.116 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:29.116 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:29.119 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:29.119 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:29.120 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:29.120 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:29.120 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:29.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:29.148 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:29.148 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:29.181 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:29.181 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:29.181 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:29.181+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:29.258 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.258 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.130149857000006, 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:29.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:29.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.130116285, 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:29.264 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:29.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.130084022000005, 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:29.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:29.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:29.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:29.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.129968470999998, 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:29.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.662534546000003, 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:29.281 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:29.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:29.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.662421421999994, 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:29.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:29.291 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.662342339999995, 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.662239135999997, 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.297 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:29.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:29.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:29.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.662149364000001, 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.307 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.662063325999995, 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:29.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:29.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661999241000004, 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:29.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661913643000005, 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.318 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:29.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.323 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661847449999996, 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.328 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661778072000004, 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:29.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661615369000003, 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.334 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.339 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661464405000004, 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661414895999997, 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661349634000004, 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.350 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.355 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661215454000001, 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:29.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:29.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 80.661111989000005, 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:29.361 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:29.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:29.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:29.365 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:29.369 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:29.370 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:29.367+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:29.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:29.467+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:29.501 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:29.501 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:29.501 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:29.515 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:29.568 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:29.569+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:29.669 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:29.669+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:29.682 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:29.682 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:29.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:29.708 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:29.751 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:29.752 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:29.752 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-18T21:06:29.752 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:06:29.752 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:06:29.752 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-18T21:06:29.770 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:29.767+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:29.813 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.219925571000005, 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.219824564000007, 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.219723591000005, 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.219039585000004, 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.218949808000005, 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.218803808999994, 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.218709208000007, 2024-04-18T21:06:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.218604264999996, 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.218529313999994, 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.211195253, 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:29.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.207047200000005, 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.206938563999998, 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.206804833999996, 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:29.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.875 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.206659834999996, 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:29.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:29.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.198757307999998, 2024-04-18T21:06:29.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.198501755999999, 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.884 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:29.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.198445914999994, 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 80.224118638999997, 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 80.221587263000004, 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.219252802, 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:29.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:29.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:29.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:29.905 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:29.907 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:29.907 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-18T21:06:29.907 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:29.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:29.908 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:29.907+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:30.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:30.007+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:30.043 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:30.043 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:30.043 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:30.043 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:30.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:30.108 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:30.105+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:30.176 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:30.176 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:30.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:30.235 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:30.235+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:30.310 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:30.310 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:30.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:30.310 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:30.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711839615000002, 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:30.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:30.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:30.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711718614000006, 2024-04-18T21:06:30.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:30.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711645700000005, 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.322 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:30.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.327 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711576187000006, 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:30.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:30.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711541264999994, 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.338 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711496285999999, 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:30.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:30.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:30.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711430914999994, 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:30.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:30.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:30.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711381525999997, 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.350 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:30.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.711327316999999, 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.354 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:30.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:30.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.699549752999999, 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:30.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:30.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.361 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.699314556000004, 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:30.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.698848139999996, 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:30.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:30.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.698588952999998, 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:30.370 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.698431396999993, 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.378 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.698346869000005, 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:30.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:30.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:30.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.698030815999999, 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:30.387 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.696064312999994, 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:30.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.695949561999996, 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:30.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.693952636000006, 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.397 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:30.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:30.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:30.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.693246268999999, 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:30.401 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:30.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:30.405 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:30.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:30.311+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:30.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:30.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:30.411+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:30.511 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:30.509+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:30.541 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:30.541 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:30.556 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:30.612 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:30.611+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:06:30.713 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:30.711+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:30.721 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:30.721 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:30.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:30.814 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:30.813+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:30.863 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:30.863 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:30.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:30.863 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.733258621999994, 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:30.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.733225050000001, 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.869 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:30.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:30.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:30.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.733192786999993, 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:30.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:30.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:30.880 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.733077236, 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.886 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265643311000005, 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:30.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:30.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:30.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.891 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265530186999996, 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:30.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:30.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265451104999997, 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.897 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:30.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:30.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:30.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:30.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265347900999998, 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.902 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:30.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:30.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:30.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265258129000003, 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.907 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:30.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:30.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:30.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:30.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265172090999997, 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.912 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265108006000006, 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.265022407999993, 2024-04-18T21:06:30.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:30.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:30.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264956214999998, 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.927 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:30.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.932 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264886837000006, 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:30.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:30.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:30.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:30.937 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264724134000005, 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:30.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:30.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264573170000006, 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264523660999998, 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264458399000006, 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264324219000002, 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.264220753999993, 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:30.969 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:30.970 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:30.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:30.971+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:31.071 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:31.071+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:31.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:31.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:31.171+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:31.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:31.229 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:31.229 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:31.229 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:31.229 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:31.229 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:31.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:31.272 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:31.271+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:31.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:31.371+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:31.398 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:31.399 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.811962026000003, 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.407 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:31.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:31.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.811861019000006, 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:31.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:31.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:31.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.811760046000003, 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:31.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:31.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:31.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.811076040000003, 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.810986263000004, 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.810840264000007, 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.810745663000006, 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.810640719999995, 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.810565768999993, 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.803231707999998, 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.799083655000004, 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.798975018999997, 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.798841288999995, 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.798696289999995, 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.790793762999996, 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.790538210999998, 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.790482370000007, 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.816155093999996, 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.813623718000002, 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.811289256999999, 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:31.499 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:31.500 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:31.501 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:31.501 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:31.502 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:31.499+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:31.601 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:31.599+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:31.645 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:31.702 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:31.701+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:31.802 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:31.801+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:31.813 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:31.813 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:31.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:31.904 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:31.901+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:31.950 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:31.950 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:31.964 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:32.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:32.007+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:32.105 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:32.107+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:32.111 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:32.206 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:32.205+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:32.233 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:32.233 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:32.247 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:32.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:32.307+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:32.407 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:32.407+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:32.411 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:32.411 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:32.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:32.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:32.507+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:32.560 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:32.560 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:32.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:32.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:32.619+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:32.710 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:32.709+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:32.721 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:32.738 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:32.738 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:32.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:32.811 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:32.813+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:32.874 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:32.874 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:32.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:32.912 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:32.913+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:33.013 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:33.011+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:33.019 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.019 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.035 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:33.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:33.115+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:33.198 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.198 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.214 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:33.215 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:33.215+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:33.316 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:33.315+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:33.337 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.337 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.351 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:33.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:33.419+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:33.483 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.483 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.498 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:33.503 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:33.518 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:33.515+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:33.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:33.619+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:33.619 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.619 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.634 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:33.693 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:33.707 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:06:33.717 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:33.717 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:33.719 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:33.719+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:33.737 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:33.737 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:33.755 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.625468061000007, 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.625434489, 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.625402226000006, 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.772 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.625286674999998, 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:33.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:33.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157852750000004, 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.778 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:33.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:33.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:33.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:33.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157739625999994, 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.783 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157660543999995, 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:33.788 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157557339999997, 2024-04-18T21:06:33.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:33.798 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157467568000001, 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:33.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:33.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157381529999995, 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:33.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:33.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:33.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:33.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157317445000004, 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157231847000006, 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157165653999996, 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:33.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.157096276000004, 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.156933573000003, 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:33.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:33.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:33.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:33.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:33.837 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.837 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.837 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.837 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.837 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:33.838 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.156782609000004, 2024-04-18T21:06:33.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:33.838 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.838 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.838 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.839 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:33.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:33.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:33.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:33.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:33.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:33.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:33.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:33.846 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.156733099999997, 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.156667838000004, 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:33.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:33.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:33.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.156533658000001, 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.857 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:33.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:33.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:33.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 85.156430193000006, 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:33.862 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:33.866 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:33.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:33.868 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:33.869+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:33.969 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:33.969+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:33.999 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:33.999 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:33.999 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:34.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:34.070 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:34.069+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:34.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:34.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:34.191+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:34.264 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:34.264 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.669742696, 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:34.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:34.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:34.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.669641689000002, 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:34.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:34.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:34.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.669540716, 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:34.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.66885671, 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:34.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.286 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.668766933000001, 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:34.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.668620934000003, 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.292 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:34.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:34.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:34.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.668526333000003, 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:34.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.668421390000006, 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:34.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.668346439000004, 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:34.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.661012377999995, 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:34.310 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:34.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:34.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.656864325000001, 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:34.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.656755688999993, 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:34.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:34.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.656621959000006, 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:34.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.656476960000006, 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:34.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:34.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.648574432999993, 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:34.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:34.334 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.648318880999994, 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.648263040000003, 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:34.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.673935764000007, 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:34.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:34.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 84.671404387999999, 2024-04-18T21:06:34.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:34.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:34.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.669069926999995, 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:34.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:34.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:34.355 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:34.357 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:34.357 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:34.357+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:34.458 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:34.457+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:34.489 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:34.490 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:34.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:34.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:34.559+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:34.619 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:34.619 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:34.633 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:34.660 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:34.657+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:34.752 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:34.752 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:34.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:34.752 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:34.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.154257435000005, 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:34.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.154136433999994, 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:34.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:34.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.154063519999994, 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:34.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.153994006999994, 2024-04-18T21:06:34.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:34.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:34.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.773 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.153959084999997, 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:34.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:34.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.153914106000002, 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:34.779 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:34.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.153848734999997, 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:34.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.153799346, 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.153745137000001, 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:34.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.141967573000002, 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.141732375999993, 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.141265959999998, 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.805 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.141006773000001, 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.810 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:34.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:34.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.140849216999996, 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:34.814 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:34.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.818 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.140764688999994, 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096816439999999997, 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:34.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610989+0000", 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610990+0000", 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8400000000000003e-07 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611010+0000", 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0676e-05 2024-04-18T21:06:34.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611027+0000", 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6855999999999999e-05 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611041+0000", 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.401e-05 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613948+0000", 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002906418 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613992+0000", 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4521999999999998e-05 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620594+0000", 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006601244 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620671+0000", 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7033999999999995e-05 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.140448636000002, 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.823 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:34.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:34.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.138482132999997, 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073376099999999996, 2024-04-18T21:06:34.827 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613271+0000", 2024-04-18T21:06:34.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613273+0000", 2024-04-18T21:06:34.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3570000000000001e-06 2024-04-18T21:06:34.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613301+0000", 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613327+0000", 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5689000000000001e-05 2024-04-18T21:06:34.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613345+0000", 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613512+0000", 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167269 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613572+0000", 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9274999999999997e-05 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620536+0000", 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069645619999999997 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620609+0000", 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2915000000000002e-05 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:34.832 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.138367381999998, 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073134330000000003, 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613386+0000", 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613387+0000", 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613397+0000", 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3389999999999999e-06 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613414+0000", 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7713000000000001e-05 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613432+0000", 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8170000000000001e-05 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613995+0000", 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056240299999999995 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.614045+0000", 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0436000000000003e-05 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620614+0000", 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065682700000000002 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620700+0000", 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6044999999999994e-05 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:9 3.10 e17/15 3:09401a81:::601.00000000:head v 17'4, mlcod=0'0)", 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.136370455999995, 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066403290000000004, 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615384+0000", 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615431+0000", 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7191999999999998e-05 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615449+0000", 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.806e-05 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.615463+0000", 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3835999999999999e-05 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618220+0000", 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027568279999999998 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618270+0000", 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9468999999999997e-05 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621931+0000", 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036619159999999999 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622023+0000", 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2040999999999995e-05 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.841 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 86.135664089000002, 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065143049999999997, 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:34.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616090+0000", 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3300000000000001e-07 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7370000000000001e-06 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616143+0000", 2024-04-18T21:06:34.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2964999999999999e-05 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616156+0000", 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2556e-05 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619287+0000", 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031318829999999998 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619338+0000", 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0429000000000001e-05 2024-04-18T21:06:34.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622523+0000", 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003184634 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:34.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.622604+0000", 2024-04-18T21:06:34.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1267999999999995e-05 2024-04-18T21:06:34.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.846 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:34.846 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:34.847 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:34.848 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:34.847+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:34.848 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:34.908 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:34.908 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:34.908 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:06:34.909 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:06:34.948 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:34.945+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:34.981 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:34.981 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:34.981 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:34.982 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:34.997 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:35.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:35.047+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:35.151 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:35.151+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:35.165 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:35.166 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:35.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 49, 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:06:33.699233+0000", 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:06:35.197 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5799936, 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:06:35.198 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:35.200 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:35.201 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:35.202 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:06:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.0299999713897705, 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.0299999713897705, 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.0299999713897705, 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.0299999713897705, 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:06:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:06:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 41, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:06:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:06:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:06:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:06:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 16, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 36, 2024-04-18T21:06:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "3.6", 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: 2, 2024-04-18T21:06:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:06:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:35.242 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:06:35.244 INFO:tasks.thrashosds.thrasher:j is {'epoch': 49, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:06:33.699233+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.6', 'osds': [2, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:06:35.244 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.6 2024-04-18T21:06:35.244 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.6 2024-04-18T21:06:35.251 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:35.249+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.175164191999997, 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:35.303 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:35.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.175130620000004, 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.309 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:35.315 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.175098356999996, 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:35.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.321 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 97.174982806000003, 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:35.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:35.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.707548880999994, 2024-04-18T21:06:35.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:35.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.707435756999999, 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:35.333 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:35.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:35.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:35.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:35.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.707356675, 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:35.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:35.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.344 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.707253471000001, 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.707163699000006, 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:35.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:35.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.707077661, 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:35.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:35.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:35.361 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.707013575999994, 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706927977999996, 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.367 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:35.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:35.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706861785000001, 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:35.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:35.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:35.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706792406999995, 2024-04-18T21:06:35.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:35.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:35.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:35.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.384 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706629703999994, 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706478739999994, 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.390 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:35.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:35.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:35.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706429231000001, 2024-04-18T21:06:35.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:35.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:35.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706363968999995, 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.401 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706229789000005, 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:35.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.706126323999996, 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:35.412 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:35.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:35.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:35.417 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:35.417 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:35.418 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:35.419 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:35.419+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:35.519 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:35.521+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:35.549 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:35.549 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:35.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:35.620 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:35.619+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:35.690 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:35.690 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:35.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:35.708 INFO:teuthology.orchestra.run.smithi096.stderr:clear 3.6 pg_upmap mapping 2024-04-18T21:06:35.721 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:35.719+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:35.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:35.754 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:35.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:35.819+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.228014341999994, 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.227913334999997, 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.227812361999995, 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.227128355999994, 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.227038578999995, 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.226892579999998, 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.226797978999997, 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.226693036, 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.226618084999998, 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.219284024000004, 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.215135970999995, 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.215027335000002, 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.214893605, 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.214748606000001, 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.206846079000002, 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.206590527000003, 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.206534685999998, 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 86.232207410000001, 2024-04-18T21:06:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 86.229676033999993, 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.227341573000004, 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:35.913 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:35.913 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:35.914 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:35.914 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:35.931 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:35.949 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:35.949 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:35.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:35.959+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:36.023 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:36.021+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:36.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:36.124 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:36.123+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:36.180 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:36.180 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:36.195 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:36.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:36.227+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:36.325 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:36.323+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:36.359 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:36.359 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:36.373 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:36.426 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:36.427+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:36.519 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:36.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:36.527+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:Note: switching to 'c46a99d99fa3e2dad10a5ce96141fec909e651df'. 2024-04-18T21:06:36.531 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T21:06:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-18T21:06:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-18T21:06:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:state without impacting any branches by switching back to a branch. 2024-04-18T21:06:36.531 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr: git switch -c 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr:Or undo this operation with: 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr: git switch - 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-18T21:06:36.532 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T21:06:36.533 INFO:tasks.workunit.client.0.smithi096.stderr:HEAD is now at c46a99d99fa Merge pull request #56974 from rhcs-dashboard/fix-xmlsec-issue 2024-04-18T21:06:36.534 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-18T21:06:36.540 INFO:tasks.workunit.client.0.smithi096.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-18T21:06:36.543 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T21:06:36.543 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-18T21:06:36.627 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:36.627+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:36.644 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:36.644 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:36.659 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:36.725 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:06:36.729 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:36.727+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:36.775 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:36.775 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:36.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:36.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:36.835+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:36.923 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:36.923 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:36.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:36.927+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:36.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:37.030 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:37.031+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:37.103 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:37.103 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:37.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:37.131 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:37.131+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:37.233 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:37.235+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:37.243 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:37.243 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:37.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:37.323 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-18T21:06:37.333 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:37.333+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:37.388 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:37.388 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:37.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:37.419 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-18T21:06:37.446 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:37.447+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:37.484 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T21:06:37.485 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T21:06:37.485 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:37.533 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T21:06:37.535 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:37.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:37.535+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:37.537 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:06:37.537 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-18T21:06:37.542 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-18T21:06:37.543 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-18T21:06:37.544 DEBUG:teuthology.orchestra.run.smithi096:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c46a99d99fa3e2dad10a5ce96141fec909e651df TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-18T21:06:37.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ mkdir -p fsstress 2024-04-18T21:06:37.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd fsstress 2024-04-18T21:06:37.596 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:37.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-18T21:06:37.635 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:37.635+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:37.702 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:37.703 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:37.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:37.761 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:37.761+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:37.837 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:37.835+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:37.850 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:37.850 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:37.864 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:37.950 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:37.949+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:37.966 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:38.028 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.029 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:38.039+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:38.044 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:38.127 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:38.127 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:38.140 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:38.139+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:38.148 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:38.148 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:38.174 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:38.175 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:38.213 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:38.213 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:38.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:38.213 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.084833168, 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:38.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:38.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.219 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.084799596, 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.084767333, 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.225 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:38.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:38.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:38.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 100.08465178199999, 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:38.230 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:38.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:38.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:38.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.235 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.617217857, 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:38.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:38.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:38.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.617104733000005, 2024-04-18T21:06:38.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:38.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:38.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:38.246 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.617025651000006, 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:38.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:38.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:38.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616922446999993, 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:38.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.257 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.258 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.258 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:38.258 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616832674999998, 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:38.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:38.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:38.263 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616746637000006, 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:38.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616682552, 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.269 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.274 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616596954000002, 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:38.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616530761000007, 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.280 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:38.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:38.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616461383000001, 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.285 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.61629868, 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019720611999999998, 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597646+0000", 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597648+0000", 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597655+0000", 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9670000000000004e-06 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597674+0000", 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8889000000000002e-05 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597686+0000", 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.255e-05 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603549+0000", 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058632019999999997 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603753+0000", 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000203616 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604100+0000", 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034689200000000001 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615015+0000", 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010914858 2024-04-18T21:06:38.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617003+0000", 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019878389999999999 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617261+0000", 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025806400000000001 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617367+0000", 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000106465 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616147716, 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.296 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:38.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616098206999993, 2024-04-18T21:06:38.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:38.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.306 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.616032945000001, 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:38.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:38.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:38.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.312 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.615898764999997, 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:38.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:38.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.317 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 89.615795300000002, 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:38.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:38.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:38.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:38.321 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:38.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:38.323 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:38.323+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:38.424 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:38.421+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:38.456 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:38.456 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:38.470 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:38.525 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:38.523+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:38.593 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:38.593 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:38.594 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:38.594 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:38.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ tar xzf ltp-full.tgz 2024-04-18T21:06:38.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:38.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:38.655+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:38.727 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:38.725+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:38.748 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.157808399999993, 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0205953, 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.752 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594900+0000", 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594903+0000", 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0759999999999999e-06 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594916+0000", 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3687e-05 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594944+0000", 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7596000000000001e-05 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.594963+0000", 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9122000000000001e-05 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595094+0000", 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013103600000000001 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595987+0000", 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089317300000000004 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596367+0000", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037990799999999998 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604355+0000", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079878550000000003 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615287+0000", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010932140999999999 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615383+0000", 2024-04-18T21:06:38.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5987000000000001e-05 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615495+0000", 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011171900000000001 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.157707392999995, 2024-04-18T21:06:38.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020739546000000001, 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595001+0000", 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595002+0000", 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595013+0000", 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1379999999999999e-05 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595038+0000", 2024-04-18T21:06:38.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4743e-05 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595074+0000", 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597011+0000", 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019367340000000001 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018906399999999999 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034374299999999998 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604387+0000", 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068432730000000004 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615601+0000", 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011213951999999999 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615689+0000", 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7954000000000005e-05 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.615740+0000", 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1431999999999998e-05 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.157606419999993, 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027842291000000002, 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:38.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595102+0000", 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595103+0000", 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595111+0000", 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1340000000000004e-06 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595131+0000", 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595146+0000", 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596989+0000", 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001843477 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597252+0000", 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000262642 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597543+0000", 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029177400000000002 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604374+0000", 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068302500000000004 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622753+0000", 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018379178999999999 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622833+0000", 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0507999999999996e-05 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.622944+0000", 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110399 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.156922413999993, 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027426309999999999, 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595786+0000", 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595788+0000", 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0999999999999998e-06 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595800+0000", 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1976e-05 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595825+0000", 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5760000000000001e-05 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595846+0000", 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0548999999999999e-05 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032171410000000002 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599273+0000", 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020981 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599604+0000", 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033073299999999999 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.604400+0000", 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004796369 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623052+0000", 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018652314 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623144+0000", 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1516999999999998e-05 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623212+0000", 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8040999999999994e-05 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.156832636999994, 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020893301, 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595875+0000", 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595877+0000", 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595886+0000", 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T21:06:38.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595975+0000", 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9697000000000005e-05 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.595994+0000", 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599373+0000", 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033785999999999998 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.599683+0000", 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031042 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.600007+0000", 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032375699999999998 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.605330+0000", 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053232230000000002 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616515+0000", 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011184965999999999 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616652+0000", 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013694600000000001 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616769+0000", 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011667600000000001 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.777 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.156686637999996, 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020587404, 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596021+0000", 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596023+0000", 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596031+0000", 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3529999999999995e-06 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596054+0000", 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3295999999999999e-05 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596069+0000", 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5062000000000001e-05 2024-04-18T21:06:38.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596238+0000", 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168565 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596514+0000", 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027598500000000002 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596820+0000", 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030565099999999999 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602078+0000", 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052579080000000004 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616371+0000", 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014293393999999999 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616497+0000", 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126057 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616609+0000", 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111716 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.156592036999996, 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020865549000000001, 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596116+0000", 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596118+0000", 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6330000000000001e-06 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596130+0000", 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596151+0000", 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0429e-05 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596174+0000", 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3319000000000002e-05 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597785+0000", 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016107610000000001 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.598538+0000", 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075345000000000002 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616981+0000", 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018443154 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.156487093999999, 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020834930000000002, 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596221+0000", 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596223+0000", 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.88e-06 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596230+0000", 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6590000000000007e-06 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596250+0000", 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0007e-05 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596269+0000", 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8549000000000001e-05 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602602+0000", 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063333460000000001 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.602821+0000", 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021829999999999999 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617056+0000", 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014235189000000001 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.156412142999997, 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026775017000000002, 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596296+0000", 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596297+0000", 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959999999999999e-06 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596316+0000", 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8507000000000001e-05 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596340+0000", 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3869000000000001e-05 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596361+0000", 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0976e-05 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.596844+0000", 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048367199999999999 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.597007+0000", 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016239499999999999 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.623071+0000", 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026064101999999999 2024-04-18T21:06:38.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.149078082000003, 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648549, 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603630+0000", 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603631+0000", 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.344e-06 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603651+0000", 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603682+0000", 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1136000000000001e-05 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603708+0000", 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5646000000000001e-05 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.603881+0000", 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173358 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.606278+0000", 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023972799999999999 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:38.798 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.144930028999994, 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039278029999999997, 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607778+0000", 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607779+0000", 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607811+0000", 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2552000000000003e-05 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607830+0000", 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972999999999999e-05 2024-04-18T21:06:38.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607848+0000", 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7408999999999999e-05 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607973+0000", 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125203 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608016+0000", 2024-04-18T21:06:38.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3545999999999999e-05 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611594+0000", 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035772099999999999 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611706+0000", 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112057 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.144821393000001, 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044203039999999999, 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607887+0000", 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607888+0000", 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607902+0000", 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4980000000000001e-05 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607922+0000", 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9502999999999999e-05 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.607953+0000", 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1338999999999999e-05 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608652+0000", 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000698995 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608703+0000", 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0225000000000001e-05 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612200+0000", 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003497923 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.612307+0000", 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106359 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.144687662999999, 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037112260000000002, 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608020+0000", 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608021+0000", 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608044+0000", 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2625000000000001e-05 2024-04-18T21:06:38.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608065+0000", 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.177e-05 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608078+0000", 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3036e-05 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608273+0000", 2024-04-18T21:06:38.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019435399999999999 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608317+0000", 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4515999999999999e-05 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611640+0000", 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033225310000000001 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611731+0000", 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1734e-05 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.144542663999999, 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037178250000000001, 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608165+0000", 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608166+0000", 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-04-18T21:06:38.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608176+0000", 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7759999999999992e-06 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608192+0000", 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6523000000000001e-05 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608229+0000", 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239e-05 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608891+0000", 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066179300000000004 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.608943+0000", 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909000000000001e-05 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611799+0000", 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557919999999998 2024-04-18T21:06:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.611883+0000", 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4179999999999997e-05 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.136640137000001, 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055477300000000005, 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616068+0000", 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616069+0000", 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616077+0000", 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616100+0000", 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2696000000000001e-05 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616116+0000", 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616269+0000", 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015320500000000001 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616356+0000", 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6914000000000002e-05 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616623+0000", 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026687899999999998 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.136384585000002, 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074100000000000001, 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:38.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616323+0000", 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616324+0000", 2024-04-18T21:06:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616329+0000", 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3669999999999996e-06 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616345+0000", 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5716e-05 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616359+0000", 2024-04-18T21:06:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3825999999999999e-05 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616839+0000", 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000480209 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225169 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 5 lcod 17'2)", 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 90.136328743999997, 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000613348, 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616379+0000", 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616380+0000", 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6000000000000004e-07 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616384+0000", 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616399+0000", 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5449999999999999e-05 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616410+0000", 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039000000000001e-05 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616720+0000", 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030957800000000002 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027250100000000003 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.162001468, 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030648120000000001, 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590706+0000", 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590709+0000", 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7760000000000002e-06 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590723+0000", 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3487e-05 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590755+0000", 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2082000000000002e-05 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590770+0000", 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.590888+0000", 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117516 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591108+0000", 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022004300000000001 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.591286+0000", 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000178078 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.592450+0000", 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011635510000000001 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593481+0000", 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031618 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593622+0000", 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014087299999999999 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593771+0000", 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149178 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e17/15 ondisk, result = 0)", 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.159470092000007, 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055313599999999997, 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593238+0000", 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593240+0000", 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.826e-06 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593251+0000", 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0936e-05 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593280+0000", 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9519e-05 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593293+0000", 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3107e-05 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593412+0000", 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118486 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593464+0000", 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2651999999999997e-05 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:09.593791+0000", 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032661000000000002 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:38.835 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.157135631000003, 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027119599999999998, 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:38.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595572+0000", 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595576+0000", 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595593+0000", 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595628+0000", 2024-04-18T21:06:38.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4836000000000003e-05 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595645+0000", 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7003e-05 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595817+0000", 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017179700000000001 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:38.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.595969+0000", 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152323 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.596186+0000", 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021680899999999999 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597604+0000", 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001418079 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.597996+0000", 2024-04-18T21:06:38.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206199999999999 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598158+0000", 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016241399999999999 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:05:28.598284+0000", 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012584099999999999 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:38.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:38.841 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:38.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:38.843 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:38.839+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:38.942 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:38.943+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:38.979 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:38.979 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:38.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:39.043 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:39.041+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:39.144 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:39.143+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:39.175 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:39.175 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:39.191 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:39.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:39.243+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:39.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:39.343+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:39.370 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:39.370 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:39.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:39.370 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:39.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.370 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.77201565, 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022107585999999999, 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597496+0000", 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597499+0000", 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.79e-06 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597512+0000", 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3263e-05 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597556+0000", 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3643000000000002e-05 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597575+0000", 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8788999999999999e-05 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597705+0000", 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013009999999999999 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597957+0000", 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025183099999999999 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598271+0000", 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031451599999999998 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601762+0000", 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034909260000000001 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619369+0000", 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017606726999999999 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619494+0000", 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012534300000000001 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619604+0000", 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109658 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771894649000004, 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023074364999999999, 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597617+0000", 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597618+0000", 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597625+0000", 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0500000000000003e-06 2024-04-18T21:06:39.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597638+0000", 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2439999999999999e-05 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597647+0000", 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9560000000000003e-06 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599063+0000", 2024-04-18T21:06:39.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001415967 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599319+0000", 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000255887 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599712+0000", 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039326999999999998 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601781+0000", 2024-04-18T21:06:39.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020688709999999999 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620428+0000", 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018647718000000001 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620584+0000", 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015558600000000001 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620692+0000", 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107544 2024-04-18T21:06:39.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771821735000003, 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022632353000000001, 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:39.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597690+0000", 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597691+0000", 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597719+0000", 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8164e-05 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597732+0000", 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979000000000001e-05 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597742+0000", 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8330000000000006e-06 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599015+0000", 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012728500000000001 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599244+0000", 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022945100000000001 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599413+0000", 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016853899999999999 2024-04-18T21:06:39.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601774+0000", 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023608639999999998 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619705+0000", 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017931744999999999 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.619848+0000", 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014287999999999999 2024-04-18T21:06:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620322+0000", 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047423799999999998 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771752222000003, 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023333851999999999, 2024-04-18T21:06:39.386 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597760+0000", 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597761+0000", 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597765+0000", 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597775+0000", 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4560000000000006e-06 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597782+0000", 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5259999999999996e-06 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599846+0000", 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002063788 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599982+0000", 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135814 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600234+0000", 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025203699999999999 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.601788+0000", 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015538800000000001 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620820+0000", 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019031935 2024-04-18T21:06:39.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620982+0000", 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016238900000000001 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621093+0000", 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111264 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.391 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771717300000006, 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019882350999999999, 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597795+0000", 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0330000000000002e-06 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:39.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597817+0000", 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7260000000000008e-06 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597919+0000", 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102475 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598188+0000", 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026905000000000001 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598452+0000", 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026313999999999998 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600145+0000", 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001693684 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616822+0000", 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016676337999999999 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616993+0000", 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017152899999999999 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617677+0000", 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068380299999999997 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.396 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771672320999997, 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020306807999999999, 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597839+0000", 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597841+0000", 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.72e-06 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597866+0000", 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597882+0000", 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.571e-05 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599072+0000", 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001189358 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599263+0000", 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000191962 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.599544+0000", 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028032000000000003 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600743+0000", 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001199208 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.617839+0000", 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017096248000000001 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618013+0000", 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173282 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.618146+0000", 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133774 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771606950000006, 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023492473, 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597905+0000", 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597906+0000", 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-04-18T21:06:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9529999999999999e-06 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7750000000000001e-05 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597943+0000", 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0971999999999999e-05 2024-04-18T21:06:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600258+0000", 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023157619999999999 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600585+0000", 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032641899999999999 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.600889+0000", 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030385299999999998 2024-04-18T21:06:39.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.602348+0000", 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001459052 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621170+0000", 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018822680000000001 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621296+0000", 2024-04-18T21:06:39.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125487 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.621397+0000", 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101431 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771557560999995, 2024-04-18T21:06:39.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018573776, 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597954+0000", 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597955+0000", 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.64e-07 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597959+0000", 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5760000000000002e-06 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.597980+0000", 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1729000000000001e-05 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598109+0000", 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012871000000000001 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598377+0000", 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000268344 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616528+0000", 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018150869 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.771503351999996, 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018954814, 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.411 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598008+0000", 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598010+0000", 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598015+0000", 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5990000000000001e-06 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598032+0000", 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6172999999999999e-05 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598039+0000", 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598177+0000", 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137381 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.598401+0000", 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022426400000000001 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616963+0000", 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018562249999999999 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.759725787999997, 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011092266999999999, 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:06:39.415 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609786+0000", 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609803+0000", 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492000000000001e-05 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609843+0000", 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9746000000000002e-05 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.609890+0000", 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6819e-05 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613357+0000", 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034674810000000001 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620878+0000", 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075212689999999997 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.418 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.759490591000002, 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010803564, 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610021+0000", 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610022+0000", 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4e-07 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610075+0000", 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2565999999999998e-05 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610094+0000", 2024-04-18T21:06:39.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9315999999999999e-05 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610387+0000", 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029315 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610561+0000", 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174119 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610610+0000", 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8389e-05 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620746+0000", 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010136523 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620825+0000", 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8660999999999998e-05 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.422 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.759024174999993, 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010042084999999999, 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610488+0000", 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610489+0000", 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1960000000000001e-06 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610501+0000", 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2077e-05 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610522+0000", 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1029000000000001e-05 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610542+0000", 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0086999999999999e-05 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612887+0000", 2024-04-18T21:06:39.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002345424 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.612932+0000", 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4172000000000003e-05 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620418+0000", 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074860960000000002 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620530+0000", 2024-04-18T21:06:39.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011200399999999999 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.758764987999996, 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098392240000000006, 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610747+0000", 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610748+0000", 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610769+0000", 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1759999999999998e-05 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610792+0000", 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2486000000000001e-05 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610807+0000", 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613459+0000", 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026522400000000002 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613501+0000", 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1718999999999998e-05 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620490+0000", 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069884109999999999 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620586+0000", 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6488000000000002e-05 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.758607432000005, 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099682169999999997, 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610904+0000", 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610905+0000", 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1399999999999996e-07 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610915+0000", 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7389999999999994e-06 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610935+0000", 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9746999999999999e-05 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.610951+0000", 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6409000000000002e-05 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611109+0000", 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015784999999999999 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611157+0000", 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8652000000000001e-05 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620831+0000", 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096736010000000004 2024-04-18T21:06:39.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620873+0000", 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1505000000000003e-05 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.758206850999997, 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096888470000000004, 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611305+0000", 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611306+0000", 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1999999999999998e-07 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.611329+0000", 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3163000000000002e-05 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613748+0000", 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024187589999999999 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.613776+0000", 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8085999999999998e-05 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616319+0000", 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025427430000000001 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.616368+0000", 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9082000000000002e-05 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620913+0000", 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045457960000000004 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:05:08.620994+0000", 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0397999999999998e-05 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4707.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-18T21:06:39.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:38.444247+0000", 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.92526496499999999, 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023438692000000001, 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.444247+0000", 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.444247+0000", 2024-04-18T21:06:39.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.444249+0000", 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.452401+0000", 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0081526540000000005 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.452435+0000", 2024-04-18T21:06:39.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3936000000000002e-05 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.452455+0000", 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.012e-05 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.452651+0000", 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000195525 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.452689+0000", 2024-04-18T21:06:39.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7809999999999999e-05 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.467536+0000", 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014847544000000001 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.467686+0000", 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014936300000000001 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4707.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:38.604991+0000", 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.76452111099999998, 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013917063, 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.604991+0000", 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.604991+0000", 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.604997+0000", 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8860000000000001e-06 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.607731+0000", 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027343440000000001 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.607758+0000", 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7109000000000001e-05 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.607772+0000", 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229999999999999e-05 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.607879+0000", 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107223 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.607923+0000", 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3411999999999997e-05 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.618813+0000", 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010890469 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.618908+0000", 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4389999999999996e-05 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4707.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:38.611393+0000", 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.75811905300000004, 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022562213000000001, 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.611393+0000", 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.611393+0000", 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.611395+0000", 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1229999999999998e-06 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.617922+0000", 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065275860000000002 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.617942+0000", 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9789999999999999e-05 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.617956+0000", 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4027e-05 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.618070+0000", 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011388200000000001 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.618118+0000", 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7973000000000003e-05 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.633843+0000", 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015724926 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.633955+0000", 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111906 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:38.615492+0000", 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.75401964899999996, 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013513213, 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11 2024-04-18T21:06:39.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.615492+0000", 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.615492+0000", 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.615494+0000", 2024-04-18T21:06:39.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.615506+0000", 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2317000000000001e-05 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.615559+0000", 2024-04-18T21:06:39.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2955999999999999e-05 2024-04-18T21:06:39.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.615577+0000", 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7880000000000002e-05 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.615762+0000", 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018509900000000001 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616100+0000", 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00033776999999999999 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616460+0000", 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000360367 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.620152+0000", 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036914750000000001 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.628603+0000", 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084513890000000001 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.628877+0000", 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027355800000000003 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.629005+0000", 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012845599999999999 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:39.460 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:38.616721+0000", 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.75279121999999998, 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012636694, 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 12 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616721+0000", 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616721+0000", 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616723+0000", 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616735+0000", 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2216e-05 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616760+0000", 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4907000000000001e-05 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.616777+0000", 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7260000000000001e-05 2024-04-18T21:06:39.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.617322+0000", 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00054461799999999997 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.617558+0000", 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023667499999999999 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.617761+0000", 2024-04-18T21:06:39.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202738 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.620277+0000", 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025157920000000002 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.629028+0000", 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0087507409999999994 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.629217+0000", 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018964399999999999 2024-04-18T21:06:39.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:38.629357+0000", 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000140106 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:39.466 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:39.468 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:39.467+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:39.468 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:39.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:39.567+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:39.603 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:39.603 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:39.603 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:39.619 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:39.669 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:39.667+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:39.730 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:06:39.750 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:39.750 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:39.750 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:39.750 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:39.750 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:39.765 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:39.809 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:39.809+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:39.871 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:39.869+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:39.889 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:39.889 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:39.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:39.889 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:39.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.889 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:39.889 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.76068069199999, 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:39.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.895 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.76064712, 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:39.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:39.901 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.76061485699999, 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:39.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.907 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 101.760499306, 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.293065381000005, 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:39.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292952256999996, 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:39.919 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:39.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:39.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292873174999997, 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:39.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292769970999998, 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:39.930 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:39.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:39.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292680199000003, 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:39.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:39.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292594160999997, 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.941 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292530076000006, 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292444477999993, 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292378284999998, 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.292308907000006, 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.291995240000006, 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.291945730999998, 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.291880469000006, 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.291746289000002, 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 91.291642823999993, 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.452603026, 2024-04-18T21:06:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:06:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:06:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:39.999 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:40.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:40.001 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:39.997+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:40.101 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:40.097+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4707.0:1004 4.6 e52/16 4:635effe5:::1000000069e.00000000:head v 52'23, mlcod=52'21)", 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:40.141899+0000", 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00077755800000000003, 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081350699999999999, 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.141899+0000", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.141899+0000", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.141900+0000", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0470000000000001e-06 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.141908+0000", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2530000000000004e-06 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.141926+0000", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8063e-05 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.141936+0000", 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6199999999999994e-06 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.142006+0000", 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0135000000000005e-05 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:40.142041+0000", 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5363e-05 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:40.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:40.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:40.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:40.144 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:06:40.144 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-04-18T21:06:40.144 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:40.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:40.192 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:40.202 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:40.201+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:40.276 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:40.276 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:40.276 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:40.276 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:40.276 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:40.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:40.302 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:40.299+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:40.340 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:40.340 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:40.361 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:40.361 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:40.382 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:40.383 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:40.403 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:40.403+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:40.433 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:40.433 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:40.449 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:40.503 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:40.501+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:40.589 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:40.603 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:40.603+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:40.605 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:40.705 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:40.703+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:40.729 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:40.729 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:40.729 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-18T21:06:40.730 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.012627 2024-04-18T21:06:40.730 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.012627363955601822 2024-04-18T21:06:40.781 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:40.781 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:40.797 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:40.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:40.803+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:40.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:40.907+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:40.975 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:40.976 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:40.991 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:41.037 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:41.037+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:41.108 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:41.107+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:41.149 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:41.237 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:41.237+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:41.310 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:41.309+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:41.336 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:41.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:41.411+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:41.507 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:41.507 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:41.512 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:41.511+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:41.523 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:41.612 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:41.609+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:41.661 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:41.661 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:41.676 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:41.714 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:41.711+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.0 primary-affinity to 0.0126274 (88272) 2024-04-18T21:06:41.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:41.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:41.815+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:41.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:41.916 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:41.915+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:41.987 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:41.987 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:42.003 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:42.046 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:42.047+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:42.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:42.115+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:42.142 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:42.142 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:42.158 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:42.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:42.219+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:42.319 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:42.317+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:42.350 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:42.401 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:42.420 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:42.417+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:42.481 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:42.481 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:42.497 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:42.521 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:42.519+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:42.557 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:42.557 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:42.579 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:42.579 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:42.603 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:42.604 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:42.622 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:42.619+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:42.633 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:42.633 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:42.633 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:42.648 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:42.723 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:42.723+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:06:42.792 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:42.792 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:42.792 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:42.792 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:42.793 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:42.816 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:42.861 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:42.861+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:42.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:42.923+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:42.942 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.814111645, 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:42.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:42.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.814078073, 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.948 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:42.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.81404581, 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:42.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:42.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:42.958 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.813930259, 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:42.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:42.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.964 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.346496333999994, 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:42.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:42.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:42.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.346383209999999, 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.970 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.971 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:42.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:42.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.346304128, 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.978 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:42.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.346200924000001, 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.984 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:42.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.990 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.346111152000006, 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:42.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:42.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.996 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.346025114, 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:42.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:42.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.004 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345961028999994, 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:43.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:43.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.010 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345875430999996, 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:43.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:43.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:43.016 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345809238000001, 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.017 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:43.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:43.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345739859999995, 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:43.023 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:43.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345426192999994, 2024-04-18T21:06:43.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:43.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345376684000001, 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:43.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:43.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345311421999995, 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:43.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:43.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345177242000005, 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.054 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.345073776999996, 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:43.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.5060339789999997, 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:43.059 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:06:43.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:06:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:43.066 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:43.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:43.067 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:43.065+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:43.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:43.167+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:43.218 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:43.218 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3620 4.11 4:89578c99:::10000001193.00000000:head [write 0~16396 in=16396b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:43.217981+0000", 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029825469999999999, 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00302426, 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3620 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.217981+0000", 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.217981+0000", 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.217987+0000", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.083e-06 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.218010+0000", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2599000000000002e-05 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.218034+0000", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4037e-05 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.218049+0000", 2024-04-18T21:06:43.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5319e-05 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.218227+0000", 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017817899999999999 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.218506+0000", 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027874600000000002 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.218827+0000", 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000320811 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.220144+0000", 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001317379 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3621 4.26 4:6660d229:::10000001194.00000000:head [write 0~2546 in=2546b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:43.219352+0000", 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0016117989999999999, 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001828725, 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3621 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219352+0000", 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219352+0000", 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219353+0000", 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-06 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219359+0000", 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0379999999999996e-06 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219386+0000", 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7763000000000002e-05 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219396+0000", 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0850000000000003e-06 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219520+0000", 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012409500000000001 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219709+0000", 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018969000000000001 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.219917+0000", 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020773300000000001 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221041+0000", 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001124232 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4707.0:3620 4.11 e54/16 ondisk, result = 0)", 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:43.221143+0000", 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9998207, 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171013, 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.228 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221143+0000", 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221143+0000", 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221144+0000", 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1370000000000001e-06 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221150+0000", 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1e-06 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221169+0000", 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8754e-05 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221184+0000", 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5282e-05 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221245+0000", 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0819999999999997e-05 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221250+0000", 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0200000000000002e-06 2024-04-18T21:06:43.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:43.221314+0000", 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3899999999999995e-05 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 3 2024-04-18T21:06:43.232 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:43.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:43.270 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:43.269+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:43.370 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:43.371+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:43.408 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:43.408 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:43.408 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:43.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:43.471 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:43.471+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.96456798399999999, 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:06:43.555 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:06:43.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.95170376400000001, 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.562 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:06:43.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:06:43.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.568 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.95090229400000004, 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:06:43.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:06:43.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:06:43.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:06:43.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.95012858899999997, 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:06:43.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:06:43.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:06:43.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:06:43.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.94288302499999999, 2024-04-18T21:06:43.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:06:43.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:06:43.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.93981636499999999, 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:06:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:06:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:06:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.92197165999999997, 2024-04-18T21:06:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:06:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:06:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:06:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.92113261999999996, 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:06:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.91677894000000004, 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:06:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:06:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:06:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.91601062799999999, 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:06:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:06:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.91266102400000004, 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:06:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:06:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:06:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:06:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3101 4.39 4:9f88871f:::10000000f79.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.90496116900000001, 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15377127199999999, 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3101 2024-04-18T21:06:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651075+0000", 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0199999999999994e-06 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651088+0000", 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125999999999999e-05 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651118+0000", 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0056000000000002e-05 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651133+0000", 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-05 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651300+0000", 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016728000000000001 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651332+0000", 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1316000000000003e-05 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795393+0000", 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14406152699999999 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795615+0000", 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022176100000000001 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796175+0000", 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055999999999999995 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803891+0000", 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077157019999999996 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804661+0000", 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077030499999999999 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804756+0000", 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4893000000000001e-05 2024-04-18T21:06:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804838+0000", 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2455999999999998e-05 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3102 4.a 4:51346ff1:::10000000f7a.00000000:head [write 0~2274] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.90408732000000003, 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15630893400000001, 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3102 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651943+0000", 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2239999999999998e-06 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651955+0000", 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651985+0000", 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0212000000000001e-05 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652005+0000", 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0060000000000001e-05 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652155+0000", 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015061 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652172+0000", 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6699999999999999e-05 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795443+0000", 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.143270429 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795698+0000", 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025559399999999999 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796261+0000", 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056251499999999998 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804465+0000", 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082038619999999993 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808068+0000", 2024-04-18T21:06:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036032339999999999 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808163+0000", 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4913000000000004e-05 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808250+0000", 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7040999999999996e-05 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89918504700000002, 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:06:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:06:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3109 4.a 4:51362415:::10000000f81.00000000:head [write 0~549] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89830377100000003, 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15212483099999999, 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3109 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657726+0000", 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657737+0000", 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0413e-05 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657758+0000", 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1066000000000001e-05 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657770+0000", 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2037e-05 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657884+0000", 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657899+0000", 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4912999999999999e-05 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797739+0000", 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.139839608 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797980+0000", 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024131000000000001 2024-04-18T21:06:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.798495+0000", 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051529799999999997 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807863+0000", 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093672040000000005 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808270+0000", 2024-04-18T21:06:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00040760200000000002 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809761+0000", 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001490805 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809849+0000", 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8244000000000004e-05 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89753154300000004, 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:06:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:06:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:06:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89440077399999995, 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:06:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86708806299999996, 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:06:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86571563699999998, 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:06:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:06:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3147 4.c 4:30e7223c:::10000000faa.00000000:head [write 0~3847] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86238040299999996, 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14405016200000001, 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3147 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693650+0000", 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.277e-06 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693684+0000", 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4003e-05 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693716+0000", 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2212999999999998e-05 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693731+0000", 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4525999999999999e-05 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693864+0000", 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013289399999999999 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693878+0000", 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.455e-05 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831460+0000", 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.137582329 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831586+0000", 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542900000000001 2024-04-18T21:06:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831762+0000", 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017588599999999999 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.833477+0000", 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001715563 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837579+0000", 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041016389999999998 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837638+0000", 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9249999999999997e-05 2024-04-18T21:06:43.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837698+0000", 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9602999999999998e-05 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:43.690 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:43.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:43.691 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:43.609+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:43.712 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:43.711+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:43.812 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:43.811+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4707.0:4027 4.2f e54/16 4:f6b4c6f3:::1000000133c.00000000:head v 54'71, mlcod=54'69)", 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:43.829297+0000", 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0031702689999999999, 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032101450000000002, 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829297+0000", 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829297+0000", 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829299+0000", 2024-04-18T21:06:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-06 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829305+0000", 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7800000000000003e-06 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829322+0000", 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6549999999999999e-05 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829331+0000", 2024-04-18T21:06:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829401+0000", 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0290000000000006e-05 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.829436+0000", 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5442999999999999e-05 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:4029 4.1 4:82684fa4:::1000000133e.00000000:head [write 0~127 in=127b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:43.831311+0000", 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.001157197, 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001309948, 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4029 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831311+0000", 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831311+0000", 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831312+0000", 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9069999999999999e-06 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831322+0000", 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-06 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831346+0000", 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4130000000000001e-05 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831368+0000", 2024-04-18T21:06:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1838999999999999e-05 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831451+0000", 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2361000000000006e-05 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831575+0000", 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124108 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:43.831705+0000", 2024-04-18T21:06:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012997599999999999 2024-04-18T21:06:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-04-18T21:06:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 2 2024-04-18T21:06:43.838 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:43.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:43.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:43.911+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:43.978 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:43.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:43.978 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:43.978 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:43.978 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:43.993 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:44.014 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:44.013+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:44.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:44.115+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.516479465, 2024-04-18T21:06:44.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:06:44.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:06:44.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:06:44.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:06:44.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.5129702090000001, 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:06:44.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:06:44.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:06:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:06:44.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:06:44.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4997770070000001, 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:06:44.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:06:44.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.482589803, 2024-04-18T21:06:44.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:06:44.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:06:44.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.149 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4791756890000001, 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:06:44.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4783221740000001, 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.156 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:44.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.162 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.475785492, 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:44.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:06:44.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:06:44.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4610532759999999, 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.169 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.458593445, 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:06:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:06:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:06:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:06:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:06:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4526744190000001, 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:06:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:06:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:06:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:06:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.445945525, 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:06:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:06:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:06:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.391263476, 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:06:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3616770229999999, 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:06:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:06:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:06:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:06:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:06:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:06:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3195 4.32 4:4fded690:::10000000fdf.00000000:head [write 0~7142] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.355989396, 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.055582142000000001, 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3195 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768927+0000", 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768955+0000", 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768981+0000", 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5763e-05 2024-04-18T21:06:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.769001+0000", 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000002e-05 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807819+0000", 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038817813 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807997+0000", 2024-04-18T21:06:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017838500000000001 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808192+0000", 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194682 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811728+0000", 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035360980000000001 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824337+0000", 2024-04-18T21:06:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012609142 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824434+0000", 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6454999999999997e-05 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824500+0000", 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5983999999999997e-05 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3504928940000001, 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:06:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3198 4.22 4:478bb804:::10000000fe2.00000000:head [write 0~3740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3503490980000001, 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050157102000000002, 2024-04-18T21:06:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3198 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774559+0000", 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4899999999999999e-06 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774570+0000", 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.022e-05 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774591+0000", 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1438999999999999e-05 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774609+0000", 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7567e-05 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809058+0000", 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034449281999999998 2024-04-18T21:06:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809233+0000", 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017482399999999999 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809416+0000", 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000182843 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811738+0000", 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023220179999999999 2024-04-18T21:06:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824562+0000", 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01282428 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824651+0000", 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9017000000000005e-05 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824715+0000", 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4121999999999994e-05 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.350198703, 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3475581750000001, 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:06:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3392765799999999, 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:06:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:06:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:06:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:06:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3226 4.15 4:a8178309:::10000000ffe.00000000:head [write 0~6268] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3278930369999999, 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052934095, 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3226 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797016+0000", 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4229999999999999e-06 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797041+0000", 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4341999999999998e-05 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797070+0000", 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8768999999999998e-05 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797088+0000", 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8151e-05 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847133+0000", 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050045415000000003 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847330+0000", 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000196376 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847563+0000", 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023379 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849713+0000", 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021493240000000002 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849793+0000", 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9901000000000006e-05 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849882+0000", 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9000999999999997e-05 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849948+0000", 2024-04-18T21:06:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6602999999999999e-05 2024-04-18T21:06:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:44.247 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:44.247 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:44.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:44.247+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:44.349 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:44.347+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:44.383 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:44.384 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:44.398 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:44.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:44.447+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:44.528 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:44.528 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:44.528 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:44.528 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:44.528 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:44.542 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:44.551 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:44.551+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:44.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:44.651 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:44.649+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:44.673 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 106.543732013, 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:44.674 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:44.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:44.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:44.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:44.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 106.543698441, 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:44.680 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:44.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:44.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 106.543666178, 2024-04-18T21:06:44.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 106.543550627, 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:44.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:44.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:44.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.076116701999993, 2024-04-18T21:06:44.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:44.700 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.700 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.700 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.700 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:44.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.076003577999998, 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.705 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:44.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:44.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:44.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:44.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:44.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:44.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075924495999999, 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:44.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:44.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:44.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:44.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075821292000001, 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075731520000005, 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:44.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:44.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:44.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:44.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075645481999999, 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:44.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.736 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075581396999993, 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:44.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075495798999995, 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.746 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075429606, 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:44.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:44.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:44.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075360227999994, 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.075046560999994, 2024-04-18T21:06:44.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:44.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:44.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.763 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.763 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:44.763 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.074997052000001, 2024-04-18T21:06:44.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:44.763 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.763 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:44.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:44.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.074931789999994, 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:44.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.074797610000005, 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:44.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:44.779 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 96.074694144999995, 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:44.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:44.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:44.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.2356543469999997, 2024-04-18T21:06:44.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:06:44.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:06:44.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:06:44.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:06:44.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:06:44.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.790 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:44.790 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:44.790 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:44.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:44.792 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:44.792 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:44.791+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:44.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:44.813 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:44.814 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:44.838 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:44.839 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:44.892 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:44.891+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:44.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:45.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:45.003+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:45.088 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:45.088 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:45.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:45.095+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:45.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:45.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:45.195+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:45.296 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:45.293+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:45.301 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:45.301 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:45.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:45.396 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:45.395+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:45.465 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:45.465 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:45.481 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:45.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:45.495+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:45.598 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:45.595+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:45.672 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:45.715 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:45.715+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:45.759 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:06:45.800 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:45.799+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:45.860 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:45.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:45.899+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:45.996 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:45.996 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.001 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:45.999+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:46.011 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:46.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:46.103+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:46.138 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.138 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.152 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:46.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:46.203+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:46.305 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:46.301+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:46.406 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:46.405+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:46.437 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.437 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:46.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:46.503+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:46.580 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.580 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:46.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:46.643+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:46.708 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:46.707+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:46.761 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:46.761 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:46.761 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-18T21:06:46.761 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:06:46.761 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:06:46.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-18T21:06:46.767 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.767 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:46.826 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:46.827+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:46.860 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:46.899 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:46.899 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "" 2024-04-18T21:06:46.899 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:46.909 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:46.907+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:46.914 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.914 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.930 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:47.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:47.011+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:47.029 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:47.029 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:47.056 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:47.056 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:47.081 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:47.081 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:47.100 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:47.100 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:47.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:47.111+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:47.116 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:47.212 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:47.209+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:47.250 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.639423485, 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6359142289999999, 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:06:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:06:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6227210269999999, 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:06:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:06:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.605533823, 2024-04-18T21:06:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:06:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:06:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:06:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6021197090000001, 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:06:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:06:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:06:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:06:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6012661939999999, 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.5987295120000002, 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:06:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:06:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:06:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.5839972959999997, 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.5815374650000003, 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.5756184390000003, 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:06:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:06:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.5688895450000002, 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.514207496, 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4846210429999998, 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3195 4.32 4:4fded690:::10000000fdf.00000000:head [write 0~7142] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4789334160000003, 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.055582142000000001, 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3195 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768927+0000", 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768955+0000", 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768981+0000", 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5763e-05 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.769001+0000", 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000002e-05 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807819+0000", 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038817813 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807997+0000", 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017838500000000001 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808192+0000", 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194682 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811728+0000", 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035360980000000001 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824337+0000", 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012609142 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824434+0000", 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6454999999999997e-05 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824500+0000", 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5983999999999997e-05 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4734369139999997, 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:06:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:06:47.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:06:47.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3198 4.22 4:478bb804:::10000000fe2.00000000:head [write 0~3740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.473293118, 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050157102000000002, 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3198 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774559+0000", 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4899999999999999e-06 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774570+0000", 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.022e-05 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774591+0000", 2024-04-18T21:06:47.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1438999999999999e-05 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774609+0000", 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7567e-05 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809058+0000", 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034449281999999998 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809233+0000", 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017482399999999999 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809416+0000", 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000182843 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811738+0000", 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023220179999999999 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824562+0000", 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01282428 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824651+0000", 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9017000000000005e-05 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824715+0000", 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4121999999999994e-05 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4731427229999996, 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:06:47.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:06:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:06:47.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:06:47.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4705021949999999, 2024-04-18T21:06:47.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:06:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:06:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:06:47.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:06:47.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:06:47.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:06:47.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:06:47.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4622206000000002, 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.362 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.367 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3226 4.15 4:a8178309:::10000000ffe.00000000:head [write 0~6268] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4508370570000002, 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052934095, 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3226 2024-04-18T21:06:47.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797016+0000", 2024-04-18T21:06:47.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4229999999999999e-06 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797041+0000", 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4341999999999998e-05 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797070+0000", 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8768999999999998e-05 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797088+0000", 2024-04-18T21:06:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8151e-05 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847133+0000", 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050045415000000003 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847330+0000", 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000196376 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847563+0000", 2024-04-18T21:06:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023379 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849713+0000", 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021493240000000002 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849793+0000", 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9901000000000006e-05 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849882+0000", 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9000999999999997e-05 2024-04-18T21:06:47.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849948+0000", 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6602999999999999e-05 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:47.373 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:47.375 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:47.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:47.375+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:47.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:47.475+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:47.514 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:47.514 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:47.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.514 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:6623 4.30 e55/53 4:0d070c8b:::10000001e47.00000000:head v 55'117, mlcod=55'115)", 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:47.516976+0000", 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.00026181799999999998, 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029854799999999999, 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.516976+0000", 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.516976+0000", 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.516978+0000", 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.167e-06 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.516991+0000", 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3162999999999999e-05 2024-04-18T21:06:47.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.517010+0000", 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8964e-05 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.517025+0000", 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4895999999999999e-05 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.517134+0000", 2024-04-18T21:06:47.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909899999999999 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:47.517164+0000", 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0332999999999999e-05 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-04-18T21:06:47.518 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:47.529 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:47.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:47.575+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:47.654 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:47.654 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:47.654 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:47.654 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:47.654 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:47.670 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:47.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:47.675+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:47.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:47.775+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:47.778 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:47.807 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:47.807 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 109.677710664, 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021275196, 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 186 2024-04-18T21:06:47.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129112+0000", 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129113+0000", 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129119+0000", 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7169999999999996e-06 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129128+0000", 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129135+0000", 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6560000000000003e-06 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144455+0000", 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015320346 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.144719+0000", 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000263847 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.145114+0000", 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039571000000000002 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148123+0000", 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003008925 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150218+0000", 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020948329999999999 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150308+0000", 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9585000000000004e-05 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150387+0000", 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9344000000000005e-05 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 109.677677092, 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:47.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.819 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 109.677644829, 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:47.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 109.67752927799999, 2024-04-18T21:06:47.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:47.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:47.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.210095353, 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:47.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:47.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209982229000005, 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:47.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209903147000006, 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.842 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:47.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.847 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209799942999993, 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.852 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209710170999998, 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209624133000005, 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:47.858 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:47.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209560048, 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.865 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209474450000002, 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209408257000007, 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:47.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209338879000001, 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.881 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.886 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.209025212, 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:47.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.208975702999993, 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.208910441, 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.897 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:47.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:47.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:47.902 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.208776260999997, 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:47.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 99.208672796000002, 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:47.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:47.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.3696329980000002, 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:06:47.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:06:47.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:47.917 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:47.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:47.919 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:47.917+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:48.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:48.019+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4707.0:6925 4.6 e55/16 4:62749b46:::10000001faf.00000000:head v 55'112, mlcod=55'109)", 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:48.058534+0000", 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001290231, 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001307215, 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058534+0000", 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058534+0000", 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058536+0000", 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-06 2024-04-18T21:06:48.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058565+0000", 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9842999999999999e-05 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058592+0000", 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6213000000000001e-05 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058605+0000", 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2836e-05 2024-04-18T21:06:48.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058701+0000", 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6308e-05 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058741+0000", 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0602000000000002e-05 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:6926 4.18 4:1ba70460:::10000001fb0.00000000:head [write 0~2676 in=2676b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:48.058701+0000", 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001123307, 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011808350000000001, 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 6926 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058701+0000", 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058701+0000", 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058703+0000", 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.933e-06 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058714+0000", 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1430000000000001e-05 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058734+0000", 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9656999999999998e-05 2024-04-18T21:06:48.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058745+0000", 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1523e-05 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.058853+0000", 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107662 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.059057+0000", 2024-04-18T21:06:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203859 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:48.059253+0000", 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196367 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 2 2024-04-18T21:06:48.065 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:48.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:48.121 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:48.117+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:48.221 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:48.221+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:48.266 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:48.266 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:48.266 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:48.266 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:48.266 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:48.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:48.323 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:48.323+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:48.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8208559300000005, 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8079917099999996, 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:06:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:06:48.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:06:48.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8071902399999997, 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.427 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:06:48.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8064165350000003, 2024-04-18T21:06:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:06:48.434 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:06:48.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7991709709999997, 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:06:48.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:06:48.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:06:48.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:06:48.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:06:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:06:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7961043109999997, 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:06:48.448 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.454 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7782596059999998, 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:48.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:06:48.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.777420566, 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:06:48.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:06:48.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:06:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7730668859999996, 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7722985739999997, 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:48.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:06:48.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:06:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:06:48.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:06:48.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7689489700000003, 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3101 4.39 4:9f88871f:::10000000f79.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.761249115, 2024-04-18T21:06:48.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15377127199999999, 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3101 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651075+0000", 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0199999999999994e-06 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651088+0000", 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125999999999999e-05 2024-04-18T21:06:48.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651118+0000", 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0056000000000002e-05 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651133+0000", 2024-04-18T21:06:48.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-05 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651300+0000", 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016728000000000001 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651332+0000", 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1316000000000003e-05 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795393+0000", 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14406152699999999 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795615+0000", 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022176100000000001 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796175+0000", 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055999999999999995 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803891+0000", 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077157019999999996 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804661+0000", 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077030499999999999 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804756+0000", 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4893000000000001e-05 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804838+0000", 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2455999999999998e-05 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3102 4.a 4:51346ff1:::10000000f7a.00000000:head [write 0~2274] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7603752660000005, 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15630893400000001, 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3102 2024-04-18T21:06:48.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651943+0000", 2024-04-18T21:06:48.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2239999999999998e-06 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651955+0000", 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651985+0000", 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0212000000000001e-05 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652005+0000", 2024-04-18T21:06:48.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0060000000000001e-05 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652155+0000", 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015061 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652172+0000", 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6699999999999999e-05 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795443+0000", 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.143270429 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795698+0000", 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025559399999999999 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796261+0000", 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056251499999999998 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804465+0000", 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082038619999999993 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808068+0000", 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036032339999999999 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808163+0000", 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4913000000000004e-05 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808250+0000", 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7040999999999996e-05 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7554729929999997, 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.500 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:48.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:06:48.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:06:48.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3109 4.a 4:51362415:::10000000f81.00000000:head [write 0~549] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7545917170000003, 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15212483099999999, 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3109 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657726+0000", 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657737+0000", 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0413e-05 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657758+0000", 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1066000000000001e-05 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657770+0000", 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2037e-05 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657884+0000", 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657899+0000", 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4912999999999999e-05 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797739+0000", 2024-04-18T21:06:48.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.139839608 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797980+0000", 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024131000000000001 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.798495+0000", 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051529799999999997 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807863+0000", 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093672040000000005 2024-04-18T21:06:48.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808270+0000", 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00040760200000000002 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809761+0000", 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001490805 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809849+0000", 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8244000000000004e-05 2024-04-18T21:06:48.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7538194889999996, 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:06:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:06:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7506887200000003, 2024-04-18T21:06:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:06:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:06:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7233760089999999, 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:06:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:06:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7220035830000002, 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3147 4.c 4:30e7223c:::10000000faa.00000000:head [write 0~3847] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7186683489999997, 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14405016200000001, 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3147 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693650+0000", 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.277e-06 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693684+0000", 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4003e-05 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693716+0000", 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2212999999999998e-05 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693731+0000", 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4525999999999999e-05 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693864+0000", 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013289399999999999 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693878+0000", 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.455e-05 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831460+0000", 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.137582329 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831586+0000", 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542900000000001 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831762+0000", 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017588599999999999 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.833477+0000", 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001715563 2024-04-18T21:06:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837579+0000", 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041016389999999998 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837638+0000", 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9249999999999997e-05 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837698+0000", 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9602999999999998e-05 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:48.545 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:48.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:48.547 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:48.543+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:48.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:48.647+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:48.690 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:48.690 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:48.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.690 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7378 4.1d 4:b9685761:::100000021ad.00000000:head [write 0~2636 in=2636b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.689151+0000", 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0036959440000000001, 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037409269999999998, 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7378 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:48.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689151+0000", 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689151+0000", 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689152+0000", 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.102e-06 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689159+0000", 2024-04-18T21:06:48.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5729999999999996e-06 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689171+0000", 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2964e-05 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689185+0000", 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3954000000000001e-05 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689341+0000", 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015538800000000001 2024-04-18T21:06:48.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689607+0000", 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026577399999999998 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689890+0000", 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028356099999999999 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692288+0000", 2024-04-18T21:06:48.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023976760000000001 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:118 3.1e e55/15 3:7bf7e7b5:::200.00000006:head v 55'23, mlcod=55'15)", 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.689718+0000", 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0031283700000000001, 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033102349999999999, 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:48.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689718+0000", 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689718+0000", 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689720+0000", 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9369999999999998e-06 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689738+0000", 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.802e-05 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689761+0000", 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2996000000000001e-05 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689777+0000", 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5727e-05 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689850+0000", 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2603999999999998e-05 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.689869+0000", 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9225e-05 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7380 4.24 4:24635ece:::100000021af.00000000:head [write 0~4163 in=4163b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.692200+0000", 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00064701099999999996, 2024-04-18T21:06:48.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00092677500000000002, 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7380 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692200+0000", 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692200+0000", 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692201+0000", 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692215+0000", 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3423e-05 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:48.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692231+0000", 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6096999999999999e-05 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692241+0000", 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0456e-05 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692310+0000", 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8919999999999997e-05 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:48.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692446+0000", 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135494 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692572+0000", 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125914 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:119 3.1e e55/15 3:7bf7e7b5:::200.00000006:head v 55'24, mlcod=55'21)", 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.692463+0000", 2024-04-18T21:06:48.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00038356000000000002, 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00077216299999999997, 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692463+0000", 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692463+0000", 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:48.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692464+0000", 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692474+0000", 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9029999999999999e-06 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692489+0000", 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4620000000000001e-05 2024-04-18T21:06:48.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692499+0000", 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0516000000000001e-05 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692604+0000", 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104326 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.692648+0000", 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3856999999999997e-05 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.705 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:48.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:48.706 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-04-18T21:06:48.706 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 4 2024-04-18T21:06:48.706 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:48.707 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:48.754 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:48.755+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:48.773 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:06:48.849 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:48.847+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:48.850 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:48.851 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:48.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:48.958 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:48.959+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:49.047 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:49.047 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:49.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4374281570000003, 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:06:49.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4339189010000002, 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.054 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:06:49.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:06:49.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:06:49.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:49.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4207256990000001, 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:06:49.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4035384950000003, 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:06:49.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4001243810000004, 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:06:49.073 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3992708660000002, 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3967341839999996, 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:06:49.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:06:49.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:06:49.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.382001968, 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:49.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3795421369999996, 2024-04-18T21:06:49.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:06:49.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:06:49.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:06:49.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:06:49.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3736231109999997, 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:06:49.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:06:49.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:06:49.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3668942170000005, 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:06:49.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:06:49.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:06:49.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:06:49.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3122121680000003, 2024-04-18T21:06:49.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.282625715, 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:06:49.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:06:49.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3195 4.32 4:4fded690:::10000000fdf.00000000:head [write 0~7142] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2769380879999996, 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.055582142000000001, 2024-04-18T21:06:49.130 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3195 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768918+0000", 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768927+0000", 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5840000000000001e-06 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768955+0000", 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8045999999999999e-05 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.768981+0000", 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5763e-05 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.769001+0000", 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000002e-05 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807819+0000", 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038817813 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807997+0000", 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017838500000000001 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808192+0000", 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194682 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811728+0000", 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035360980000000001 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824337+0000", 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012609142 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824434+0000", 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6454999999999997e-05 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824500+0000", 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5983999999999997e-05 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2714415859999999, 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:06:49.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:06:49.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3198 4.22 4:478bb804:::10000000fe2.00000000:head [write 0~3740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2712977900000002, 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050157102000000002, 2024-04-18T21:06:49.141 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3198 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774558+0000", 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774559+0000", 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4899999999999999e-06 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774570+0000", 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.022e-05 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774591+0000", 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1438999999999999e-05 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774609+0000", 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7567e-05 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809058+0000", 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034449281999999998 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809233+0000", 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017482399999999999 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809416+0000", 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000182843 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811738+0000", 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023220179999999999 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824562+0000", 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01282428 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824651+0000", 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9017000000000005e-05 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824715+0000", 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4121999999999994e-05 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2711473949999998, 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.152 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2685068670000001, 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.158 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2602252719999996, 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:49.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:06:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3226 4.15 4:a8178309:::10000000ffe.00000000:head [write 0~6268] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2488417290000005, 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052934095, 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:49.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3226 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797014+0000", 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:49.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797016+0000", 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4229999999999999e-06 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797041+0000", 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4341999999999998e-05 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797070+0000", 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8768999999999998e-05 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797088+0000", 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8151e-05 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847133+0000", 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050045415000000003 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847330+0000", 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000196376 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.847563+0000", 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023379 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849713+0000", 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021493240000000002 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849793+0000", 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9901000000000006e-05 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849882+0000", 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9000999999999997e-05 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.849948+0000", 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6602999999999999e-05 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:49.169 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:49.170 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:49.171 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:49.169+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:49.172 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:49.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:49.270+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:49.309 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:49.311 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:49.311 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:49.327 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:49.330 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:49.330 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:49.373 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:49.373+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:49.464 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:49.464 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:49.474 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:49.475+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:49.479 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:49.575 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:49.575+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:49.659 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:49.659 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:49.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:49.677 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:49.675+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:49.777 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:49.777+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:49.823 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:49.823 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:49.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:49.878 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:49.877+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:49.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:49.978+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:49.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:50.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:50.078+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:50.166 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:50.166 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:50.180 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:50.177+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:50.182 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:50.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:50.278+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:50.322 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:50.322 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:50.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:50.382 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:50.383+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:50.460 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:50.460 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:50.476 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:50.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:50.478+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:50.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:50.578+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:50.652 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:50.652 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:50.666 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:50.713 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:50.713+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:50.783 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:50.782+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:50.797 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:50.803 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:50.804 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:50.818 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:50.884 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:50.883+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:50.985 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:50.985+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:50.991 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:50.992 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.007 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:51.085 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:51.083+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.187 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:51.187+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:51.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:51.287 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:51.285+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:51.328 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:51.328 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:51.368 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:51.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:51.390+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:51.471 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:51.471 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:51.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:51.530+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:51.534 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:51.534 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:51.554 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:51.554 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:51.576 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:51.577 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:51.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:51.586+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0844121290000004, 2024-04-18T21:06:51.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:06:51.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:06:51.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0715479089999995, 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:06:51.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:06:51.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:06:51.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0707464390000005, 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.691 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0699727340000003, 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:06:51.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:06:51.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0627271700000005, 2024-04-18T21:06:51.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:06:51.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:06:51.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:06:51.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:06:51.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0596605100000005, 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:06:51.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:06:51.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:06:51.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.715 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0418158050000006, 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:06:51.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:06:51.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0409767649999999, 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:06:51.722 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:51.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:06:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0366230850000004, 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:06:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:06:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0358547730000005, 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:06:51.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:06:51.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:06:51.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:06:51.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:06:51.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0325051690000002, 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.742 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:06:51.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3101 4.39 4:9f88871f:::10000000f79.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.024805314, 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15377127199999999, 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3101 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:51.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651075+0000", 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0199999999999994e-06 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651088+0000", 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125999999999999e-05 2024-04-18T21:06:51.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651118+0000", 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0056000000000002e-05 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651133+0000", 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-05 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651300+0000", 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016728000000000001 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651332+0000", 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1316000000000003e-05 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795393+0000", 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14406152699999999 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795615+0000", 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022176100000000001 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796175+0000", 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055999999999999995 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803891+0000", 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077157019999999996 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804661+0000", 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077030499999999999 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804756+0000", 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4893000000000001e-05 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804838+0000", 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2455999999999998e-05 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3102 4.a 4:51346ff1:::10000000f7a.00000000:head [write 0~2274] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:51.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0239314650000004, 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15630893400000001, 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3102 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651943+0000", 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2239999999999998e-06 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651955+0000", 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651985+0000", 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0212000000000001e-05 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652005+0000", 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0060000000000001e-05 2024-04-18T21:06:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652155+0000", 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015061 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652172+0000", 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6699999999999999e-05 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795443+0000", 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.143270429 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795698+0000", 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025559399999999999 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796261+0000", 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056251499999999998 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804465+0000", 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082038619999999993 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808068+0000", 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036032339999999999 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808163+0000", 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4913000000000004e-05 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808250+0000", 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7040999999999996e-05 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0190291919999996, 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:06:51.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:06:51.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:06:51.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3109 4.a 4:51362415:::10000000f81.00000000:head [write 0~549] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0181479160000002, 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15212483099999999, 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3109 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657726+0000", 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657737+0000", 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0413e-05 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657758+0000", 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1066000000000001e-05 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657770+0000", 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2037e-05 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657884+0000", 2024-04-18T21:06:51.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657899+0000", 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4912999999999999e-05 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797739+0000", 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.139839608 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797980+0000", 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024131000000000001 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.798495+0000", 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051529799999999997 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807863+0000", 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093672040000000005 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808270+0000", 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00040760200000000002 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809761+0000", 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001490805 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809849+0000", 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8244000000000004e-05 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0173756879999996, 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:06:51.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:06:51.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0142449189999994, 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:06:51.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:06:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9869322080000007, 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:06:51.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:06:51.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9855597819999993, 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:06:51.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3147 4.c 4:30e7223c:::10000000faa.00000000:head [write 0~3847] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9822245479999996, 2024-04-18T21:06:51.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14405016200000001, 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3147 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693650+0000", 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.277e-06 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:51.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693684+0000", 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4003e-05 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693716+0000", 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2212999999999998e-05 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693731+0000", 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4525999999999999e-05 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693864+0000", 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013289399999999999 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693878+0000", 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.455e-05 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831460+0000", 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.137582329 2024-04-18T21:06:51.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831586+0000", 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542900000000001 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831762+0000", 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017588599999999999 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.833477+0000", 2024-04-18T21:06:51.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001715563 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837579+0000", 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041016389999999998 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837638+0000", 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9249999999999997e-05 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837698+0000", 2024-04-18T21:06:51.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9602999999999998e-05 2024-04-18T21:06:51.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:51.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:51.807 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:51.808 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:06:51.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:51.809 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:51.805+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:51.909 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:51.907+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:51.914 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:51.914 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:51.914 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:06:51.914 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:06:51.945 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:51.945 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:51.946 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:51.946 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:51.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:52.010 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:52.009+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:52.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:52.110+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:52.132 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:52.132 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:52.148 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:52.212 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:52.211+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:52.222 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:06:52.222 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:06:52.222 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 57, 2024-04-18T21:06:52.222 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:06:52.222 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:06:52.222 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:06:51.789607+0000", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5806080, 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "nodeep-scrub", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "noscrub", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:52.223 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "jewel", 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:06:52.224 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:52.225 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:52.226 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:52.227 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:06:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.8799999952316284, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.8799999952316284, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.8799999952316284, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.8799999952316284, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:06:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.7799999713897705, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.7799999713897705, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.7799999713897705, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.7799999713897705, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:06:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:06:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:06:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:06:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 0.0126190185546875, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 41, 2024-04-18T21:06:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 53, 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:06:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 53, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:06:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:06:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [], 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:06:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:06:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:06:52.270 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:06:52.271 INFO:tasks.thrashosds.thrasher:j is {'epoch': 57, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:06:51.789607+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 1, 'raw_score_acting': 1.7799999713897705, 'raw_score_stable': 1.7799999713897705, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.0126190185546875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 53, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 53, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:06:52.271 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:06:52.279 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6677239610000001, 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:06:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:06:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:06:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6642147049999991, 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:06:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:06:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6510215029999991, 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:06:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6338342990000001, 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:06:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6304201850000002, 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:06:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:06:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:06:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6295666699999991, 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:06:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:06:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:06:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:06:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:06:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6270299880000003, 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6122977719999998, 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:06:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:06:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:06:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6098379410000003, 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:06:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:06:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:06:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6039189149999995, 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:06:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:06:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5971900209999994, 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:06:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5425079719999992, 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:06:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5129215190000007, 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:52.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:06:52.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:06:52.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:06:52.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5017373900000006, 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.359 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:06:52.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5014431990000006, 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:52.369 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.498802671, 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:06:52.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4905210760000003, 2024-04-18T21:06:52.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3036037500000002, 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:06:52.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:52.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:06:52.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:06:52.386 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3026159819999998, 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:06:52.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:06:52.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:06:52.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.2983115380000001, 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:52.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:52.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:06:52.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:52.398 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:52.399 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:52.397+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:52.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:52.498+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:52.540 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:9890 4.1a e57/53 4:5b0facce:::10000002d60.00000000:head v 57'146, mlcod=57'144)", 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:52.537553+0000", 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0052777750000000002, 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053024669999999999, 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537553+0000", 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537553+0000", 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537555+0000", 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.323e-06 2024-04-18T21:06:52.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537578+0000", 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2657e-05 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537610+0000", 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2243000000000003e-05 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537631+0000", 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1140000000000001e-05 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537709+0000", 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7285000000000003e-05 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.537728+0000", 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8870000000000001e-05 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:9891 4.17 e57/16 4:e929715f:::10000002d61.00000000:head v 57'141, mlcod=57'139)", 2024-04-18T21:06:52.544 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:52.538724+0000", 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0041065349999999997, 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042590609999999997, 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538724+0000", 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538724+0000", 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538726+0000", 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.72e-06 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538737+0000", 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0876000000000001e-05 2024-04-18T21:06:52.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538763+0000", 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.603e-05 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538775+0000", 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1926000000000001e-05 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538842+0000", 2024-04-18T21:06:52.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7189999999999999e-05 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.538861+0000", 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9272000000000001e-05 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542892+0000", 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040310909999999997 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542983+0000", 2024-04-18T21:06:52.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0956000000000001e-05 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:9893 4.1 e57/16 4:83448878:::10000002d63.00000000:head v 57'145, mlcod=57'143)", 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:52.540467+0000", 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0023635119999999999, 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027034590000000001, 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540467+0000", 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540467+0000", 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540468+0000", 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540475+0000", 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8020000000000003e-06 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540486+0000", 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0852e-05 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540507+0000", 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1324000000000001e-05 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540553+0000", 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6128000000000003e-05 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.540573+0000", 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9278000000000001e-05 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:9894 4.11 e57/16 4:8b02ff31:::10000002d64.00000000:head v 57'176, mlcod=57'174)", 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:52.541216+0000", 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0016145549999999999, 2024-04-18T21:06:52.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020471109999999999, 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541216+0000", 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541216+0000", 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541218+0000", 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6300000000000001e-06 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541229+0000", 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1209999999999999e-05 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541251+0000", 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1753e-05 2024-04-18T21:06:52.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541263+0000", 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2334000000000001e-05 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541329+0000", 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5677000000000002e-05 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541348+0000", 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8946000000000001e-05 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:9895 4.8 e57/16 4:13f3e161:::10000002d65.00000000:head v 57'157, mlcod=57'155)", 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:52.541952+0000", 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.00087849399999999995, 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014068189999999999, 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:52.556 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541952+0000", 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541952+0000", 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541953+0000", 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541958+0000", 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2680000000000002e-06 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541970+0000", 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1208e-05 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.541976+0000", 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.764e-06 2024-04-18T21:06:52.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542034+0000", 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7462e-05 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542054+0000", 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0071000000000001e-05 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.559 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:9896 4.d e57/53 4:b2bbf284:::10000002d66.00000000:head v 57'160, mlcod=57'158)", 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:52.542974+0000", 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4294967295.9998569, 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047747300000000001, 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542974+0000", 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542974+0000", 2024-04-18T21:06:52.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542975+0000", 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5199999999999996e-07 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542981+0000", 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4960000000000001e-06 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542992+0000", 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0621999999999999e-05 2024-04-18T21:06:52.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.542999+0000", 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1049999999999997e-06 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.543094+0000", 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5258000000000002e-05 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:52.543124+0000", 2024-04-18T21:06:52.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9995999999999999e-05 2024-04-18T21:06:52.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.563 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.563 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-18T21:06:52.563 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 6 2024-04-18T21:06:52.563 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:52.564 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:52.589 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:06:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:06:52.606 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-04-18T21:06:51.800777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":81886781,"num_objects":8629,"num_object_clones":0,"num_object_copies":17258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8629,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":9028,"num_write_kb":88291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8959,"ondisk_log_size":8959,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":224084,"kb_used_data":122236,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":282891436,"statfs":{"total":289910292480,"available":289680830464,"internally_reserved":0,"allocated":125169664,"data_stored":157454160,"data_compressed":20126481,"data_compressed_allocated":24440832,"data_compressed_original":97120256,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":62448090,"num_objects":7201,"num_object_clones":0,"num_object_copies":14402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7351,"num_write_kb":65430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.171314"},"pg_stats":[{"pgid":"4.3f","version":"56'130","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.200109+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:06:50.200109+0000","last_peered":"2024-04-18T21:06:50.200109+0000","last_clean":"2024-04-18T21:06:50.200109+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:06:50.200109+0000","last_undegraded":"2024-04-18T21:06:50.200109+0000","last_fullsized":"2024-04-18T21:06:50.200109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612499,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"56'121","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.427057+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:06:50.427057+0000","last_peered":"2024-04-18T21:06:50.427057+0000","last_clean":"2024-04-18T21:06:50.427057+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:06:50.427057+0000","last_undegraded":"2024-04-18T21:06:50.427057+0000","last_fullsized":"2024-04-18T21:06:50.427057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399949,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"56'123","reported_seq":216,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.077416+0000","last_change":"2024-04-18T21:06:42.772100+0000","last_active":"2024-04-18T21:06:50.077416+0000","last_peered":"2024-04-18T21:06:50.077416+0000","last_clean":"2024-04-18T21:06:50.077416+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:06:50.077416+0000","last_undegraded":"2024-04-18T21:06:50.077416+0000","last_fullsized":"2024-04-18T21:06:50.077416+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:42.621459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851135,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"56'111","reported_seq":204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.789720+0000","last_change":"2024-04-18T21:06:42.773600+0000","last_active":"2024-04-18T21:06:49.789720+0000","last_peered":"2024-04-18T21:06:49.789720+0000","last_clean":"2024-04-18T21:06:49.789720+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:06:49.789720+0000","last_undegraded":"2024-04-18T21:06:49.789720+0000","last_fullsized":"2024-04-18T21:06:49.789720+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:01.631939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969334,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":1006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"56'147","reported_seq":235,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.399887+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:06:50.399887+0000","last_peered":"2024-04-18T21:06:50.399887+0000","last_clean":"2024-04-18T21:06:50.399887+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:06:50.399887+0000","last_undegraded":"2024-04-18T21:06:50.399887+0000","last_fullsized":"2024-04-18T21:06:50.399887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108706,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"56'139","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.512833+0000","last_change":"2024-04-18T21:06:42.762884+0000","last_active":"2024-04-18T21:06:50.512833+0000","last_peered":"2024-04-18T21:06:50.512833+0000","last_clean":"2024-04-18T21:06:50.512833+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:06:50.512833+0000","last_undegraded":"2024-04-18T21:06:50.512833+0000","last_fullsized":"2024-04-18T21:06:50.512833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:57:06.797511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585287,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"56'147","reported_seq":240,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.371378+0000","last_change":"2024-04-18T21:06:42.765508+0000","last_active":"2024-04-18T21:06:50.371378+0000","last_peered":"2024-04-18T21:06:50.371378+0000","last_clean":"2024-04-18T21:06:50.371378+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:06:50.371378+0000","last_undegraded":"2024-04-18T21:06:50.371378+0000","last_fullsized":"2024-04-18T21:06:50.371378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:01:42.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":572341,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"56'113","reported_seq":206,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.365409+0000","last_change":"2024-04-18T21:06:42.764054+0000","last_active":"2024-04-18T21:06:50.365409+0000","last_peered":"2024-04-18T21:06:50.365409+0000","last_clean":"2024-04-18T21:06:50.365409+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:06:50.365409+0000","last_undegraded":"2024-04-18T21:06:50.365409+0000","last_fullsized":"2024-04-18T21:06:50.365409+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:15:50.427889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694546,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"56'136","reported_seq":224,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.955227+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:06:49.955227+0000","last_peered":"2024-04-18T21:06:49.955227+0000","last_clean":"2024-04-18T21:06:49.955227+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:06:49.955227+0000","last_undegraded":"2024-04-18T21:06:49.955227+0000","last_fullsized":"2024-04-18T21:06:49.955227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":552574,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"56'130","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.513762+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:06:50.513762+0000","last_peered":"2024-04-18T21:06:50.513762+0000","last_clean":"2024-04-18T21:06:50.513762+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:06:50.513762+0000","last_undegraded":"2024-04-18T21:06:50.513762+0000","last_fullsized":"2024-04-18T21:06:50.513762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550850,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"56'125","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.425145+0000","last_change":"2024-04-18T21:06:42.770457+0000","last_active":"2024-04-18T21:06:50.425145+0000","last_peered":"2024-04-18T21:06:50.425145+0000","last_clean":"2024-04-18T21:06:50.425145+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:06:50.425145+0000","last_undegraded":"2024-04-18T21:06:50.425145+0000","last_fullsized":"2024-04-18T21:06:50.425145+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:10.843661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363038,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"56'119","reported_seq":207,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.507293+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:06:50.507293+0000","last_peered":"2024-04-18T21:06:50.507293+0000","last_clean":"2024-04-18T21:06:50.507293+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:06:50.507293+0000","last_undegraded":"2024-04-18T21:06:50.507293+0000","last_fullsized":"2024-04-18T21:06:50.507293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329329,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"56'130","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.322285+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:06:50.322285+0000","last_peered":"2024-04-18T21:06:50.322285+0000","last_clean":"2024-04-18T21:06:50.322285+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:06:50.322285+0000","last_undegraded":"2024-04-18T21:06:50.322285+0000","last_fullsized":"2024-04-18T21:06:50.322285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476737,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"56'140","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.353863+0000","last_change":"2024-04-18T21:06:42.763763+0000","last_active":"2024-04-18T21:06:50.353863+0000","last_peered":"2024-04-18T21:06:50.353863+0000","last_clean":"2024-04-18T21:06:50.353863+0000","last_became_active":"2024-04-18T21:06:42.757502+0000","last_became_peered":"2024-04-18T21:06:42.757502+0000","last_unstale":"2024-04-18T21:06:50.353863+0000","last_undegraded":"2024-04-18T21:06:50.353863+0000","last_fullsized":"2024-04-18T21:06:50.353863+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:01:42.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4912459,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"56'132","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.292437+0000","last_change":"2024-04-18T21:06:42.765445+0000","last_active":"2024-04-18T21:06:50.292437+0000","last_peered":"2024-04-18T21:06:50.292437+0000","last_clean":"2024-04-18T21:06:50.292437+0000","last_became_active":"2024-04-18T21:06:42.758220+0000","last_became_peered":"2024-04-18T21:06:42.758220+0000","last_unstale":"2024-04-18T21:06:50.292437+0000","last_undegraded":"2024-04-18T21:06:50.292437+0000","last_fullsized":"2024-04-18T21:06:50.292437+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:47.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855421,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"56'146","reported_seq":239,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.878389+0000","last_change":"2024-04-18T21:06:42.762039+0000","last_active":"2024-04-18T21:06:49.878389+0000","last_peered":"2024-04-18T21:06:49.878389+0000","last_clean":"2024-04-18T21:06:49.878389+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:06:49.878389+0000","last_undegraded":"2024-04-18T21:06:49.878389+0000","last_fullsized":"2024-04-18T21:06:49.878389+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:27.621896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620590,"num_objects":146,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"56'134","reported_seq":222,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.446021+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:06:50.446021+0000","last_peered":"2024-04-18T21:06:50.446021+0000","last_clean":"2024-04-18T21:06:50.446021+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:06:50.446021+0000","last_undegraded":"2024-04-18T21:06:50.446021+0000","last_fullsized":"2024-04-18T21:06:50.446021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409683,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"56'130","reported_seq":218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.218904+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:06:50.218904+0000","last_peered":"2024-04-18T21:06:50.218904+0000","last_clean":"2024-04-18T21:06:50.218904+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:06:50.218904+0000","last_undegraded":"2024-04-18T21:06:50.218904+0000","last_fullsized":"2024-04-18T21:06:50.218904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404524,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"56'123","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.368353+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:06:50.368353+0000","last_peered":"2024-04-18T21:06:50.368353+0000","last_clean":"2024-04-18T21:06:50.368353+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:06:50.368353+0000","last_undegraded":"2024-04-18T21:06:50.368353+0000","last_fullsized":"2024-04-18T21:06:50.368353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":509395,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"56'151","reported_seq":244,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.346811+0000","last_change":"2024-04-18T21:06:42.777421+0000","last_active":"2024-04-18T21:06:50.346811+0000","last_peered":"2024-04-18T21:06:50.346811+0000","last_clean":"2024-04-18T21:06:50.346811+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:06:50.346811+0000","last_undegraded":"2024-04-18T21:06:50.346811+0000","last_fullsized":"2024-04-18T21:06:50.346811+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:05.221224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627249,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"56'133","reported_seq":226,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.386556+0000","last_change":"2024-04-18T21:06:42.776871+0000","last_active":"2024-04-18T21:06:50.386556+0000","last_peered":"2024-04-18T21:06:50.386556+0000","last_clean":"2024-04-18T21:06:50.386556+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:06:50.386556+0000","last_undegraded":"2024-04-18T21:06:50.386556+0000","last_fullsized":"2024-04-18T21:06:50.386556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:16.876164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":602658,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"56'146","reported_seq":234,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.540959+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:06:50.540959+0000","last_peered":"2024-04-18T21:06:50.540959+0000","last_clean":"2024-04-18T21:06:50.540959+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:06:50.540959+0000","last_undegraded":"2024-04-18T21:06:50.540959+0000","last_fullsized":"2024-04-18T21:06:50.540959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580834,"num_objects":146,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"56'124","reported_seq":212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.336471+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:06:50.336471+0000","last_peered":"2024-04-18T21:06:50.336471+0000","last_clean":"2024-04-18T21:06:50.336471+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:06:50.336471+0000","last_undegraded":"2024-04-18T21:06:50.336471+0000","last_fullsized":"2024-04-18T21:06:50.336471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":984959,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"56'137","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.971144+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:06:49.971144+0000","last_peered":"2024-04-18T21:06:49.971144+0000","last_clean":"2024-04-18T21:06:49.971144+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:06:49.971144+0000","last_undegraded":"2024-04-18T21:06:49.971144+0000","last_fullsized":"2024-04-18T21:06:49.971144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619095,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"56'152","reported_seq":240,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.462547+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:06:50.462547+0000","last_peered":"2024-04-18T21:06:50.462547+0000","last_clean":"2024-04-18T21:06:50.462547+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:06:50.462547+0000","last_undegraded":"2024-04-18T21:06:50.462547+0000","last_fullsized":"2024-04-18T21:06:50.462547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457302,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"56'159","reported_seq":247,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.181024+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:06:50.181024+0000","last_peered":"2024-04-18T21:06:50.181024+0000","last_clean":"2024-04-18T21:06:50.181024+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:06:50.181024+0000","last_undegraded":"2024-04-18T21:06:50.181024+0000","last_fullsized":"2024-04-18T21:06:50.181024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":677965,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"56'132","reported_seq":225,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.382018+0000","last_change":"2024-04-18T21:06:42.769309+0000","last_active":"2024-04-18T21:06:50.382018+0000","last_peered":"2024-04-18T21:06:50.382018+0000","last_clean":"2024-04-18T21:06:50.382018+0000","last_became_active":"2024-04-18T21:06:42.766848+0000","last_became_peered":"2024-04-18T21:06:42.766848+0000","last_unstale":"2024-04-18T21:06:50.382018+0000","last_undegraded":"2024-04-18T21:06:50.382018+0000","last_fullsized":"2024-04-18T21:06:50.382018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:09.526938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689654,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"56'124","reported_seq":212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.479566+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:06:50.479566+0000","last_peered":"2024-04-18T21:06:50.479566+0000","last_clean":"2024-04-18T21:06:50.479566+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:06:50.479566+0000","last_undegraded":"2024-04-18T21:06:50.479566+0000","last_fullsized":"2024-04-18T21:06:50.479566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538673,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"56'124","reported_seq":212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.252898+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:06:50.252898+0000","last_peered":"2024-04-18T21:06:50.252898+0000","last_clean":"2024-04-18T21:06:50.252898+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:06:50.252898+0000","last_undegraded":"2024-04-18T21:06:50.252898+0000","last_fullsized":"2024-04-18T21:06:50.252898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":599568,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"56'151","reported_seq":239,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.356024+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:06:50.356024+0000","last_peered":"2024-04-18T21:06:50.356024+0000","last_clean":"2024-04-18T21:06:50.356024+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:06:50.356024+0000","last_undegraded":"2024-04-18T21:06:50.356024+0000","last_fullsized":"2024-04-18T21:06:50.356024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650996,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"56'154","reported_seq":242,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.495435+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:06:50.495435+0000","last_peered":"2024-04-18T21:06:50.495435+0000","last_clean":"2024-04-18T21:06:50.495435+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:06:50.495435+0000","last_undegraded":"2024-04-18T21:06:50.495435+0000","last_fullsized":"2024-04-18T21:06:50.495435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975100,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"56'158","reported_seq":251,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.601622+0000","last_change":"2024-04-18T21:06:42.764233+0000","last_active":"2024-04-18T21:06:50.601622+0000","last_peered":"2024-04-18T21:06:50.601622+0000","last_clean":"2024-04-18T21:06:50.601622+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:06:50.601622+0000","last_undegraded":"2024-04-18T21:06:50.601622+0000","last_fullsized":"2024-04-18T21:06:50.601622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:09.928737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238896,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"56'125","reported_seq":213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.811572+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:06:49.811572+0000","last_peered":"2024-04-18T21:06:49.811572+0000","last_clean":"2024-04-18T21:06:49.811572+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:06:49.811572+0000","last_undegraded":"2024-04-18T21:06:49.811572+0000","last_fullsized":"2024-04-18T21:06:49.811572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594313,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"55'3","reported_seq":26,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778564+0000","last_change":"2024-04-18T21:06:42.767288+0000","last_active":"2024-04-18T21:06:48.778564+0000","last_peered":"2024-04-18T21:06:48.778564+0000","last_clean":"2024-04-18T21:06:48.778564+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:06:48.778564+0000","last_undegraded":"2024-04-18T21:06:48.778564+0000","last_fullsized":"2024-04-18T21:06:48.778564+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:20.327001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"56'125","reported_seq":223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.470580+0000","last_change":"2024-04-18T21:06:04.010167+0000","last_active":"2024-04-18T21:06:50.470580+0000","last_peered":"2024-04-18T21:06:50.470580+0000","last_clean":"2024-04-18T21:06:50.470580+0000","last_became_active":"2024-04-18T21:06:04.009963+0000","last_became_peered":"2024-04-18T21:06:04.009963+0000","last_unstale":"2024-04-18T21:06:50.470580+0000","last_undegraded":"2024-04-18T21:06:50.470580+0000","last_fullsized":"2024-04-18T21:06:50.470580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.959959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531554,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.780082+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:06:48.780082+0000","last_peered":"2024-04-18T21:06:48.780082+0000","last_clean":"2024-04-18T21:06:48.780082+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:06:48.780082+0000","last_undegraded":"2024-04-18T21:06:48.780082+0000","last_fullsized":"2024-04-18T21:06:48.780082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"56'144","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.251881+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:06:50.251881+0000","last_peered":"2024-04-18T21:06:50.251881+0000","last_clean":"2024-04-18T21:06:50.251881+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:06:50.251881+0000","last_undegraded":"2024-04-18T21:06:50.251881+0000","last_fullsized":"2024-04-18T21:06:50.251881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":552166,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777663+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:06:48.777663+0000","last_peered":"2024-04-18T21:06:48.777663+0000","last_clean":"2024-04-18T21:06:48.777663+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:06:48.777663+0000","last_undegraded":"2024-04-18T21:06:48.777663+0000","last_fullsized":"2024-04-18T21:06:48.777663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"56'123","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.494729+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:06:50.494729+0000","last_peered":"2024-04-18T21:06:50.494729+0000","last_clean":"2024-04-18T21:06:50.494729+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:06:50.494729+0000","last_undegraded":"2024-04-18T21:06:50.494729+0000","last_fullsized":"2024-04-18T21:06:50.494729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":527826,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777040+0000","last_change":"2024-04-18T21:06:42.765792+0000","last_active":"2024-04-18T21:06:48.777040+0000","last_peered":"2024-04-18T21:06:48.777040+0000","last_clean":"2024-04-18T21:06:48.777040+0000","last_became_active":"2024-04-18T21:06:42.763647+0000","last_became_peered":"2024-04-18T21:06:42.763647+0000","last_unstale":"2024-04-18T21:06:48.777040+0000","last_undegraded":"2024-04-18T21:06:48.777040+0000","last_fullsized":"2024-04-18T21:06:48.777040+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:29:03.325216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778393+0000","last_change":"2024-04-18T21:06:42.769260+0000","last_active":"2024-04-18T21:06:48.778393+0000","last_peered":"2024-04-18T21:06:48.778393+0000","last_clean":"2024-04-18T21:06:48.778393+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:06:48.778393+0000","last_undegraded":"2024-04-18T21:06:48.778393+0000","last_fullsized":"2024-04-18T21:06:48.778393+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:12:01.164268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"56'135","reported_seq":223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.329933+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:06:50.329933+0000","last_peered":"2024-04-18T21:06:50.329933+0000","last_clean":"2024-04-18T21:06:50.329933+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:06:50.329933+0000","last_undegraded":"2024-04-18T21:06:50.329933+0000","last_fullsized":"2024-04-18T21:06:50.329933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631170,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778934+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:06:48.778934+0000","last_peered":"2024-04-18T21:06:48.778934+0000","last_clean":"2024-04-18T21:06:48.778934+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:06:48.778934+0000","last_undegraded":"2024-04-18T21:06:48.778934+0000","last_fullsized":"2024-04-18T21:06:48.778934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"56'151","reported_seq":239,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.266480+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:06:50.266480+0000","last_peered":"2024-04-18T21:06:50.266480+0000","last_clean":"2024-04-18T21:06:50.266480+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:06:50.266480+0000","last_undegraded":"2024-04-18T21:06:50.266480+0000","last_fullsized":"2024-04-18T21:06:50.266480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1435352,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778006+0000","last_change":"2024-04-18T21:06:42.771952+0000","last_active":"2024-04-18T21:06:48.778006+0000","last_peered":"2024-04-18T21:06:48.778006+0000","last_clean":"2024-04-18T21:06:48.778006+0000","last_became_active":"2024-04-18T21:06:42.768441+0000","last_became_peered":"2024-04-18T21:06:42.768441+0000","last_unstale":"2024-04-18T21:06:48.778006+0000","last_undegraded":"2024-04-18T21:06:48.778006+0000","last_fullsized":"2024-04-18T21:06:48.778006+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:00.622485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"56'135","reported_seq":228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.574116+0000","last_change":"2024-04-18T21:06:42.773762+0000","last_active":"2024-04-18T21:06:50.574116+0000","last_peered":"2024-04-18T21:06:50.574116+0000","last_clean":"2024-04-18T21:06:50.574116+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:06:50.574116+0000","last_undegraded":"2024-04-18T21:06:50.574116+0000","last_fullsized":"2024-04-18T21:06:50.574116+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:42.621459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578927,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.780421+0000","last_change":"2024-04-18T21:06:42.775878+0000","last_active":"2024-04-18T21:06:48.780421+0000","last_peered":"2024-04-18T21:06:48.780421+0000","last_clean":"2024-04-18T21:06:48.780421+0000","last_became_active":"2024-04-18T21:06:42.772647+0000","last_became_peered":"2024-04-18T21:06:42.772647+0000","last_unstale":"2024-04-18T21:06:48.780421+0000","last_undegraded":"2024-04-18T21:06:48.780421+0000","last_fullsized":"2024-04-18T21:06:48.780421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:15.012341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"56'147","reported_seq":235,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.554706+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:06:50.554706+0000","last_peered":"2024-04-18T21:06:50.554706+0000","last_clean":"2024-04-18T21:06:50.554706+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:06:50.554706+0000","last_undegraded":"2024-04-18T21:06:50.554706+0000","last_fullsized":"2024-04-18T21:06:50.554706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":567404,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'18","reported_seq":108,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.779685+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:06:48.779685+0000","last_peered":"2024-04-18T21:06:48.779685+0000","last_clean":"2024-04-18T21:06:48.779685+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:06:48.779685+0000","last_undegraded":"2024-04-18T21:06:48.779685+0000","last_fullsized":"2024-04-18T21:06:48.779685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"56'151","reported_seq":244,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.493037+0000","last_change":"2024-04-18T21:06:42.775218+0000","last_active":"2024-04-18T21:06:50.493037+0000","last_peered":"2024-04-18T21:06:50.493037+0000","last_clean":"2024-04-18T21:06:50.493037+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:06:50.493037+0000","last_undegraded":"2024-04-18T21:06:50.493037+0000","last_fullsized":"2024-04-18T21:06:50.493037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:09.627976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741646,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778110+0000","last_change":"2024-04-18T21:06:42.762081+0000","last_active":"2024-04-18T21:06:48.778110+0000","last_peered":"2024-04-18T21:06:48.778110+0000","last_clean":"2024-04-18T21:06:48.778110+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:06:48.778110+0000","last_undegraded":"2024-04-18T21:06:48.778110+0000","last_fullsized":"2024-04-18T21:06:48.778110+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:14.883260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"56'143","reported_seq":236,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.221757+0000","last_change":"2024-04-18T21:06:42.771159+0000","last_active":"2024-04-18T21:06:50.221757+0000","last_peered":"2024-04-18T21:06:50.221757+0000","last_clean":"2024-04-18T21:06:50.221757+0000","last_became_active":"2024-04-18T21:06:42.767524+0000","last_became_peered":"2024-04-18T21:06:42.767524+0000","last_unstale":"2024-04-18T21:06:50.221757+0000","last_undegraded":"2024-04-18T21:06:50.221757+0000","last_fullsized":"2024-04-18T21:06:50.221757+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:42.258137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496388,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777754+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:06:48.777754+0000","last_peered":"2024-04-18T21:06:48.777754+0000","last_clean":"2024-04-18T21:06:48.777754+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:06:48.777754+0000","last_undegraded":"2024-04-18T21:06:48.777754+0000","last_fullsized":"2024-04-18T21:06:48.777754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"56'120","reported_seq":213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.258977+0000","last_change":"2024-04-18T21:06:42.763294+0000","last_active":"2024-04-18T21:06:50.258977+0000","last_peered":"2024-04-18T21:06:50.258977+0000","last_clean":"2024-04-18T21:06:50.258977+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:06:50.258977+0000","last_undegraded":"2024-04-18T21:06:50.258977+0000","last_fullsized":"2024-04-18T21:06:50.258977+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:27.194682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508097,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777284+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:06:48.777284+0000","last_peered":"2024-04-18T21:06:48.777284+0000","last_clean":"2024-04-18T21:06:48.777284+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:06:48.777284+0000","last_undegraded":"2024-04-18T21:06:48.777284+0000","last_fullsized":"2024-04-18T21:06:48.777284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"56'125","reported_seq":213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.288908+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:06:50.288908+0000","last_peered":"2024-04-18T21:06:50.288908+0000","last_clean":"2024-04-18T21:06:50.288908+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:06:50.288908+0000","last_undegraded":"2024-04-18T21:06:50.288908+0000","last_fullsized":"2024-04-18T21:06:50.288908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419411,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777574+0000","last_change":"2024-04-18T21:06:42.764387+0000","last_active":"2024-04-18T21:06:48.777574+0000","last_peered":"2024-04-18T21:06:48.777574+0000","last_clean":"2024-04-18T21:06:48.777574+0000","last_became_active":"2024-04-18T21:06:42.763432+0000","last_became_peered":"2024-04-18T21:06:42.763432+0000","last_unstale":"2024-04-18T21:06:48.777574+0000","last_undegraded":"2024-04-18T21:06:48.777574+0000","last_fullsized":"2024-04-18T21:06:48.777574+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:10.269224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.779816+0000","last_change":"2024-04-18T21:06:42.775112+0000","last_active":"2024-04-18T21:06:48.779816+0000","last_peered":"2024-04-18T21:06:48.779816+0000","last_clean":"2024-04-18T21:06:48.779816+0000","last_became_active":"2024-04-18T21:06:42.770706+0000","last_became_peered":"2024-04-18T21:06:42.770706+0000","last_unstale":"2024-04-18T21:06:48.779816+0000","last_undegraded":"2024-04-18T21:06:48.779816+0000","last_fullsized":"2024-04-18T21:06:48.779816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:24:32.220495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"55'1","reported_seq":91,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.780391+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:06:48.780391+0000","last_peered":"2024-04-18T21:06:48.780391+0000","last_clean":"2024-04-18T21:06:48.780391+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:06:48.780391+0000","last_undegraded":"2024-04-18T21:06:48.780391+0000","last_fullsized":"2024-04-18T21:06:48.780391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"56'139","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.210654+0000","last_change":"2024-04-18T21:06:42.772808+0000","last_active":"2024-04-18T21:06:50.210654+0000","last_peered":"2024-04-18T21:06:50.210654+0000","last_clean":"2024-04-18T21:06:50.210654+0000","last_became_active":"2024-04-18T21:06:42.770871+0000","last_became_peered":"2024-04-18T21:06:42.770871+0000","last_unstale":"2024-04-18T21:06:50.210654+0000","last_undegraded":"2024-04-18T21:06:50.210654+0000","last_fullsized":"2024-04-18T21:06:50.210654+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:24:37.254402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574892,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777405+0000","last_change":"2024-04-18T21:06:42.767098+0000","last_active":"2024-04-18T21:06:48.777405+0000","last_peered":"2024-04-18T21:06:48.777405+0000","last_clean":"2024-04-18T21:06:48.777405+0000","last_became_active":"2024-04-18T21:06:42.765744+0000","last_became_peered":"2024-04-18T21:06:42.765744+0000","last_unstale":"2024-04-18T21:06:48.777405+0000","last_undegraded":"2024-04-18T21:06:48.777405+0000","last_fullsized":"2024-04-18T21:06:48.777405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:10.352655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778696+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:06:48.778696+0000","last_peered":"2024-04-18T21:06:48.778696+0000","last_clean":"2024-04-18T21:06:48.778696+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:06:48.778696+0000","last_undegraded":"2024-04-18T21:06:48.778696+0000","last_fullsized":"2024-04-18T21:06:48.778696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"56'139","reported_seq":227,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.509983+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:06:50.509983+0000","last_peered":"2024-04-18T21:06:50.509983+0000","last_clean":"2024-04-18T21:06:50.509983+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:06:50.509983+0000","last_undegraded":"2024-04-18T21:06:50.509983+0000","last_fullsized":"2024-04-18T21:06:50.509983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":501596,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.780042+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:06:48.780042+0000","last_peered":"2024-04-18T21:06:48.780042+0000","last_clean":"2024-04-18T21:06:48.780042+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:06:48.780042+0000","last_undegraded":"2024-04-18T21:06:48.780042+0000","last_fullsized":"2024-04-18T21:06:48.780042+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"56'2","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777434+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:06:48.777434+0000","last_peered":"2024-04-18T21:06:48.777434+0000","last_clean":"2024-04-18T21:06:48.777434+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:06:48.777434+0000","last_undegraded":"2024-04-18T21:06:48.777434+0000","last_fullsized":"2024-04-18T21:06:48.777434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"56'121","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.528768+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:06:50.528768+0000","last_peered":"2024-04-18T21:06:50.528768+0000","last_clean":"2024-04-18T21:06:50.528768+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:06:50.528768+0000","last_undegraded":"2024-04-18T21:06:50.528768+0000","last_fullsized":"2024-04-18T21:06:50.528768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":683317,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.780549+0000","last_change":"2024-04-18T21:06:42.771115+0000","last_active":"2024-04-18T21:06:48.780549+0000","last_peered":"2024-04-18T21:06:48.780549+0000","last_clean":"2024-04-18T21:06:48.780549+0000","last_became_active":"2024-04-18T21:06:42.769644+0000","last_became_peered":"2024-04-18T21:06:42.769644+0000","last_unstale":"2024-04-18T21:06:48.780549+0000","last_undegraded":"2024-04-18T21:06:48.780549+0000","last_fullsized":"2024-04-18T21:06:48.780549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:57.139815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.779053+0000","last_change":"2024-04-18T21:06:42.769806+0000","last_active":"2024-04-18T21:06:48.779053+0000","last_peered":"2024-04-18T21:06:48.779053+0000","last_clean":"2024-04-18T21:06:48.779053+0000","last_became_active":"2024-04-18T21:06:42.766399+0000","last_became_peered":"2024-04-18T21:06:42.766399+0000","last_unstale":"2024-04-18T21:06:48.779053+0000","last_undegraded":"2024-04-18T21:06:48.779053+0000","last_fullsized":"2024-04-18T21:06:48.779053+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:14.377108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"56'117","reported_seq":205,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.707054+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:06:49.707054+0000","last_peered":"2024-04-18T21:06:49.707054+0000","last_clean":"2024-04-18T21:06:49.707054+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:06:49.707054+0000","last_undegraded":"2024-04-18T21:06:49.707054+0000","last_fullsized":"2024-04-18T21:06:49.707054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443258,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.779443+0000","last_change":"2024-04-18T21:06:42.771952+0000","last_active":"2024-04-18T21:06:48.779443+0000","last_peered":"2024-04-18T21:06:48.779443+0000","last_clean":"2024-04-18T21:06:48.779443+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:06:48.779443+0000","last_undegraded":"2024-04-18T21:06:48.779443+0000","last_fullsized":"2024-04-18T21:06:48.779443+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:41.248683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.781293+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:06:48.781293+0000","last_peered":"2024-04-18T21:06:48.781293+0000","last_clean":"2024-04-18T21:06:48.781293+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:06:48.781293+0000","last_undegraded":"2024-04-18T21:06:48.781293+0000","last_fullsized":"2024-04-18T21:06:48.781293+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"56'123","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.587358+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:06:50.587358+0000","last_peered":"2024-04-18T21:06:50.587358+0000","last_clean":"2024-04-18T21:06:50.587358+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:06:50.587358+0000","last_undegraded":"2024-04-18T21:06:50.587358+0000","last_fullsized":"2024-04-18T21:06:50.587358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497170,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.781107+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:06:48.781107+0000","last_peered":"2024-04-18T21:06:48.781107+0000","last_clean":"2024-04-18T21:06:48.781107+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:06:48.781107+0000","last_undegraded":"2024-04-18T21:06:48.781107+0000","last_fullsized":"2024-04-18T21:06:48.781107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778560+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:06:48.778560+0000","last_peered":"2024-04-18T21:06:48.778560+0000","last_clean":"2024-04-18T21:06:48.778560+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:06:48.778560+0000","last_undegraded":"2024-04-18T21:06:48.778560+0000","last_fullsized":"2024-04-18T21:06:48.778560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"56'135","reported_seq":223,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.510328+0000","last_change":"2024-04-18T21:05:08.605248+0000","last_active":"2024-04-18T21:06:50.510328+0000","last_peered":"2024-04-18T21:06:50.510328+0000","last_clean":"2024-04-18T21:06:50.510328+0000","last_became_active":"2024-04-18T21:05:08.604501+0000","last_became_peered":"2024-04-18T21:05:08.604501+0000","last_unstale":"2024-04-18T21:06:50.510328+0000","last_undegraded":"2024-04-18T21:06:50.510328+0000","last_fullsized":"2024-04-18T21:06:50.510328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580751,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.780983+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:06:48.780983+0000","last_peered":"2024-04-18T21:06:48.780983+0000","last_clean":"2024-04-18T21:06:48.780983+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:06:48.780983+0000","last_undegraded":"2024-04-18T21:06:48.780983+0000","last_fullsized":"2024-04-18T21:06:48.780983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.783369+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:06:48.783369+0000","last_peered":"2024-04-18T21:06:48.783369+0000","last_clean":"2024-04-18T21:06:48.783369+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:06:48.783369+0000","last_undegraded":"2024-04-18T21:06:48.783369+0000","last_fullsized":"2024-04-18T21:06:48.783369+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"56'140","reported_seq":228,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.670960+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:06:50.670960+0000","last_peered":"2024-04-18T21:06:50.670960+0000","last_clean":"2024-04-18T21:06:50.670960+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:06:50.670960+0000","last_undegraded":"2024-04-18T21:06:50.670960+0000","last_fullsized":"2024-04-18T21:06:50.670960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467773,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'17","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.651668+0000","last_change":"2024-04-18T21:06:36.741511+0000","last_active":"2024-04-18T21:06:49.651668+0000","last_peered":"2024-04-18T21:06:49.651668+0000","last_clean":"2024-04-18T21:06:49.651668+0000","last_became_active":"2024-04-18T21:06:36.737416+0000","last_became_peered":"2024-04-18T21:06:36.737416+0000","last_unstale":"2024-04-18T21:06:49.651668+0000","last_undegraded":"2024-04-18T21:06:49.651668+0000","last_fullsized":"2024-04-18T21:06:49.651668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:20.743288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778724+0000","last_change":"2024-04-18T21:06:42.761278+0000","last_active":"2024-04-18T21:06:48.778724+0000","last_peered":"2024-04-18T21:06:48.778724+0000","last_clean":"2024-04-18T21:06:48.778724+0000","last_became_active":"2024-04-18T21:06:42.760377+0000","last_became_peered":"2024-04-18T21:06:42.760377+0000","last_unstale":"2024-04-18T21:06:48.778724+0000","last_undegraded":"2024-04-18T21:06:48.778724+0000","last_fullsized":"2024-04-18T21:06:48.778724+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:13.153204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"56'121","reported_seq":209,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.460915+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:06:50.460915+0000","last_peered":"2024-04-18T21:06:50.460915+0000","last_clean":"2024-04-18T21:06:50.460915+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:06:50.460915+0000","last_undegraded":"2024-04-18T21:06:50.460915+0000","last_fullsized":"2024-04-18T21:06:50.460915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531774,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"56'134","reported_seq":227,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.518759+0000","last_change":"2024-04-18T21:06:42.767671+0000","last_active":"2024-04-18T21:06:50.518759+0000","last_peered":"2024-04-18T21:06:50.518759+0000","last_clean":"2024-04-18T21:06:50.518759+0000","last_became_active":"2024-04-18T21:06:42.764583+0000","last_became_peered":"2024-04-18T21:06:42.764583+0000","last_unstale":"2024-04-18T21:06:50.518759+0000","last_undegraded":"2024-04-18T21:06:50.518759+0000","last_fullsized":"2024-04-18T21:06:50.518759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:10.843661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883890,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":2886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"52'20","reported_seq":115,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777676+0000","last_change":"2024-04-18T21:06:42.757898+0000","last_active":"2024-04-18T21:06:48.777676+0000","last_peered":"2024-04-18T21:06:48.777676+0000","last_clean":"2024-04-18T21:06:48.777676+0000","last_became_active":"2024-04-18T21:06:42.756852+0000","last_became_peered":"2024-04-18T21:06:42.756852+0000","last_unstale":"2024-04-18T21:06:48.777676+0000","last_undegraded":"2024-04-18T21:06:48.777676+0000","last_fullsized":"2024-04-18T21:06:48.777676+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:08.919283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"56'129","reported_seq":217,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.338712+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:06:50.338712+0000","last_peered":"2024-04-18T21:06:50.338712+0000","last_clean":"2024-04-18T21:06:50.338712+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:06:50.338712+0000","last_undegraded":"2024-04-18T21:06:50.338712+0000","last_fullsized":"2024-04-18T21:06:50.338712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569356,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":93,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778449+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:06:48.778449+0000","last_peered":"2024-04-18T21:06:48.778449+0000","last_clean":"2024-04-18T21:06:48.778449+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:06:48.778449+0000","last_undegraded":"2024-04-18T21:06:48.778449+0000","last_fullsized":"2024-04-18T21:06:48.778449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.782676+0000","last_change":"2024-04-18T21:06:42.765175+0000","last_active":"2024-04-18T21:06:48.782676+0000","last_peered":"2024-04-18T21:06:48.782676+0000","last_clean":"2024-04-18T21:06:48.782676+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:06:48.782676+0000","last_undegraded":"2024-04-18T21:06:48.782676+0000","last_fullsized":"2024-04-18T21:06:48.782676+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:26.185227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"56'144","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.517336+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:06:50.517336+0000","last_peered":"2024-04-18T21:06:50.517336+0000","last_clean":"2024-04-18T21:06:50.517336+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:06:50.517336+0000","last_undegraded":"2024-04-18T21:06:50.517336+0000","last_fullsized":"2024-04-18T21:06:50.517336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1249622,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.781383+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:06:48.781383+0000","last_peered":"2024-04-18T21:06:48.781383+0000","last_clean":"2024-04-18T21:06:48.781383+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:06:48.781383+0000","last_undegraded":"2024-04-18T21:06:48.781383+0000","last_fullsized":"2024-04-18T21:06:48.781383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"56'152","reported_seq":240,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.224523+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:06:50.224523+0000","last_peered":"2024-04-18T21:06:50.224523+0000","last_clean":"2024-04-18T21:06:50.224523+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:06:50.224523+0000","last_undegraded":"2024-04-18T21:06:50.224523+0000","last_fullsized":"2024-04-18T21:06:50.224523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4857289,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"56'125","reported_seq":213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.122124+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:06:50.122124+0000","last_peered":"2024-04-18T21:06:50.122124+0000","last_clean":"2024-04-18T21:06:50.122124+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:06:50.122124+0000","last_undegraded":"2024-04-18T21:06:50.122124+0000","last_fullsized":"2024-04-18T21:06:50.122124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993647,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":1041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778270+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:06:48.778270+0000","last_peered":"2024-04-18T21:06:48.778270+0000","last_clean":"2024-04-18T21:06:48.778270+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:06:48.778270+0000","last_undegraded":"2024-04-18T21:06:48.778270+0000","last_fullsized":"2024-04-18T21:06:48.778270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"56'139","reported_seq":227,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.548634+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:06:50.548634+0000","last_peered":"2024-04-18T21:06:50.548634+0000","last_clean":"2024-04-18T21:06:50.548634+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:06:50.548634+0000","last_undegraded":"2024-04-18T21:06:50.548634+0000","last_fullsized":"2024-04-18T21:06:50.548634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":509949,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":90,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.778593+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:06:48.778593+0000","last_peered":"2024-04-18T21:06:48.778593+0000","last_clean":"2024-04-18T21:06:48.778593+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:06:48.778593+0000","last_undegraded":"2024-04-18T21:06:48.778593+0000","last_fullsized":"2024-04-18T21:06:48.778593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"56'127","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.062654+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:06:50.062654+0000","last_peered":"2024-04-18T21:06:50.062654+0000","last_clean":"2024-04-18T21:06:50.062654+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:06:50.062654+0000","last_undegraded":"2024-04-18T21:06:50.062654+0000","last_fullsized":"2024-04-18T21:06:50.062654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503675,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"55'2","reported_seq":92,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777450+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:06:48.777450+0000","last_peered":"2024-04-18T21:06:48.777450+0000","last_clean":"2024-04-18T21:06:48.777450+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:06:48.777450+0000","last_undegraded":"2024-04-18T21:06:48.777450+0000","last_fullsized":"2024-04-18T21:06:48.777450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"56'123","reported_seq":211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.279178+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:06:50.279178+0000","last_peered":"2024-04-18T21:06:50.279178+0000","last_clean":"2024-04-18T21:06:50.279178+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:06:50.279178+0000","last_undegraded":"2024-04-18T21:06:50.279178+0000","last_fullsized":"2024-04-18T21:06:50.279178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":598504,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"54'5","reported_seq":95,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.777837+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:06:48.777837+0000","last_peered":"2024-04-18T21:06:48.777837+0000","last_clean":"2024-04-18T21:06:48.777837+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:06:48.777837+0000","last_undegraded":"2024-04-18T21:06:48.777837+0000","last_fullsized":"2024-04-18T21:06:48.777837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"56'122","reported_seq":215,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.133568+0000","last_change":"2024-04-18T21:06:42.769314+0000","last_active":"2024-04-18T21:06:50.133568+0000","last_peered":"2024-04-18T21:06:50.133568+0000","last_clean":"2024-04-18T21:06:50.133568+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:06:50.133568+0000","last_undegraded":"2024-04-18T21:06:50.133568+0000","last_fullsized":"2024-04-18T21:06:50.133568+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:29:04.334671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328347,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.779063+0000","last_change":"2024-04-18T21:06:42.771271+0000","last_active":"2024-04-18T21:06:48.779063+0000","last_peered":"2024-04-18T21:06:48.779063+0000","last_clean":"2024-04-18T21:06:48.779063+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:06:48.779063+0000","last_undegraded":"2024-04-18T21:06:48.779063+0000","last_fullsized":"2024-04-18T21:06:48.779063+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:08.517484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"56'134","reported_seq":227,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.004634+0000","last_change":"2024-04-18T21:06:42.768180+0000","last_active":"2024-04-18T21:06:50.004634+0000","last_peered":"2024-04-18T21:06:50.004634+0000","last_clean":"2024-04-18T21:06:50.004634+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:06:50.004634+0000","last_undegraded":"2024-04-18T21:06:50.004634+0000","last_fullsized":"2024-04-18T21:06:50.004634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:47.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435187,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"56'6","reported_seq":96,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:49.665472+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:06:49.665472+0000","last_peered":"2024-04-18T21:06:49.665472+0000","last_clean":"2024-04-18T21:06:49.665472+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:06:49.665472+0000","last_undegraded":"2024-04-18T21:06:49.665472+0000","last_fullsized":"2024-04-18T21:06:49.665472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4019737,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"56'139","reported_seq":227,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.568990+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:06:50.568990+0000","last_peered":"2024-04-18T21:06:50.568990+0000","last_clean":"2024-04-18T21:06:50.568990+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:06:50.568990+0000","last_undegraded":"2024-04-18T21:06:50.568990+0000","last_fullsized":"2024-04-18T21:06:50.568990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":795659,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"56'102","reported_seq":192,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.831371+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:06:48.831371+0000","last_peered":"2024-04-18T21:06:48.831371+0000","last_clean":"2024-04-18T21:06:48.831371+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:06:48.831371+0000","last_undegraded":"2024-04-18T21:06:48.831371+0000","last_fullsized":"2024-04-18T21:06:48.831371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"56'152","reported_seq":245,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:50.524029+0000","last_change":"2024-04-18T21:06:42.764836+0000","last_active":"2024-04-18T21:06:50.524029+0000","last_peered":"2024-04-18T21:06:50.524029+0000","last_clean":"2024-04-18T21:06:50.524029+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:06:50.524029+0000","last_undegraded":"2024-04-18T21:06:50.524029+0000","last_fullsized":"2024-04-18T21:06:50.524029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:18.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498126,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-18T21:06:48.780274+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:06:48.780274+0000","last_peered":"2024-04-18T21:06:48.780274+0000","last_clean":"2024-04-18T21:06:48.780274+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:06:48.780274+0000","last_undegraded":"2024-04-18T21:06:48.780274+0000","last_fullsized":"2024-04-18T21:06:48.780274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":52109382,"num_objects":8599,"num_object_clones":0,"num_object_copies":17198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8599,"num_write_kb":55406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":116666368,"data_stored":104210175,"data_compressed":11787992,"data_compressed_allocated":14589952,"data_compressed_original":43261952,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":29187031,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":29425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11657216,"data_stored":58374062,"data_compressed":9161044,"data_compressed_allocated":10862592,"data_compressed_original":57638912,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738395,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79752,"kb_used_data":44416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94292088,"statfs":{"total":96636764160,"available":96555098112,"internally_reserved":0,"allocated":45481984,"data_stored":55721689,"data_compressed":6847792,"data_compressed_allocated":8269824,"data_compressed_original":31940608,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738395,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74284,"kb_used_data":38948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94297556,"statfs":{"total":96636764160,"available":96560697344,"internally_reserved":0,"allocated":39882752,"data_stored":49920605,"data_compressed":6639133,"data_compressed_allocated":8167424,"data_compressed_original":32247808,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70048,"kb_used_data":38872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94301792,"statfs":{"total":96636764160,"available":96565035008,"internally_reserved":0,"allocated":39804928,"data_stored":51811866,"data_compressed":6639556,"data_compressed_allocated":8003584,"data_compressed_original":32931840,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4030464,"data_stored":20798423,"data_compressed":3337497,"data_compressed_allocated":3899392,"data_compressed_original":20697088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3416064,"data_stored":16777832,"data_compressed":2569127,"data_compressed_allocated":3104768,"data_compressed_original":16474112,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":20797807,"data_compressed":3254420,"data_compressed_allocated":3858432,"data_compressed_original":20467712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37273600,"data_stored":33450674,"data_compressed":3679657,"data_compressed_allocated":4567040,"data_compressed_original":14036992,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37679104,"data_stored":34043040,"data_compressed":4177536,"data_compressed_allocated":5206016,"data_compressed_original":16044032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41713664,"data_stored":36716461,"data_compressed":3930799,"data_compressed_allocated":4816896,"data_compressed_original":13180928,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:06:52.610 INFO:tasks.thrashosds.thrasher:Setting 4.3 to [1, 2] 2024-04-18T21:06:52.610 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.3', '1', '2'] 2024-04-18T21:06:52.611 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.3 1 2 2024-04-18T21:06:52.611 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:52.609+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:52.690 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:52.690 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:52.690 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:52.690 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:52.690 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:52.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:52.698+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:52.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:52.801 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:52.799+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 114.756259714, 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:52.887 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 114.756227451, 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.893 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:52.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:52.898 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 114.75611189999999, 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:52.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:52.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.288677975, 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:52.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.288564851, 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:52.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:52.914 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.288485769, 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:52.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:52.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:52.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.28838256500001, 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:52.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:52.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:52.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.288292793, 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:52.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:52.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:52.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:52.930 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.288206755, 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:52.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.28814267, 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.940 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.288057072, 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.28799087900001, 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.287921501, 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.287607834, 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.956 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:52.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:52.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:52.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.28755832500001, 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:52.961 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:52.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.287493063, 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.287358883, 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:52.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:52.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 104.287255418, 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:52.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:52.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:52.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:52.980 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.448215619999999, 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:06:52.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:06:52.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:06:52.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.985 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:206 3.1d e57/15 3:bf8dcf43:::200.00000008:head v 57'8, mlcod=56'6)", 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:51.889593+0000", 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.99581205699999997, 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022213417999999999, 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.889593+0000", 2024-04-18T21:06:52.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.889593+0000", 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.889595+0000", 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.137e-06 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895137+0000", 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055418919999999997 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895171+0000", 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3476999999999998e-05 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895185+0000", 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4093e-05 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895325+0000", 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139825 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:52.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895392+0000", 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7385999999999995e-05 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.911709+0000", 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016317071999999998 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.911807+0000", 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:52.990 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:52.990 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:52.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:52.992 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:52.989+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:53.091 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:53.089+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:53.142 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10500 4.16 4:688f8ee2:::10000003012.00000000:head [write 0~17847 in=17847b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:53.141724+0000", 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003415735, 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034545230000000001, 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10500 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.141724+0000", 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.141724+0000", 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.141725+0000", 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1689999999999999e-06 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.141750+0000", 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4861000000000001e-05 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.141766+0000", 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6121999999999999e-05 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.141774+0000", 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4090000000000003e-06 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.141853+0000", 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8141999999999998e-05 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.142004+0000", 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150965 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.142136+0000", 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013227700000000001 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.145024+0000", 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002887868 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10502 4.35 4:aeadc8ea:::10000003015.00000000:head [write 0~1404 in=1404b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:53.144149+0000", 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0009909579999999999, 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011573930000000001, 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10502 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144149+0000", 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144149+0000", 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144150+0000", 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144159+0000", 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4460000000000001e-06 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144179+0000", 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144191+0000", 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2009e-05 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144259+0000", 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8021000000000005e-05 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144387+0000", 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012779800000000001 2024-04-18T21:06:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:53.144512+0000", 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012544499999999999 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 2 2024-04-18T21:06:53.151 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:53.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:53.193 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:53.191+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:53.294 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:53.293+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:53.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-18T21:06:53.299 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:53.299 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:53.301 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:53.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ make 2024-04-18T21:06:53.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:53.346 INFO:tasks.workunit.client.0.smithi096.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-18T21:06:53.395 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:53.397+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.843417837000001, 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:06:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:06:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.830553617, 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:06:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.829752147000001, 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.828978442, 2024-04-18T21:06:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:06:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:06:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:06:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.821732878000001, 2024-04-18T21:06:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.818666218000001, 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:06:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:06:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:06:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:06:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.800821513000001, 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:06:53.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:06:53.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:06:53.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.799982473, 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:06:53.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:53.483 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.795628793000001, 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:06:53.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:06:53.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.794860481000001, 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:06:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.498 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.791510877, 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:06:53.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:06:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:06:53.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3101 4.39 4:9f88871f:::10000000f79.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.783811022, 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15377127199999999, 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3101 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651075+0000", 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0199999999999994e-06 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651088+0000", 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125999999999999e-05 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651118+0000", 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0056000000000002e-05 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651133+0000", 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-05 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651300+0000", 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016728000000000001 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651332+0000", 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1316000000000003e-05 2024-04-18T21:06:53.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795393+0000", 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14406152699999999 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795615+0000", 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022176100000000001 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796175+0000", 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055999999999999995 2024-04-18T21:06:53.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803891+0000", 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077157019999999996 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804661+0000", 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077030499999999999 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804756+0000", 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4893000000000001e-05 2024-04-18T21:06:53.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804838+0000", 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2455999999999998e-05 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3102 4.a 4:51346ff1:::10000000f7a.00000000:head [write 0~2274] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.782937173000001, 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15630893400000001, 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3102 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651943+0000", 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2239999999999998e-06 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651955+0000", 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651985+0000", 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0212000000000001e-05 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652005+0000", 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0060000000000001e-05 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652155+0000", 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015061 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652172+0000", 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6699999999999999e-05 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795443+0000", 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.143270429 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795698+0000", 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025559399999999999 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796261+0000", 2024-04-18T21:06:53.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056251499999999998 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804465+0000", 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082038619999999993 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808068+0000", 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036032339999999999 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808163+0000", 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4913000000000004e-05 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808250+0000", 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7040999999999996e-05 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:53.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.7780349, 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:53.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:06:53.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3109 4.a 4:51362415:::10000000f81.00000000:head [write 0~549] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:53.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.777153624, 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15212483099999999, 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3109 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657726+0000", 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657737+0000", 2024-04-18T21:06:53.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0413e-05 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657758+0000", 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1066000000000001e-05 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657770+0000", 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2037e-05 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657884+0000", 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657899+0000", 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4912999999999999e-05 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797739+0000", 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.139839608 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797980+0000", 2024-04-18T21:06:53.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024131000000000001 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.798495+0000", 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051529799999999997 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807863+0000", 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093672040000000005 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808270+0000", 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00040760200000000002 2024-04-18T21:06:53.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809761+0000", 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001490805 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809849+0000", 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8244000000000004e-05 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.529 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.776381396, 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:06:53.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:06:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.773250626999999, 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:06:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.745937916000001, 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.542 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:06:53.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:06:53.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.744565489999999, 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:06:53.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:06:53.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:06:53.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3147 4.c 4:30e7223c:::10000000faa.00000000:head [write 0~3847] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.741230256, 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14405016200000001, 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3147 2024-04-18T21:06:53.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693650+0000", 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.277e-06 2024-04-18T21:06:53.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693684+0000", 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4003e-05 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693716+0000", 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2212999999999998e-05 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693731+0000", 2024-04-18T21:06:53.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4525999999999999e-05 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693864+0000", 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013289399999999999 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693878+0000", 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.455e-05 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831460+0000", 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.137582329 2024-04-18T21:06:53.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831586+0000", 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542900000000001 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831762+0000", 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017588599999999999 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.833477+0000", 2024-04-18T21:06:53.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001715563 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837579+0000", 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041016389999999998 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837638+0000", 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9249999999999997e-05 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837698+0000", 2024-04-18T21:06:53.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9602999999999998e-05 2024-04-18T21:06:53.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.560 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:53.560 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:53.560 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:53.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:53.562 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:53.559+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:53.595 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:53.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:53.658+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:53.686 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:53.687 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:53.687 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:53.687 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:53.700 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:53.754 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:53.754 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:53.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:53.762+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi096.stderr:set 4.3 pg_upmap mapping to [1,2] 2024-04-18T21:06:53.822 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:53.838 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:53.839 INFO:tasks.workunit.client.0.smithi096.stderr:++ readlink -f fsstress 2024-04-18T21:06:53.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-18T21:06:53.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2024-04-18T21:06:53.842 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:53.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2024-04-18T21:06:53.842 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:53.842 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp -d -p . 2024-04-18T21:06:53.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ T=./tmp.pYQ32nC2Vb 2024-04-18T21:06:53.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.pYQ32nC2Vb -l 1 -n 1000 -p 10 -v 2024-04-18T21:06:53.845 INFO:tasks.workunit.client.0.smithi096.stdout:seed = 1714257557 2024-04-18T21:06:53.847 INFO:tasks.workunit.client.0.smithi096.stdout:0/0: chown . 260576 1 2024-04-18T21:06:53.847 INFO:tasks.workunit.client.0.smithi096.stdout:0/1: dread - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/0: dread - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/1: dwrite - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/2: dread - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/3: rename - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/4: fdatasync - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:0/2: symlink l0 0 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:0/3: fsync - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/5: chown . 107 1 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/6: truncate - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/7: dread - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/8: rename - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/9: readlink - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/10: dwrite - no filename 2024-04-18T21:06:53.848 INFO:tasks.workunit.client.0.smithi096.stdout:2/0: fsync - no filename 2024-04-18T21:06:53.849 INFO:tasks.workunit.client.0.smithi096.stdout:2/1: rename - no filename 2024-04-18T21:06:53.850 INFO:tasks.workunit.client.0.smithi096.stdout:0/4: chown l0 233 1 2024-04-18T21:06:53.850 INFO:tasks.workunit.client.0.smithi096.stdout:0/5: truncate - no filename 2024-04-18T21:06:53.850 INFO:tasks.workunit.client.0.smithi096.stdout:3/0: rename - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:3/1: chown . 0 1 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:3/2: dread - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:3/3: readlink - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:3/4: fsync - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:3/5: dwrite - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:3/6: write - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:0/6: chown l0 1878708987 1 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:0/7: write - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/2: symlink l0 0 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/3: dwrite - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/4: write - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/5: write - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/6: read - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:4/0: dread - no filename 2024-04-18T21:06:53.851 INFO:tasks.workunit.client.0.smithi096.stdout:4/1: rmdir - no directory 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/2: write - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/3: dwrite - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/4: fdatasync - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/5: read - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/6: dwrite - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:0/8: mkdir d1 0 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:0/9: write - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:2/7: chown l0 711107 1 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:2/8: dread - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:2/9: truncate - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:2/10: dwrite - no filename 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:0/10: chown d1 13559600 1 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:3/7: creat f0 x:0 0 0 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:5/0: rmdir - no directory 2024-04-18T21:06:53.852 INFO:tasks.workunit.client.0.smithi096.stdout:5/1: dwrite - no filename 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:5/2: write - no filename 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/11: chown l0 1307 1 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/12: read - no filename 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/13: dwrite - no filename 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/7: creat f0 x:0 0 0 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/14: stat l0 0 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/15: fsync - no filename 2024-04-18T21:06:53.853 INFO:tasks.workunit.client.0.smithi096.stdout:3/8: creat f1 x:0 0 0 2024-04-18T21:06:53.856 INFO:tasks.workunit.client.0.smithi096.stdout:4/8: creat f1 x:0 0 0 2024-04-18T21:06:53.856 INFO:tasks.workunit.client.0.smithi096.stdout:6/0: readlink - no filename 2024-04-18T21:06:53.856 INFO:tasks.workunit.client.0.smithi096.stdout:6/1: stat - no entries 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:2/16: unlink l0 0 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:2/17: rename - no filename 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:2/18: dwrite - no filename 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:0/11: getdents d1 0 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:0/12: dread - no filename 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:5/3: creat f0 x:0 0 0 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:3/9: fdatasync f0 0 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:6/2: chown . 30 1 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:6/3: dwrite - no filename 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:6/4: rename - no filename 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:6/5: dread - no filename 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:7/0: chown . 0 1 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:7/1: dread - no filename 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:7/2: unlink - no file 2024-04-18T21:06:53.857 INFO:tasks.workunit.client.0.smithi096.stdout:7/3: write - no filename 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:7/4: chown . 123534 1 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:2/19: creat f1 x:0 0 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:5/4: symlink l1 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:3/10: truncate f1 332539 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:6/6: mknod c0 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:2/20: write f1 [254314,60777] 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:5/5: write f0 [631920,77316] 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:7/5: mkdir d0 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:0/13: creat d1/f2 x:0 0 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:7/6: truncate - no filename 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:6/7: unlink c0 0 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/0: stat - no entries 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/1: fsync - no filename 2024-04-18T21:06:53.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/2: truncate - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/3: link - no file 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/4: fdatasync - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/5: unlink - no file 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/6: truncate - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/7: rename - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/8: dread - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/9: read - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/10: write - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/11: fdatasync - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/12: rename - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/13: dread - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/14: dread - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/15: dread - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/16: fsync - no filename 2024-04-18T21:06:53.859 INFO:tasks.workunit.client.0.smithi096.stdout:3/11: dread - f0 zero size 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/8: mkdir d1 0 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/9: dwrite - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/10: read - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/11: dwrite - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/12: dwrite - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:0/14: dread - d1/f2 zero size 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/13: dwrite - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/14: truncate - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:5/6: mkdir d2 0 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:8/0: mkdir d0 0 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:8/1: write - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:9/17: mkdir d0 0 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:9/18: dread - no filename 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:0/15: rmdir d1 39 2024-04-18T21:06:53.860 INFO:tasks.workunit.client.0.smithi096.stdout:8/2: rename d0 to d0/d1 22 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:6/15: symlink d1/l2 0 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:7/7: mkdir d0/d1 0 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:5/7: creat d2/f3 x:0 0 0 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:7/8: rename d0 to d0/d2 22 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:9/19: creat d0/f1 x:0 0 0 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/3: mknod d0/c2 0 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/4: fsync - no filename 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/5: write - no filename 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/6: fdatasync - no filename 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:5/8: symlink d2/l4 0 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:5/9: stat d2/f3 0 2024-04-18T21:06:53.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/7: mkdir d0/d3 0 2024-04-18T21:06:53.862 INFO:tasks.workunit.client.0.smithi096.stdout:9/20: write d0/f1 [845908,116165] 0 2024-04-18T21:06:53.862 INFO:tasks.workunit.client.0.smithi096.stdout:5/10: write d2/f3 [480274,65562] 0 2024-04-18T21:06:53.862 INFO:tasks.workunit.client.0.smithi096.stdout:8/8: creat d0/d3/f4 x:0 0 0 2024-04-18T21:06:53.863 INFO:tasks.workunit.client.0.smithi096.stdout:9/21: symlink d0/l2 0 2024-04-18T21:06:53.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/11: truncate d2/f3 770146 0 2024-04-18T21:06:53.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/12: creat d2/f5 x:0 0 0 2024-04-18T21:06:53.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/13: creat d2/f6 x:0 0 0 2024-04-18T21:06:53.863 INFO:tasks.workunit.client.0.smithi096.stdout:2/21: dread f1 [0,4194304] 0 2024-04-18T21:06:53.863 INFO:tasks.workunit.client.0.smithi096.stdout:2/22: chown f1 122 1 2024-04-18T21:06:53.863 INFO:tasks.workunit.client.0.smithi096.stdout:3/12: dwrite f0 [0,4194304] 0 2024-04-18T21:06:53.864 INFO:tasks.workunit.client.0.smithi096.stdout:2/23: creat f2 x:0 0 0 2024-04-18T21:06:53.864 INFO:tasks.workunit.client.0.smithi096.stdout:3/13: creat f2 x:0 0 0 2024-04-18T21:06:53.867 INFO:tasks.workunit.client.0.smithi096.stdout:3/14: symlink l3 0 2024-04-18T21:06:53.868 INFO:tasks.workunit.client.0.smithi096.stdout:8/9: fsync d0/d3/f4 0 2024-04-18T21:06:53.868 INFO:tasks.workunit.client.0.smithi096.stdout:9/22: truncate d0/f1 132337 0 2024-04-18T21:06:53.868 INFO:tasks.workunit.client.0.smithi096.stdout:3/15: mkdir d4 0 2024-04-18T21:06:53.868 INFO:tasks.workunit.client.0.smithi096.stdout:0/16: creat d1/f3 x:0 0 0 2024-04-18T21:06:53.869 INFO:tasks.workunit.client.0.smithi096.stdout:9/23: rename d0 to d0/d3 22 2024-04-18T21:06:53.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/16: fsync f1 0 2024-04-18T21:06:53.871 INFO:tasks.workunit.client.0.smithi096.stdout:0/17: write d1/f2 [450067,61656] 0 2024-04-18T21:06:53.871 INFO:tasks.workunit.client.0.smithi096.stdout:8/10: link d0/d3/f4 d0/d3/f5 0 2024-04-18T21:06:53.871 INFO:tasks.workunit.client.0.smithi096.stdout:5/14: dwrite d2/f3 [0,4194304] 0 2024-04-18T21:06:53.872 INFO:tasks.workunit.client.0.smithi096.stdout:0/18: truncate d1/f3 961639 0 2024-04-18T21:06:53.873 INFO:tasks.workunit.client.0.smithi096.stdout:0/19: readlink l0 0 2024-04-18T21:06:53.874 INFO:tasks.workunit.client.0.smithi096.stdout:5/15: creat d2/f7 x:0 0 0 2024-04-18T21:06:53.874 INFO:tasks.workunit.client.0.smithi096.stdout:0/20: mkdir d1/d4 0 2024-04-18T21:06:53.874 INFO:tasks.workunit.client.0.smithi096.stdout:8/11: creat d0/d3/f6 x:0 0 0 2024-04-18T21:06:53.876 INFO:tasks.workunit.client.0.smithi096.stdout:5/16: write f0 [335542,110480] 0 2024-04-18T21:06:53.876 INFO:tasks.workunit.client.0.smithi096.stdout:0/21: write d1/f3 [1669412,14016] 0 2024-04-18T21:06:53.876 INFO:tasks.workunit.client.0.smithi096.stdout:2/24: dwrite f1 [0,4194304] 0 2024-04-18T21:06:53.876 INFO:tasks.workunit.client.0.smithi096.stdout:8/12: fdatasync d0/d3/f5 0 2024-04-18T21:06:53.877 INFO:tasks.workunit.client.0.smithi096.stdout:5/17: write f0 [813715,124351] 0 2024-04-18T21:06:53.877 INFO:tasks.workunit.client.0.smithi096.stdout:0/22: creat d1/d4/f5 x:0 0 0 2024-04-18T21:06:53.878 INFO:tasks.workunit.client.0.smithi096.stdout:8/13: link d0/d3/f6 d0/f7 0 2024-04-18T21:06:53.878 INFO:tasks.workunit.client.0.smithi096.stdout:0/23: write d1/f3 [2546616,53775] 0 2024-04-18T21:06:53.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/17: dread f0 [0,4194304] 0 2024-04-18T21:06:53.879 INFO:tasks.workunit.client.0.smithi096.stdout:8/14: rename d0/f7 to d0/f8 0 2024-04-18T21:06:53.880 INFO:tasks.workunit.client.0.smithi096.stdout:8/15: symlink d0/l9 0 2024-04-18T21:06:53.884 INFO:tasks.workunit.client.0.smithi096.stdout:2/25: dread f1 [0,4194304] 0 2024-04-18T21:06:53.884 INFO:tasks.workunit.client.0.smithi096.stdout:8/16: dread - d0/d3/f4 zero size 2024-04-18T21:06:53.886 INFO:tasks.workunit.client.0.smithi096.stdout:2/26: read f1 [2728974,79132] 0 2024-04-18T21:06:53.886 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:53.887+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:53.893 INFO:tasks.workunit.client.0.smithi096.stdout:2/27: truncate f2 74300 0 2024-04-18T21:06:53.893 INFO:tasks.workunit.client.0.smithi096.stdout:2/28: rmdir - no directory 2024-04-18T21:06:53.894 INFO:tasks.workunit.client.0.smithi096.stdout:8/17: write d0/d3/f6 [995886,35118] 0 2024-04-18T21:06:53.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/29: chown f1 0 1 2024-04-18T21:06:53.896 INFO:tasks.workunit.client.0.smithi096.stdout:5/18: dwrite d2/f7 [0,4194304] 0 2024-04-18T21:06:53.898 INFO:tasks.workunit.client.0.smithi096.stdout:8/18: truncate d0/d3/f5 608744 0 2024-04-18T21:06:53.898 INFO:tasks.workunit.client.0.smithi096.stdout:9/24: dwrite d0/f1 [0,4194304] 0 2024-04-18T21:06:53.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/18: dwrite f2 [0,4194304] 0 2024-04-18T21:06:53.904 INFO:tasks.workunit.client.0.smithi096.stdout:2/30: mknod c3 0 2024-04-18T21:06:53.904 INFO:tasks.workunit.client.0.smithi096.stdout:8/19: symlink d0/la 0 2024-04-18T21:06:53.905 INFO:tasks.workunit.client.0.smithi096.stdout:3/19: rename f0 to d4/f5 0 2024-04-18T21:06:53.905 INFO:tasks.workunit.client.0.smithi096.stdout:2/31: mknod c4 0 2024-04-18T21:06:53.905 INFO:tasks.workunit.client.0.smithi096.stdout:8/20: mkdir d0/d3/db 0 2024-04-18T21:06:53.906 INFO:tasks.workunit.client.0.smithi096.stdout:9/25: getdents d0 0 2024-04-18T21:06:53.907 INFO:tasks.workunit.client.0.smithi096.stdout:2/32: write f1 [1945922,73858] 0 2024-04-18T21:06:53.907 INFO:tasks.workunit.client.0.smithi096.stdout:5/19: dwrite d2/f7 [0,4194304] 0 2024-04-18T21:06:53.908 INFO:tasks.workunit.client.0.smithi096.stdout:9/26: read d0/f1 [3960513,109940] 0 2024-04-18T21:06:53.908 INFO:tasks.workunit.client.0.smithi096.stdout:9/27: readlink d0/l2 0 2024-04-18T21:06:53.908 INFO:tasks.workunit.client.0.smithi096.stdout:2/33: mkdir d5 0 2024-04-18T21:06:53.909 INFO:tasks.workunit.client.0.smithi096.stdout:2/34: rmdir d5 0 2024-04-18T21:06:53.909 INFO:tasks.workunit.client.0.smithi096.stdout:9/28: rename d0/f1 to d0/f4 0 2024-04-18T21:06:53.912 INFO:tasks.workunit.client.0.smithi096.stdout:5/20: mknod d2/c8 0 2024-04-18T21:06:53.912 INFO:tasks.workunit.client.0.smithi096.stdout:9/29: creat d0/f5 x:0 0 0 2024-04-18T21:06:53.913 INFO:tasks.workunit.client.0.smithi096.stdout:5/21: read - d2/f6 zero size 2024-04-18T21:06:53.914 INFO:tasks.workunit.client.0.smithi096.stdout:5/22: creat d2/f9 x:0 0 0 2024-04-18T21:06:53.915 INFO:tasks.workunit.client.0.smithi096.stdout:5/23: mkdir d2/da 0 2024-04-18T21:06:53.916 INFO:tasks.workunit.client.0.smithi096.stdout:8/21: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:53.922 INFO:tasks.workunit.client.0.smithi096.stdout:9/30: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:53.923 INFO:tasks.workunit.client.0.smithi096.stdout:9/31: symlink d0/l6 0 2024-04-18T21:06:53.927 INFO:tasks.workunit.client.0.smithi096.stdout:8/22: dwrite d0/d3/f5 [0,4194304] 0 2024-04-18T21:06:53.929 INFO:tasks.workunit.client.0.smithi096.stdout:0/24: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:53.933 INFO:tasks.workunit.client.0.smithi096.stdout:9/32: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:53.934 INFO:tasks.workunit.client.0.smithi096.stdout:9/33: rename d0 to d0/d7 22 2024-04-18T21:06:53.935 INFO:tasks.workunit.client.0.smithi096.stdout:8/23: symlink d0/d3/lc 0 2024-04-18T21:06:53.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/25: dwrite d1/d4/f5 [0,4194304] 0 2024-04-18T21:06:53.943 INFO:tasks.workunit.client.0.smithi096.stdout:3/20: getdents d4 0 2024-04-18T21:06:53.943 INFO:tasks.workunit.client.0.smithi096.stdout:2/35: truncate f2 8033 0 2024-04-18T21:06:53.943 INFO:tasks.workunit.client.0.smithi096.stdout:9/34: mkdir d0/d8 0 2024-04-18T21:06:53.943 INFO:tasks.workunit.client.0.smithi096.stdout:8/24: creat d0/d3/fd x:0 0 0 2024-04-18T21:06:53.944 INFO:tasks.workunit.client.0.smithi096.stdout:3/21: dread f1 [0,4194304] 0 2024-04-18T21:06:53.944 INFO:tasks.workunit.client.0.smithi096.stdout:2/36: symlink l6 0 2024-04-18T21:06:53.945 INFO:tasks.workunit.client.0.smithi096.stdout:9/35: unlink d0/l2 0 2024-04-18T21:06:53.945 INFO:tasks.workunit.client.0.smithi096.stdout:8/25: truncate d0/d3/fd 261832 0 2024-04-18T21:06:53.945 INFO:tasks.workunit.client.0.smithi096.stdout:9/36: dread - d0/f5 zero size 2024-04-18T21:06:53.946 INFO:tasks.workunit.client.0.smithi096.stdout:3/22: rmdir d4 39 2024-04-18T21:06:53.946 INFO:tasks.workunit.client.0.smithi096.stdout:2/37: creat f7 x:0 0 0 2024-04-18T21:06:53.946 INFO:tasks.workunit.client.0.smithi096.stdout:3/23: chown d4 88 1 2024-04-18T21:06:53.947 INFO:tasks.workunit.client.0.smithi096.stdout:2/38: chown c4 807168398 1 2024-04-18T21:06:53.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/37: write d0/f5 [510650,125207] 0 2024-04-18T21:06:53.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/38: chown d0/d8 5309 1 2024-04-18T21:06:53.950 INFO:tasks.workunit.client.0.smithi096.stdout:0/26: dread d1/d4/f5 [0,4194304] 0 2024-04-18T21:06:53.957 INFO:tasks.workunit.client.0.smithi096.stdout:2/39: dwrite f1 [4194304,4194304] 0 2024-04-18T21:06:53.958 INFO:tasks.workunit.client.0.smithi096.stdout:3/24: dwrite d4/f5 [4194304,4194304] 0 2024-04-18T21:06:53.960 INFO:tasks.workunit.client.0.smithi096.stdout:2/40: mknod c8 0 2024-04-18T21:06:53.965 INFO:tasks.workunit.client.0.smithi096.stdout:8/26: dwrite d0/f8 [4194304,4194304] 0 2024-04-18T21:06:53.965 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:53.963+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:53.966 INFO:tasks.workunit.client.0.smithi096.stdout:9/39: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:53.967 INFO:tasks.workunit.client.0.smithi096.stdout:0/27: dwrite d1/f2 [0,4194304] 0 2024-04-18T21:06:53.970 INFO:tasks.workunit.client.0.smithi096.stdout:8/27: creat d0/fe x:0 0 0 2024-04-18T21:06:53.972 INFO:tasks.workunit.client.0.smithi096.stdout:8/28: chown d0/d3/f4 139489 1 2024-04-18T21:06:53.973 INFO:tasks.workunit.client.0.smithi096.stdout:3/25: dwrite f1 [0,4194304] 0 2024-04-18T21:06:53.973 INFO:tasks.workunit.client.0.smithi096.stdout:2/41: dwrite f1 [4194304,4194304] 0 2024-04-18T21:06:53.974 INFO:tasks.workunit.client.0.smithi096.stdout:3/26: mkdir d4/d6 0 2024-04-18T21:06:53.976 INFO:tasks.workunit.client.0.smithi096.stdout:2/42: rename c8 to c9 0 2024-04-18T21:06:53.977 INFO:tasks.workunit.client.0.smithi096.stdout:3/27: mkdir d4/d6/d7 0 2024-04-18T21:06:53.977 INFO:tasks.workunit.client.0.smithi096.stdout:2/43: fdatasync f7 0 2024-04-18T21:06:53.977 INFO:tasks.workunit.client.0.smithi096.stdout:3/28: unlink f1 0 2024-04-18T21:06:53.978 INFO:tasks.workunit.client.0.smithi096.stdout:3/29: chown f2 5167 1 2024-04-18T21:06:53.978 INFO:tasks.workunit.client.0.smithi096.stdout:2/44: fsync f2 0 2024-04-18T21:06:53.979 INFO:tasks.workunit.client.0.smithi096.stdout:2/45: dread - f7 zero size 2024-04-18T21:06:53.980 INFO:tasks.workunit.client.0.smithi096.stdout:3/30: write f2 [1578724,116468] 0 2024-04-18T21:06:53.980 INFO:tasks.workunit.client.0.smithi096.stdout:9/40: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:53.980 INFO:tasks.workunit.client.0.smithi096.stdout:8/29: dread d0/d3/f5 [0,4194304] 0 2024-04-18T21:06:53.981 INFO:tasks.workunit.client.0.smithi096.stdout:2/46: creat fa x:0 0 0 2024-04-18T21:06:53.981 INFO:tasks.workunit.client.0.smithi096.stdout:9/41: write d0/f4 [4146247,34369] 0 2024-04-18T21:06:53.983 INFO:tasks.workunit.client.0.smithi096.stdout:3/31: rmdir d4/d6 39 2024-04-18T21:06:53.984 INFO:tasks.workunit.client.0.smithi096.stdout:8/30: unlink d0/d3/lc 0 2024-04-18T21:06:53.984 INFO:tasks.workunit.client.0.smithi096.stdout:2/47: link fa fb 0 2024-04-18T21:06:53.984 INFO:tasks.workunit.client.0.smithi096.stdout:3/32: chown f2 6369 1 2024-04-18T21:06:53.984 INFO:tasks.workunit.client.0.smithi096.stdout:2/48: write f1 [1830439,41671] 0 2024-04-18T21:06:53.987 INFO:tasks.workunit.client.0.smithi096.stdout:2/49: write f1 [1629806,70209] 0 2024-04-18T21:06:53.988 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:53.988 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:53.988 INFO:tasks.workunit.client.0.smithi096.stdout:2/50: rename c3 to cc 0 2024-04-18T21:06:53.989 INFO:tasks.workunit.client.0.smithi096.stdout:2/51: stat fb 0 2024-04-18T21:06:53.989 INFO:tasks.workunit.client.0.smithi096.stdout:0/28: truncate d1/f2 328155 0 2024-04-18T21:06:53.991 INFO:tasks.workunit.client.0.smithi096.stdout:0/29: creat d1/d4/f6 x:0 0 0 2024-04-18T21:06:53.992 INFO:tasks.workunit.client.0.smithi096.stdout:8/31: dwrite d0/d3/f5 [0,4194304] 0 2024-04-18T21:06:53.993 INFO:tasks.workunit.client.0.smithi096.stdout:3/33: dwrite d4/f5 [4194304,4194304] 0 2024-04-18T21:06:53.993 INFO:tasks.workunit.client.0.smithi096.stdout:8/32: write d0/d3/f6 [3244710,77455] 0 2024-04-18T21:06:53.996 INFO:tasks.workunit.client.0.smithi096.stdout:8/33: symlink d0/d3/lf 0 2024-04-18T21:06:53.997 INFO:tasks.workunit.client.0.smithi096.stdout:8/34: creat d0/d3/f10 x:0 0 0 2024-04-18T21:06:53.997 INFO:tasks.workunit.client.0.smithi096.stdout:3/34: mkdir d4/d8 0 2024-04-18T21:06:53.998 INFO:tasks.workunit.client.0.smithi096.stdout:8/35: rmdir d0/d3 39 2024-04-18T21:06:53.999 INFO:tasks.workunit.client.0.smithi096.stdout:8/36: truncate d0/d3/fd 299952 0 2024-04-18T21:06:53.999 INFO:tasks.workunit.client.0.smithi096.stdout:0/30: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:54.000 INFO:tasks.workunit.client.0.smithi096.stdout:8/37: read d0/d3/f6 [5307621,12652] 0 2024-04-18T21:06:54.001 INFO:tasks.workunit.client.0.smithi096.stdout:0/31: write d1/f3 [1670040,50217] 0 2024-04-18T21:06:54.001 INFO:tasks.workunit.client.0.smithi096.stdout:2/52: getdents . 0 2024-04-18T21:06:54.001 INFO:tasks.workunit.client.0.smithi096.stdout:0/32: chown d1 4991187 1 2024-04-18T21:06:54.001 INFO:tasks.workunit.client.0.smithi096.stdout:2/53: creat fd x:0 0 0 2024-04-18T21:06:54.002 INFO:tasks.workunit.client.0.smithi096.stdout:0/33: chown d1/d4/f5 387102 1 2024-04-18T21:06:54.002 INFO:tasks.workunit.client.0.smithi096.stdout:2/54: creat fe x:0 0 0 2024-04-18T21:06:54.002 INFO:tasks.workunit.client.0.smithi096.stdout:3/35: dread d4/f5 [4194304,4194304] 0 2024-04-18T21:06:54.002 INFO:tasks.workunit.client.0.smithi096.stdout:0/34: rename d1/d4/f6 to d1/f7 0 2024-04-18T21:06:54.003 INFO:tasks.workunit.client.0.smithi096.stdout:0/35: chown d1/d4/f5 12825 1 2024-04-18T21:06:54.004 INFO:tasks.workunit.client.0.smithi096.stdout:3/36: creat d4/d8/f9 x:0 0 0 2024-04-18T21:06:54.004 INFO:tasks.workunit.client.0.smithi096.stdout:0/36: creat d1/d4/f8 x:0 0 0 2024-04-18T21:06:54.004 INFO:tasks.workunit.client.0.smithi096.stdout:3/37: write d4/d8/f9 [304810,95033] 0 2024-04-18T21:06:54.004 INFO:tasks.workunit.client.0.smithi096.stdout:0/37: creat d1/d4/f9 x:0 0 0 2024-04-18T21:06:54.005 INFO:tasks.workunit.client.0.smithi096.stdout:3/38: rmdir d4 39 2024-04-18T21:06:54.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/38: write d1/f3 [515812,53200] 0 2024-04-18T21:06:54.008 INFO:tasks.workunit.client.0.smithi096.stdout:3/39: truncate d4/f5 923260 0 2024-04-18T21:06:54.008 INFO:tasks.workunit.client.0.smithi096.stdout:8/38: truncate d0/f8 7599842 0 2024-04-18T21:06:54.009 INFO:tasks.workunit.client.0.smithi096.stdout:8/39: chown d0/d3/f4 97610144 1 2024-04-18T21:06:54.009 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:54.014 INFO:tasks.workunit.client.0.smithi096.stdout:2/55: write fa [145878,63518] 0 2024-04-18T21:06:54.015 INFO:tasks.workunit.client.0.smithi096.stdout:2/56: creat ff x:0 0 0 2024-04-18T21:06:54.015 INFO:tasks.workunit.client.0.smithi096.stdout:3/40: fsync d4/d8/f9 0 2024-04-18T21:06:54.016 INFO:tasks.workunit.client.0.smithi096.stdout:2/57: write f7 [702972,73923] 0 2024-04-18T21:06:54.016 INFO:tasks.workunit.client.0.smithi096.stdout:3/41: creat d4/d8/fa x:0 0 0 2024-04-18T21:06:54.017 INFO:tasks.workunit.client.0.smithi096.stdout:2/58: creat f10 x:0 0 0 2024-04-18T21:06:54.017 INFO:tasks.workunit.client.0.smithi096.stdout:3/42: creat d4/d8/fb x:0 0 0 2024-04-18T21:06:54.018 INFO:tasks.workunit.client.0.smithi096.stdout:3/43: read - d4/d8/fa zero size 2024-04-18T21:06:54.019 INFO:tasks.workunit.client.0.smithi096.stdout:3/44: truncate d4/d8/f9 619586 0 2024-04-18T21:06:54.019 INFO:tasks.workunit.client.0.smithi096.stdout:8/40: dwrite d0/f8 [4194304,4194304] 0 2024-04-18T21:06:54.020 INFO:tasks.workunit.client.0.smithi096.stdout:8/41: readlink d0/la 0 2024-04-18T21:06:54.021 INFO:tasks.workunit.client.0.smithi096.stdout:8/42: symlink d0/d3/db/l11 0 2024-04-18T21:06:54.021 INFO:tasks.workunit.client.0.smithi096.stdout:2/59: dread f1 [0,4194304] 0 2024-04-18T21:06:54.022 INFO:tasks.workunit.client.0.smithi096.stdout:2/60: truncate f7 1649497 0 2024-04-18T21:06:54.022 INFO:tasks.workunit.client.0.smithi096.stdout:2/61: fsync fb 0 2024-04-18T21:06:54.023 INFO:tasks.workunit.client.0.smithi096.stdout:2/62: stat fa 0 2024-04-18T21:06:54.023 INFO:tasks.workunit.client.0.smithi096.stdout:2/63: mkdir d11 0 2024-04-18T21:06:54.023 INFO:tasks.workunit.client.0.smithi096.stdout:2/64: dread - fe zero size 2024-04-18T21:06:54.026 INFO:tasks.workunit.client.0.smithi096.stdout:2/65: read fb [69154,12449] 0 2024-04-18T21:06:54.026 INFO:tasks.workunit.client.0.smithi096.stdout:2/66: truncate f2 721950 0 2024-04-18T21:06:54.027 INFO:tasks.workunit.client.0.smithi096.stdout:2/67: read f7 [829549,51235] 0 2024-04-18T21:06:54.028 INFO:tasks.workunit.client.0.smithi096.stdout:8/43: truncate d0/d3/f6 5721430 0 2024-04-18T21:06:54.028 INFO:tasks.workunit.client.0.smithi096.stdout:8/44: write d0/d3/f4 [283016,115475] 0 2024-04-18T21:06:54.029 INFO:tasks.workunit.client.0.smithi096.stdout:8/45: creat d0/f12 x:0 0 0 2024-04-18T21:06:54.030 INFO:tasks.workunit.client.0.smithi096.stdout:8/46: write d0/f12 [592797,97809] 0 2024-04-18T21:06:54.030 INFO:tasks.workunit.client.0.smithi096.stdout:8/47: fsync d0/d3/fd 0 2024-04-18T21:06:54.032 INFO:tasks.workunit.client.0.smithi096.stdout:8/48: truncate d0/f12 1516978 0 2024-04-18T21:06:54.032 INFO:tasks.workunit.client.0.smithi096.stdout:8/49: dread - d0/d3/f10 zero size 2024-04-18T21:06:54.033 INFO:tasks.workunit.client.0.smithi096.stdout:2/68: dwrite ff [0,4194304] 0 2024-04-18T21:06:54.033 INFO:tasks.workunit.client.0.smithi096.stdout:8/50: write d0/d3/fd [214419,82067] 0 2024-04-18T21:06:54.036 INFO:tasks.workunit.client.0.smithi096.stdout:8/51: creat d0/d3/db/f13 x:0 0 0 2024-04-18T21:06:54.036 INFO:tasks.workunit.client.0.smithi096.stdout:8/52: mkdir d0/d3/d14 0 2024-04-18T21:06:54.036 INFO:tasks.workunit.client.0.smithi096.stdout:2/69: dread ff [0,4194304] 0 2024-04-18T21:06:54.037 INFO:tasks.workunit.client.0.smithi096.stdout:2/70: mknod d11/c12 0 2024-04-18T21:06:54.037 INFO:tasks.workunit.client.0.smithi096.stdout:2/71: mkdir d11/d13 0 2024-04-18T21:06:54.039 INFO:tasks.workunit.client.0.smithi096.stdout:2/72: read fb [1129,95897] 0 2024-04-18T21:06:54.040 INFO:tasks.workunit.client.0.smithi096.stdout:2/73: chown d11/c12 56 1 2024-04-18T21:06:54.040 INFO:tasks.workunit.client.0.smithi096.stdout:2/74: mkdir d11/d14 0 2024-04-18T21:06:54.041 INFO:tasks.workunit.client.0.smithi096.stdout:2/75: rmdir d11/d14 0 2024-04-18T21:06:54.044 INFO:tasks.workunit.client.0.smithi096.stdout:8/53: dread d0/f12 [0,4194304] 0 2024-04-18T21:06:54.045 INFO:tasks.workunit.client.0.smithi096.stdout:2/76: truncate f1 5109086 0 2024-04-18T21:06:54.045 INFO:tasks.workunit.client.0.smithi096.stdout:8/54: fdatasync d0/d3/f6 0 2024-04-18T21:06:54.045 INFO:tasks.workunit.client.0.smithi096.stdout:2/77: creat d11/d13/f15 x:0 0 0 2024-04-18T21:06:54.046 INFO:tasks.workunit.client.0.smithi096.stdout:2/78: rename f7 to d11/f16 0 2024-04-18T21:06:54.047 INFO:tasks.workunit.client.0.smithi096.stdout:2/79: unlink f10 0 2024-04-18T21:06:54.047 INFO:tasks.workunit.client.0.smithi096.stdout:8/55: dread d0/f12 [0,4194304] 0 2024-04-18T21:06:54.047 INFO:tasks.workunit.client.0.smithi096.stdout:8/56: creat d0/d3/db/f15 x:0 0 0 2024-04-18T21:06:54.048 INFO:tasks.workunit.client.0.smithi096.stdout:8/57: read d0/d3/f5 [209406,97302] 0 2024-04-18T21:06:54.049 INFO:tasks.workunit.client.0.smithi096.stdout:8/58: mknod d0/c16 0 2024-04-18T21:06:54.049 INFO:tasks.workunit.client.0.smithi096.stdout:8/59: mknod d0/d3/c17 0 2024-04-18T21:06:54.050 INFO:tasks.workunit.client.0.smithi096.stdout:8/60: creat d0/d3/f18 x:0 0 0 2024-04-18T21:06:54.051 INFO:tasks.workunit.client.0.smithi096.stdout:8/61: dread - d0/fe zero size 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi096.stdout:8/62: write d0/d3/fd [113793,69604] 0 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi096.stdout:8/63: creat d0/d3/db/f19 x:0 0 0 2024-04-18T21:06:54.053 INFO:tasks.workunit.client.0.smithi096.stdout:2/80: dwrite fb [0,4194304] 0 2024-04-18T21:06:54.053 INFO:tasks.workunit.client.0.smithi096.stdout:2/81: stat f2 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi096.stdout:2/82: truncate fe 727902 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi096.stdout:8/64: link d0/c16 d0/d3/db/c1a 0 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi096.stdout:2/83: dwrite fb [4194304,4194304] 0 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi096.stdout:8/65: dwrite d0/d3/f18 [0,4194304] 0 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi096.stdout:2/84: fsync fe 0 2024-04-18T21:06:54.063 INFO:tasks.workunit.client.0.smithi096.stdout:8/66: mkdir d0/d3/d14/d1b 0 2024-04-18T21:06:54.066 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:54.067+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:54.068 INFO:tasks.workunit.client.0.smithi096.stdout:2/85: dwrite d11/d13/f15 [0,4194304] 0 2024-04-18T21:06:54.070 INFO:tasks.workunit.client.0.smithi096.stdout:8/67: getdents d0/d3/d14 0 2024-04-18T21:06:54.070 INFO:tasks.workunit.client.0.smithi096.stdout:2/86: fdatasync f1 0 2024-04-18T21:06:54.071 INFO:tasks.workunit.client.0.smithi096.stdout:2/87: fsync f1 0 2024-04-18T21:06:54.071 INFO:tasks.workunit.client.0.smithi096.stdout:8/68: link d0/la d0/d3/d14/d1b/l1c 0 2024-04-18T21:06:54.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/88: write fe [1524122,124986] 0 2024-04-18T21:06:54.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/89: stat fb 0 2024-04-18T21:06:54.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/90: getdents d11/d13 0 2024-04-18T21:06:54.143 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:54.143 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:54.156 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:54.167 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:54.167+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:54.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:54.270+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:54.277 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:54.277 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:54.293 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:54.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:54.366+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:54.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:54.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:54.474+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:54.561 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:54.561 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:54.571 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:54.571+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:54.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:54.672 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:54.669+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:54.735 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:54.735 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:54.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:54.773 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:54.773+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:54.814 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:06:54.872 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:54.872 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:54.874 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:54.875+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:54.886 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:54.975 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:54.975+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:55.033 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:55.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:55.074+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:55.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:55.174+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:55.202 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:55.203 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:55.217 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:55.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:55.278+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:55.341 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:55.341 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:55.355 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:55.401 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:55.401+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:55.479 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:55.477+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:55.484 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:55.485 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:55.499 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:55.585 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:55.585+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:55.663 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:55.663 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:55.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:55.681 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:55.678+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:55.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:55.778+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:55.818 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:55.844 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:55.844 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:55.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:55.883 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:55.883+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:55.974 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:55.974 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:55.984 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:55.983+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:55.994 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:55.995 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:56.002 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:56.002 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:56.002 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:06:56.002 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:56.015 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:56.015 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:56.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:56.085 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:56.087+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:56.147 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:56.148 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:56.148 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:56.148 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:56.148 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:56.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:56.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:56.210+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:56.286 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:56.285+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.703179175000001, 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:06:56.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.690314955, 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.304 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:06:56.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:56.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.689513484999999, 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:06:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:06:56.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:06:56.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:06:56.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:06:56.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.688739780000001, 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:56.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:06:56.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:06:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:06:56.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.681494216000001, 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:06:56.323 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:06:56.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:06:56.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:06:56.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.678427556000001, 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.660582851000001, 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:06:56.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:06:56.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:06:56.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.659743811, 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.343 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:06:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:06:56.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:06:56.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:06:56.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:06:56.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.655390131000001, 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:06:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:06:56.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:06:56.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:06:56.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.654621819000001, 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:06:56.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:06:56.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.651272215000001, 2024-04-18T21:06:56.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:06:56.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:06:56.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:06:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3101 4.39 4:9f88871f:::10000000f79.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.64357236, 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15377127199999999, 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3101 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651067+0000", 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651075+0000", 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0199999999999994e-06 2024-04-18T21:06:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651088+0000", 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125999999999999e-05 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651118+0000", 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0056000000000002e-05 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651133+0000", 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-05 2024-04-18T21:06:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651300+0000", 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016728000000000001 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651332+0000", 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1316000000000003e-05 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795393+0000", 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14406152699999999 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795615+0000", 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022176100000000001 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796175+0000", 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055999999999999995 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803891+0000", 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077157019999999996 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804661+0000", 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077030499999999999 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804756+0000", 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4893000000000001e-05 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804838+0000", 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2455999999999998e-05 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3102 4.a 4:51346ff1:::10000000f7a.00000000:head [write 0~2274] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.642698511000001, 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15630893400000001, 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3102 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651941+0000", 2024-04-18T21:06:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651943+0000", 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2239999999999998e-06 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651955+0000", 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.154e-05 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.651985+0000", 2024-04-18T21:06:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0212000000000001e-05 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652005+0000", 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0060000000000001e-05 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652155+0000", 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015061 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.652172+0000", 2024-04-18T21:06:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6699999999999999e-05 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795443+0000", 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.143270429 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.795698+0000", 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025559399999999999 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.796261+0000", 2024-04-18T21:06:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056251499999999998 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804465+0000", 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082038619999999993 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808068+0000", 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036032339999999999 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808163+0000", 2024-04-18T21:06:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4913000000000004e-05 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808250+0000", 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7040999999999996e-05 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.637796238, 2024-04-18T21:06:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:06:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:06:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:06:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:06:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3109 4.a 4:51362415:::10000000f81.00000000:head [write 0~549] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.636914962000001, 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15212483099999999, 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3109 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657724+0000", 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657726+0000", 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657737+0000", 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0413e-05 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657758+0000", 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1066000000000001e-05 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657770+0000", 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2037e-05 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657884+0000", 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657899+0000", 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4912999999999999e-05 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797739+0000", 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.139839608 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.797980+0000", 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024131000000000001 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.798495+0000", 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051529799999999997 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807863+0000", 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093672040000000005 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808270+0000", 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00040760200000000002 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809761+0000", 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001490805 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809849+0000", 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8244000000000004e-05 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.636142734, 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:06:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:06:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.633011965, 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:06:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:06:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:06:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.605699253999999, 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:06:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:06:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:06:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:06:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.604326828, 2024-04-18T21:06:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3147 4.c 4:30e7223c:::10000000faa.00000000:head [write 0~3847] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.600991594, 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.14405016200000001, 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3147 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693648+0000", 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693650+0000", 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.277e-06 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693684+0000", 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4003e-05 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693716+0000", 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2212999999999998e-05 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693731+0000", 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4525999999999999e-05 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693864+0000", 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013289399999999999 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.693878+0000", 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.455e-05 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831460+0000", 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.137582329 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831586+0000", 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542900000000001 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831762+0000", 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017588599999999999 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.833477+0000", 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001715563 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837579+0000", 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041016389999999998 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837638+0000", 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9249999999999997e-05 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837698+0000", 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9602999999999998e-05 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:56.428 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:56.429 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:56.430 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:56.425+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:56.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:56.526+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:56.561 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:56.561 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:56.561 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:06:56.561 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:56.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:56.630 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:56.629+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:56.704 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:56.704 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:06:56.704 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:06:56.704 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:06:56.704 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:9/42: sync 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:1/11: sync 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:1/12: dwrite - no filename 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:5/24: sync 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:4/9: sync 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:3/45: sync 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:8/69: sync 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi096.stdout:7/9: sync 2024-04-18T21:06:56.716 INFO:tasks.workunit.client.0.smithi096.stdout:7/10: fsync - no filename 2024-04-18T21:06:56.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/16: sync 2024-04-18T21:06:56.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/17: fsync - no filename 2024-04-18T21:06:56.716 INFO:tasks.workunit.client.0.smithi096.stdout:0/39: sync 2024-04-18T21:06:56.716 INFO:tasks.workunit.client.0.smithi096.stdout:2/91: sync 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:1/13: chown . 200580228 1 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:0/40: chown d1/d4 59708 1 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:6/18: chown d1 1986770761 1 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:7/11: chown d0/d1 358628 1 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:7/12: unlink - no file 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:4/10: mkdir d2 0 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:4/11: readlink - no filename 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:7/13: rename d0 to d0/d3 22 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:7/14: write - no filename 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi096.stdout:7/15: fsync - no filename 2024-04-18T21:06:56.718 INFO:tasks.workunit.client.0.smithi096.stdout:4/12: read - f1 zero size 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:8/70: mkdir d0/d3/d1d 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:0/41: chown d1/f3 288 1 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:1/14: mkdir d0 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:1/15: write - no filename 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:4/13: chown d2 3275054 1 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:5/25: creat d2/da/fb x:0 0 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:9/43: mkdir d0/d8/d9 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:9/44: readlink d0/l6 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:4/14: write f0 [679778,54306] 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:9/45: fsync d0/f4 0 2024-04-18T21:06:56.721 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi096.stdout:3/46: link l3 d4/d6/d7/lc 0 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi096.stdout:5/26: read f0 [236190,45933] 0 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi096.stdout:1/16: mknod d0/c1 0 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi096.stdout:1/17: write - no filename 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:9/46: write d0/f5 [3606098,112113] 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:0/42: getdents d1 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:4/15: symlink d2/l3 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:3/47: mkdir d4/d6/dd 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:4/16: chown f1 19551003 1 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:1/18: symlink d0/l2 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:8/71: link d0/d3/d14/d1b/l1c d0/d3/l1e 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:9/47: write d0/f4 [4077752,74042] 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:1/19: mkdir d0/d3 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:3/48: readlink d4/d6/d7/lc 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:5/27: link d2/f3 d2/fc 0 2024-04-18T21:06:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:8/72: stat d0/fe 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:4/17: fdatasync f0 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:9/48: mknod d0/d8/ca 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:4/18: write f1 [117354,115337] 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/20: rmdir d0/d3 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:8/73: write d0/d3/db/f19 [356174,10571] 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:9/49: mknod d0/d8/cb 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:5/28: write d2/f3 [970492,84634] 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:9/50: stat d0/f5 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:4/19: mknod d2/c4 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:3/49: creat d4/fe x:0 0 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:5/29: rename d2/fc to d2/fd 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:9/51: chown d0/d8/cb 443763 1 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:4/20: write f1 [247600,945] 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:8/74: creat d0/d3/d14/d1b/f1f x:0 0 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:3/50: rename f2 to d4/d8/ff 0 2024-04-18T21:06:56.728 INFO:tasks.workunit.client.0.smithi096.stdout:9/52: fdatasync d0/f4 0 2024-04-18T21:06:56.728 INFO:tasks.workunit.client.0.smithi096.stdout:5/30: creat d2/da/fe x:0 0 0 2024-04-18T21:06:56.728 INFO:tasks.workunit.client.0.smithi096.stdout:4/21: write f0 [1225268,9474] 0 2024-04-18T21:06:56.728 INFO:tasks.workunit.client.0.smithi096.stdout:8/75: creat d0/d3/d14/d1b/f20 x:0 0 0 2024-04-18T21:06:56.729 INFO:tasks.workunit.client.0.smithi096.stdout:3/51: creat d4/d6/d7/f10 x:0 0 0 2024-04-18T21:06:56.729 INFO:tasks.workunit.client.0.smithi096.stdout:4/22: creat d2/f5 x:0 0 0 2024-04-18T21:06:56.730 INFO:tasks.workunit.client.0.smithi096.stdout:8/76: read - d0/d3/f10 zero size 2024-04-18T21:06:56.730 INFO:tasks.workunit.client.0.smithi096.stdout:4/23: readlink d2/l3 0 2024-04-18T21:06:56.730 INFO:tasks.workunit.client.0.smithi096.stdout:8/77: chown d0 38414558 1 2024-04-18T21:06:56.731 INFO:tasks.workunit.client.0.smithi096.stdout:5/31: write d2/fd [1229007,32494] 0 2024-04-18T21:06:56.731 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:56.729+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi096.stdout:4/24: creat d2/f6 x:0 0 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi096.stdout:3/52: truncate d4/d8/f9 695253 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi096.stdout:5/32: symlink d2/lf 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi096.stdout:0/43: dwrite d1/d4/f9 [0,4194304] 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi096.stdout:3/53: dread - d4/d8/fa zero size 2024-04-18T21:06:56.734 INFO:tasks.workunit.client.0.smithi096.stdout:9/53: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:56.735 INFO:tasks.workunit.client.0.smithi096.stdout:5/33: creat d2/f10 x:0 0 0 2024-04-18T21:06:56.735 INFO:tasks.workunit.client.0.smithi096.stdout:9/54: mkdir d0/dc 0 2024-04-18T21:06:56.735 INFO:tasks.workunit.client.0.smithi096.stdout:0/44: creat d1/d4/fa x:0 0 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi096.stdout:5/34: fdatasync d2/f9 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi096.stdout:9/55: stat d0/d8/ca 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi096.stdout:8/78: getdents d0/d3/db 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi096.stdout:0/45: mkdir d1/db 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi096.stdout:9/56: truncate d0/f4 4194312 0 2024-04-18T21:06:56.737 INFO:tasks.workunit.client.0.smithi096.stdout:0/46: dread - d1/f7 zero size 2024-04-18T21:06:56.737 INFO:tasks.workunit.client.0.smithi096.stdout:8/79: mknod d0/d3/c21 0 2024-04-18T21:06:56.737 INFO:tasks.workunit.client.0.smithi096.stdout:0/47: symlink d1/lc 0 2024-04-18T21:06:56.737 INFO:tasks.workunit.client.0.smithi096.stdout:3/54: dread d4/d8/ff [0,4194304] 0 2024-04-18T21:06:56.738 INFO:tasks.workunit.client.0.smithi096.stdout:0/48: rmdir d1/d4 39 2024-04-18T21:06:56.738 INFO:tasks.workunit.client.0.smithi096.stdout:3/55: mkdir d4/d6/dd/d11 0 2024-04-18T21:06:56.740 INFO:tasks.workunit.client.0.smithi096.stdout:3/56: write d4/d8/ff [4746807,36383] 0 2024-04-18T21:06:56.745 INFO:tasks.workunit.client.0.smithi096.stdout:9/57: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:56.746 INFO:tasks.workunit.client.0.smithi096.stdout:9/58: fsync d0/f5 0 2024-04-18T21:06:56.747 INFO:tasks.workunit.client.0.smithi096.stdout:0/49: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:56.747 INFO:tasks.workunit.client.0.smithi096.stdout:9/59: write d0/f5 [1146793,61754] 0 2024-04-18T21:06:56.751 INFO:tasks.workunit.client.0.smithi096.stdout:9/60: symlink d0/ld 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi096.stdout:2/92: truncate fb 1401171 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi096.stdout:8/80: getdents d0/d3/d14/d1b 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi096.stdout:4/25: getdents d2 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi096.stdout:0/50: creat d1/d4/fd x:0 0 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi096.stdout:3/57: truncate d4/d8/ff 1469996 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi096.stdout:9/61: mkdir d0/dc/de 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi096.stdout:6/19: creat d1/f3 x:0 0 0 2024-04-18T21:06:56.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/26: truncate d2/f6 307893 0 2024-04-18T21:06:56.762 INFO:tasks.workunit.client.0.smithi096.stdout:8/81: truncate d0/fe 413350 0 2024-04-18T21:06:56.762 INFO:tasks.workunit.client.0.smithi096.stdout:0/51: creat d1/d4/fe x:0 0 0 2024-04-18T21:06:56.762 INFO:tasks.workunit.client.0.smithi096.stdout:3/58: mknod d4/d8/c12 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi096.stdout:9/62: mknod d0/dc/cf 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/20: write d1/f3 [692200,100878] 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi096.stdout:8/82: chown d0 9286 1 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi096.stdout:4/27: write f0 [1105858,39635] 0 2024-04-18T21:06:56.764 INFO:tasks.workunit.client.0.smithi096.stdout:4/28: dread - d2/f5 zero size 2024-04-18T21:06:56.764 INFO:tasks.workunit.client.0.smithi096.stdout:3/59: write d4/d8/fa [705470,6815] 0 2024-04-18T21:06:56.764 INFO:tasks.workunit.client.0.smithi096.stdout:8/83: mknod d0/d3/d1d/c22 0 2024-04-18T21:06:56.764 INFO:tasks.workunit.client.0.smithi096.stdout:9/63: mknod d0/dc/de/c10 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:3/60: read - d4/d6/d7/f10 zero size 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:4/29: mkdir d2/d7 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:4/30: write d2/f5 [338228,22407] 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:8/84: rename d0/d3/db/f19 to d0/d3/f23 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:3/61: write d4/d8/f9 [1702464,92580] 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:4/31: stat d2/c4 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:8/85: creat d0/d3/d1d/f24 x:0 0 0 2024-04-18T21:06:56.766 INFO:tasks.workunit.client.0.smithi096.stdout:3/62: creat d4/d6/dd/f13 x:0 0 0 2024-04-18T21:06:56.766 INFO:tasks.workunit.client.0.smithi096.stdout:3/63: fdatasync d4/d8/ff 0 2024-04-18T21:06:56.766 INFO:tasks.workunit.client.0.smithi096.stdout:8/86: rename d0/d3/f10 to d0/d3/d14/d1b/f25 0 2024-04-18T21:06:56.767 INFO:tasks.workunit.client.0.smithi096.stdout:4/32: read f0 [248595,45690] 0 2024-04-18T21:06:56.768 INFO:tasks.workunit.client.0.smithi096.stdout:8/87: symlink d0/l26 0 2024-04-18T21:06:56.769 INFO:tasks.workunit.client.0.smithi096.stdout:0/52: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:56.770 INFO:tasks.workunit.client.0.smithi096.stdout:0/53: chown l0 846 1 2024-04-18T21:06:56.770 INFO:tasks.workunit.client.0.smithi096.stdout:9/64: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.773 INFO:tasks.workunit.client.0.smithi096.stdout:0/54: creat d1/d4/ff x:0 0 0 2024-04-18T21:06:56.773 INFO:tasks.workunit.client.0.smithi096.stdout:6/21: fsync d1/f3 0 2024-04-18T21:06:56.773 INFO:tasks.workunit.client.0.smithi096.stdout:2/93: write d11/f16 [2012805,43451] 0 2024-04-18T21:06:56.774 INFO:tasks.workunit.client.0.smithi096.stdout:9/65: rename d0/dc/de to d0/d8/d11 0 2024-04-18T21:06:56.774 INFO:tasks.workunit.client.0.smithi096.stdout:0/55: unlink d1/f7 0 2024-04-18T21:06:56.774 INFO:tasks.workunit.client.0.smithi096.stdout:6/22: chown d1/f3 1835533339 1 2024-04-18T21:06:56.775 INFO:tasks.workunit.client.0.smithi096.stdout:6/23: chown d1/f3 15599341 1 2024-04-18T21:06:56.775 INFO:tasks.workunit.client.0.smithi096.stdout:3/64: dwrite d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:56.775 INFO:tasks.workunit.client.0.smithi096.stdout:3/65: read - d4/d6/d7/f10 zero size 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/24: truncate d1/f3 1571731 0 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/25: fsync d1/f3 0 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi096.stdout:3/66: write d4/d6/d7/f10 [999089,103075] 0 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/26: creat d1/f4 x:0 0 0 2024-04-18T21:06:56.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/67: getdents d4/d6/d7 0 2024-04-18T21:06:56.779 INFO:tasks.workunit.client.0.smithi096.stdout:3/68: dread d4/f5 [0,4194304] 0 2024-04-18T21:06:56.781 INFO:tasks.workunit.client.0.smithi096.stdout:0/56: fsync d1/d4/ff 0 2024-04-18T21:06:56.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/66: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.783 INFO:tasks.workunit.client.0.smithi096.stdout:0/57: unlink d1/d4/ff 0 2024-04-18T21:06:56.784 INFO:tasks.workunit.client.0.smithi096.stdout:0/58: creat d1/db/f10 x:0 0 0 2024-04-18T21:06:56.785 INFO:tasks.workunit.client.0.smithi096.stdout:0/59: rename d1/d4/f8 to d1/d4/f11 0 2024-04-18T21:06:56.785 INFO:tasks.workunit.client.0.smithi096.stdout:0/60: stat d1/d4/f9 0 2024-04-18T21:06:56.786 INFO:tasks.workunit.client.0.smithi096.stdout:0/61: truncate d1/d4/fe 833883 0 2024-04-18T21:06:56.787 INFO:tasks.workunit.client.0.smithi096.stdout:0/62: creat d1/f12 x:0 0 0 2024-04-18T21:06:56.788 INFO:tasks.workunit.client.0.smithi096.stdout:9/67: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:56.789 INFO:tasks.workunit.client.0.smithi096.stdout:6/27: getdents d1 0 2024-04-18T21:06:56.790 INFO:tasks.workunit.client.0.smithi096.stdout:6/28: mkdir d1/d5 0 2024-04-18T21:06:56.790 INFO:tasks.workunit.client.0.smithi096.stdout:6/29: dread - d1/f4 zero size 2024-04-18T21:06:56.791 INFO:tasks.workunit.client.0.smithi096.stdout:6/30: mkdir d1/d6 0 2024-04-18T21:06:56.792 INFO:tasks.workunit.client.0.smithi096.stdout:6/31: mkdir d1/d5/d7 0 2024-04-18T21:06:56.792 INFO:tasks.workunit.client.0.smithi096.stdout:6/32: write d1/f4 [614397,80951] 0 2024-04-18T21:06:56.794 INFO:tasks.workunit.client.0.smithi096.stdout:4/33: dread f0 [0,4194304] 0 2024-04-18T21:06:56.795 INFO:tasks.workunit.client.0.smithi096.stdout:4/34: chown d2/f6 1819496052 1 2024-04-18T21:06:56.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/68: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/69: chown d0/d8 121 1 2024-04-18T21:06:56.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/70: readlink d0/ld 0 2024-04-18T21:06:56.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/71: write d0/f5 [108933,36747] 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi096.stdout:4/35: creat d2/f8 x:0 0 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi096.stdout:9/72: chown d0/d8/ca 112882686 1 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi096.stdout:4/36: dread - d2/f8 zero size 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi096.stdout:4/37: fsync d2/f5 0 2024-04-18T21:06:56.798 INFO:tasks.workunit.client.0.smithi096.stdout:9/73: link d0/f5 d0/d8/d11/f12 0 2024-04-18T21:06:56.798 INFO:tasks.workunit.client.0.smithi096.stdout:9/74: chown d0/d8 8054 1 2024-04-18T21:06:56.799 INFO:tasks.workunit.client.0.smithi096.stdout:9/75: mknod d0/d8/d9/c13 0 2024-04-18T21:06:56.799 INFO:tasks.workunit.client.0.smithi096.stdout:0/63: getdents d1 0 2024-04-18T21:06:56.800 INFO:tasks.workunit.client.0.smithi096.stdout:2/94: write fa [759624,123648] 0 2024-04-18T21:06:56.800 INFO:tasks.workunit.client.0.smithi096.stdout:0/64: rmdir d1/d4 39 2024-04-18T21:06:56.800 INFO:tasks.workunit.client.0.smithi096.stdout:2/95: mknod d11/c17 0 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi096.stdout:2/96: truncate fe 2308235 0 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi096.stdout:0/65: unlink d1/d4/f11 0 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi096.stdout:2/97: fdatasync f2 0 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi096.stdout:0/66: dread - d1/d4/fd zero size 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi096.stdout:0/67: readlink l0 0 2024-04-18T21:06:56.803 INFO:tasks.workunit.client.0.smithi096.stdout:0/68: mkdir d1/db/d13 0 2024-04-18T21:06:56.803 INFO:tasks.workunit.client.0.smithi096.stdout:2/98: dread fa [0,4194304] 0 2024-04-18T21:06:56.804 INFO:tasks.workunit.client.0.smithi096.stdout:2/99: read d11/d13/f15 [2573154,69171] 0 2024-04-18T21:06:56.804 INFO:tasks.workunit.client.0.smithi096.stdout:0/69: rename d1/db/f10 to d1/db/f14 0 2024-04-18T21:06:56.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/100: chown d11/f16 12165 1 2024-04-18T21:06:56.806 INFO:tasks.workunit.client.0.smithi096.stdout:0/70: dread d1/f2 [0,4194304] 0 2024-04-18T21:06:56.807 INFO:tasks.workunit.client.0.smithi096.stdout:9/76: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.808 INFO:tasks.workunit.client.0.smithi096.stdout:9/77: read d0/f4 [1779060,81594] 0 2024-04-18T21:06:56.809 INFO:tasks.workunit.client.0.smithi096.stdout:9/78: chown d0/dc/cf 0 1 2024-04-18T21:06:56.809 INFO:tasks.workunit.client.0.smithi096.stdout:0/71: creat d1/f15 x:0 0 0 2024-04-18T21:06:56.810 INFO:tasks.workunit.client.0.smithi096.stdout:9/79: symlink d0/d8/d11/l14 0 2024-04-18T21:06:56.812 INFO:tasks.workunit.client.0.smithi096.stdout:0/72: creat d1/d4/f16 x:0 0 0 2024-04-18T21:06:56.812 INFO:tasks.workunit.client.0.smithi096.stdout:6/33: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:56.812 INFO:tasks.workunit.client.0.smithi096.stdout:9/80: link d0/ld d0/l15 0 2024-04-18T21:06:56.813 INFO:tasks.workunit.client.0.smithi096.stdout:6/34: symlink d1/l8 0 2024-04-18T21:06:56.813 INFO:tasks.workunit.client.0.smithi096.stdout:9/81: mkdir d0/d8/d16 0 2024-04-18T21:06:56.814 INFO:tasks.workunit.client.0.smithi096.stdout:0/73: rmdir d1/db/d13 0 2024-04-18T21:06:56.814 INFO:tasks.workunit.client.0.smithi096.stdout:2/101: dwrite d11/f16 [0,4194304] 0 2024-04-18T21:06:56.814 INFO:tasks.workunit.client.0.smithi096.stdout:0/74: fdatasync d1/f3 0 2024-04-18T21:06:56.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/102: link fb d11/f18 0 2024-04-18T21:06:56.815 INFO:tasks.workunit.client.0.smithi096.stdout:0/75: rmdir d1 39 2024-04-18T21:06:56.815 INFO:tasks.workunit.client.0.smithi096.stdout:4/38: dread d2/f5 [0,4194304] 0 2024-04-18T21:06:56.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/103: write fd [15555,27898] 0 2024-04-18T21:06:56.816 INFO:tasks.workunit.client.0.smithi096.stdout:0/76: symlink d1/l17 0 2024-04-18T21:06:56.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/104: truncate fb 2076440 0 2024-04-18T21:06:56.817 INFO:tasks.workunit.client.0.smithi096.stdout:4/39: creat d2/f9 x:0 0 0 2024-04-18T21:06:56.817 INFO:tasks.workunit.client.0.smithi096.stdout:4/40: readlink d2/l3 0 2024-04-18T21:06:56.820 INFO:tasks.workunit.client.0.smithi096.stdout:4/41: dread f0 [0,4194304] 0 2024-04-18T21:06:56.822 INFO:tasks.workunit.client.0.smithi096.stdout:6/35: dwrite d1/f4 [0,4194304] 0 2024-04-18T21:06:56.822 INFO:tasks.workunit.client.0.smithi096.stdout:4/42: mknod d2/d7/ca 0 2024-04-18T21:06:56.823 INFO:tasks.workunit.client.0.smithi096.stdout:0/77: getdents d1/d4 0 2024-04-18T21:06:56.823 INFO:tasks.workunit.client.0.smithi096.stdout:9/82: dwrite d0/d8/d11/f12 [4194304,4194304] 0 2024-04-18T21:06:56.824 INFO:tasks.workunit.client.0.smithi096.stdout:4/43: truncate d2/f9 798578 0 2024-04-18T21:06:56.825 INFO:tasks.workunit.client.0.smithi096.stdout:6/36: creat d1/d6/f9 x:0 0 0 2024-04-18T21:06:56.825 INFO:tasks.workunit.client.0.smithi096.stdout:9/83: creat d0/d8/d16/f17 x:0 0 0 2024-04-18T21:06:56.826 INFO:tasks.workunit.client.0.smithi096.stdout:2/105: dwrite fd [0,4194304] 0 2024-04-18T21:06:56.827 INFO:tasks.workunit.client.0.smithi096.stdout:4/44: rename d2/f6 to d2/d7/fb 0 2024-04-18T21:06:56.827 INFO:tasks.workunit.client.0.smithi096.stdout:6/37: mkdir d1/d5/da 0 2024-04-18T21:06:56.827 INFO:tasks.workunit.client.0.smithi096.stdout:9/84: dread - d0/d8/d16/f17 zero size 2024-04-18T21:06:56.827 INFO:tasks.workunit.client.0.smithi096.stdout:2/106: unlink fd 0 2024-04-18T21:06:56.827 INFO:tasks.workunit.client.0.smithi096.stdout:9/85: mkdir d0/dc/d18 0 2024-04-18T21:06:56.827 INFO:tasks.workunit.client.0.smithi096.stdout:6/38: write d1/f3 [1088560,14252] 0 2024-04-18T21:06:56.827 INFO:tasks.workunit.client.0.smithi096.stdout:2/107: rmdir d11/d13 39 2024-04-18T21:06:56.828 INFO:tasks.workunit.client.0.smithi096.stdout:9/86: fdatasync d0/f4 0 2024-04-18T21:06:56.830 INFO:tasks.workunit.client.0.smithi096.stdout:6/39: link d1/f3 d1/d5/d7/fb 0 2024-04-18T21:06:56.830 INFO:tasks.workunit.client.0.smithi096.stdout:9/87: creat d0/d8/d11/f19 x:0 0 0 2024-04-18T21:06:56.831 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:56.829+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:56.831 INFO:tasks.workunit.client.0.smithi096.stdout:6/40: chown d1/d5/d7 1 1 2024-04-18T21:06:56.832 INFO:tasks.workunit.client.0.smithi096.stdout:2/108: rename fa to d11/f19 0 2024-04-18T21:06:56.832 INFO:tasks.workunit.client.0.smithi096.stdout:6/41: chown d1/d5 43 1 2024-04-18T21:06:56.832 INFO:tasks.workunit.client.0.smithi096.stdout:9/88: rename d0 to d0/d8/d11/d1a 22 2024-04-18T21:06:56.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/109: mkdir d11/d13/d1a 0 2024-04-18T21:06:56.834 INFO:tasks.workunit.client.0.smithi096.stdout:0/78: dwrite d1/f12 [0,4194304] 0 2024-04-18T21:06:56.837 INFO:tasks.workunit.client.0.smithi096.stdout:4/45: dwrite d2/d7/fb [0,4194304] 0 2024-04-18T21:06:56.837 INFO:tasks.workunit.client.0.smithi096.stdout:9/89: mknod d0/dc/d18/c1b 0 2024-04-18T21:06:56.838 INFO:tasks.workunit.client.0.smithi096.stdout:0/79: symlink d1/db/l18 0 2024-04-18T21:06:56.838 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:56.839 INFO:tasks.workunit.client.0.smithi096.stdout:0/80: fdatasync d1/d4/f5 0 2024-04-18T21:06:56.840 INFO:tasks.workunit.client.0.smithi096.stdout:0/81: truncate d1/f3 2052938 0 2024-04-18T21:06:56.841 INFO:tasks.workunit.client.0.smithi096.stdout:0/82: symlink d1/l19 0 2024-04-18T21:06:56.845 INFO:tasks.workunit.client.0.smithi096.stdout:9/90: dwrite d0/d8/d16/f17 [0,4194304] 0 2024-04-18T21:06:56.847 INFO:tasks.workunit.client.0.smithi096.stdout:9/91: creat d0/d8/f1c x:0 0 0 2024-04-18T21:06:56.849 INFO:tasks.workunit.client.0.smithi096.stdout:9/92: unlink d0/d8/d11/l14 0 2024-04-18T21:06:56.849 INFO:tasks.workunit.client.0.smithi096.stdout:6/42: truncate d1/f4 2981562 0 2024-04-18T21:06:56.849 INFO:tasks.workunit.client.0.smithi096.stdout:2/110: truncate d11/f18 915033 0 2024-04-18T21:06:56.849 INFO:tasks.workunit.client.0.smithi096.stdout:4/46: truncate d2/d7/fb 2120693 0 2024-04-18T21:06:56.849 INFO:tasks.workunit.client.0.smithi096.stdout:6/43: readlink d1/l8 0 2024-04-18T21:06:56.850 INFO:tasks.workunit.client.0.smithi096.stdout:0/83: getdents d1 0 2024-04-18T21:06:56.850 INFO:tasks.workunit.client.0.smithi096.stdout:9/93: mknod d0/dc/d18/c1d 0 2024-04-18T21:06:56.850 INFO:tasks.workunit.client.0.smithi096.stdout:6/44: read d1/f3 [1270557,66000] 0 2024-04-18T21:06:56.850 INFO:tasks.workunit.client.0.smithi096.stdout:0/84: dread - d1/db/f14 zero size 2024-04-18T21:06:56.851 INFO:tasks.workunit.client.0.smithi096.stdout:9/94: chown d0/d8/d11/f19 3254730 1 2024-04-18T21:06:56.851 INFO:tasks.workunit.client.0.smithi096.stdout:4/47: getdents d2 0 2024-04-18T21:06:56.851 INFO:tasks.workunit.client.0.smithi096.stdout:0/85: symlink d1/d4/l1a 0 2024-04-18T21:06:56.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/48: creat d2/fc x:0 0 0 2024-04-18T21:06:56.852 INFO:tasks.workunit.client.0.smithi096.stdout:9/95: unlink d0/d8/d11/c10 0 2024-04-18T21:06:56.852 INFO:tasks.workunit.client.0.smithi096.stdout:0/86: creat d1/db/f1b x:0 0 0 2024-04-18T21:06:56.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/49: creat d2/fd x:0 0 0 2024-04-18T21:06:56.852 INFO:tasks.workunit.client.0.smithi096.stdout:0/87: fsync d1/f3 0 2024-04-18T21:06:56.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/50: creat d2/d7/fe x:0 0 0 2024-04-18T21:06:56.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/51: mknod d2/d7/cf 0 2024-04-18T21:06:56.860 INFO:tasks.workunit.client.0.smithi096.stdout:2/111: write f1 [5149752,16190] 0 2024-04-18T21:06:56.860 INFO:tasks.workunit.client.0.smithi096.stdout:9/96: dwrite d0/d8/d16/f17 [4194304,4194304] 0 2024-04-18T21:06:56.861 INFO:tasks.workunit.client.0.smithi096.stdout:4/52: getdents d2 0 2024-04-18T21:06:56.861 INFO:tasks.workunit.client.0.smithi096.stdout:0/88: dwrite d1/d4/f16 [0,4194304] 0 2024-04-18T21:06:56.861 INFO:tasks.workunit.client.0.smithi096.stdout:4/53: dread - d2/fd zero size 2024-04-18T21:06:56.862 INFO:tasks.workunit.client.0.smithi096.stdout:4/54: chown f1 14185 1 2024-04-18T21:06:56.863 INFO:tasks.workunit.client.0.smithi096.stdout:4/55: write d2/f9 [800095,88691] 0 2024-04-18T21:06:56.864 INFO:tasks.workunit.client.0.smithi096.stdout:9/97: write d0/f5 [4048473,48760] 0 2024-04-18T21:06:56.865 INFO:tasks.workunit.client.0.smithi096.stdout:0/89: mkdir d1/d1c 0 2024-04-18T21:06:56.865 INFO:tasks.workunit.client.0.smithi096.stdout:9/98: dread - d0/d8/d11/f19 zero size 2024-04-18T21:06:56.865 INFO:tasks.workunit.client.0.smithi096.stdout:4/56: symlink d2/l10 0 2024-04-18T21:06:56.865 INFO:tasks.workunit.client.0.smithi096.stdout:4/57: write d2/f8 [43675,119992] 0 2024-04-18T21:06:56.866 INFO:tasks.workunit.client.0.smithi096.stdout:0/90: write d1/d4/fa [401235,82623] 0 2024-04-18T21:06:56.866 INFO:tasks.workunit.client.0.smithi096.stdout:4/58: readlink d2/l10 0 2024-04-18T21:06:56.866 INFO:tasks.workunit.client.0.smithi096.stdout:9/99: mknod d0/d8/d9/c1e 0 2024-04-18T21:06:56.867 INFO:tasks.workunit.client.0.smithi096.stdout:9/100: chown d0/d8/ca 18663696 1 2024-04-18T21:06:56.867 INFO:tasks.workunit.client.0.smithi096.stdout:0/91: fsync d1/d4/f5 0 2024-04-18T21:06:56.868 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:06:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.258917517, 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:06:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:06:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.255408260999999, 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:06:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.242215058999999, 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:06:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.225027855, 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:06:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.221613741000001, 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:06:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:06:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.220760225999999, 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:06:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:06:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.218223544000001, 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.203491328, 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:06:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:06:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:06:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:06:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.201031497000001, 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:06:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.195112471, 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:06:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:06:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.188383577, 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:06:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:06:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:06:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:06:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.133701528, 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:06:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:06:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:06:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.104115074999999, 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:06:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:06:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:06:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:06:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.092930945999999, 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:06:56.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:06:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:56.958 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:56.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.092636754999999, 2024-04-18T21:06:56.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:06:56.958 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.958 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.958 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.961 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.966 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.089996227, 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.081714632000001, 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.972 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:06:56.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:06:56.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:06:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.8947973060000001, 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.978 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:06:56.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.8938095380000002, 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.984 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:06:56.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:06:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:06:56.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:06:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.8895050940000004, 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:06:56.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:06:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:06:56.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:06:56.995 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:06:56.995 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:06:56.997 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:57.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:56.994+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:57.004 INFO:tasks.workunit.client.0.smithi096.stdout:9/101: write d0/d8/d11/f19 [564405,100819] 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/92: write d1/db/f1b [174333,54500] 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:2/112: truncate d11/d13/f15 581770 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:9/102: mkdir d0/d8/d11/d1f 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/93: fdatasync d1/d4/f9 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:2/113: chown f2 6505699 1 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/94: chown d1 0 1 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:2/114: readlink l6 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:2/115: rmdir d11 39 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/95: rmdir d1/db 39 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:9/103: creat d0/d8/d9/f20 x:0 0 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:2/116: stat d11 0 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:9/104: read - d0/d8/f1c zero size 2024-04-18T21:06:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/96: rename d1/db/f14 to d1/d4/f1d 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:9/105: symlink d0/d8/d9/l21 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:0/97: rmdir d1 39 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:9/106: unlink d0/dc/d18/c1d 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:4/59: dwrite d2/f9 [0,4194304] 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:0/98: truncate d1/f15 129110 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:9/107: chown d0/d8/ca 0 1 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:4/60: mknod d2/d7/c11 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:9/108: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:9/109: dread - d0/d8/d9/f20 zero size 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:4/61: dwrite d2/fc [0,4194304] 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:4/62: chown d2/d7/c11 3102587 1 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:0/99: write d1/f3 [1356345,112297] 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:2/117: truncate fb 364526 0 2024-04-18T21:06:57.006 INFO:tasks.workunit.client.0.smithi096.stdout:0/100: mkdir d1/d1c/d1e 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/110: dwrite d0/d8/d16/f17 [4194304,4194304] 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/101: creat d1/d1c/f1f x:0 0 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/63: dwrite d2/d7/fe [0,4194304] 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/64: mknod d2/d7/c12 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/102: dread d1/d4/fa [0,4194304] 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/65: creat d2/f13 x:0 0 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/66: rmdir d2 39 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/103: symlink d1/d4/l20 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/104: truncate d1/db/f1b 1047498 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/111: dwrite d0/f5 [8388608,4194304] 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/112: write d0/f5 [4040547,45945] 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:2/118: unlink d11/f18 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/67: mknod d2/c14 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/105: rename d1/d4 to d1/d1c/d21 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/113: creat d0/d8/d16/f22 x:0 0 0 2024-04-18T21:06:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:2/119: chown d11/d13/f15 687739878 1 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:4/68: unlink d2/d7/cf 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:0/106: rename l0 to d1/d1c/d1e/l22 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:9/114: write d0/d8/d9/f20 [538201,63449] 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:2/120: creat d11/d13/d1a/f1b x:0 0 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:4/69: creat d2/d7/f15 x:0 0 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:0/107: mkdir d1/d23 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:2/121: read ff [873411,115765] 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:4/70: creat d2/f16 x:0 0 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:9/115: getdents d0/d8/d11 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:0/108: creat d1/d1c/d21/f24 x:0 0 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:2/122: creat d11/d13/d1a/f1c x:0 0 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:4/71: truncate f0 2166578 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:2/123: mkdir d11/d13/d1d 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:9/116: creat d0/d8/d9/f23 x:0 0 0 2024-04-18T21:06:57.008 INFO:tasks.workunit.client.0.smithi096.stdout:9/117: rename d0/dc/cf to d0/dc/c24 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:9/118: truncate d0/d8/d16/f22 983385 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:9/119: fdatasync d0/d8/d9/f20 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:0/109: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:4/72: dwrite d2/f8 [0,4194304] 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:4/73: stat d2/d7/c12 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:4/74: readlink d2/l3 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:0/110: mkdir d1/db/d25 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/124: fdatasync d11/f19 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/125: mkdir d11/d13/d1a/d1e 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/126: fdatasync d11/d13/d1a/f1b 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/127: write d11/f19 [1373936,14613] 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/128: dread d11/f16 [0,4194304] 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/129: unlink l6 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/130: dwrite d11/d13/f15 [0,4194304] 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/131: dread - d11/d13/d1a/f1c zero size 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/132: symlink d11/l1f 0 2024-04-18T21:06:57.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/133: truncate d11/d13/f15 793169 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/134: truncate d11/d13/f15 225490 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/135: dread f2 [0,4194304] 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/136: stat fe 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/137: write d11/d13/d1a/f1c [301545,99411] 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/138: symlink d11/l20 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/139: read ff [986790,34473] 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/140: creat d11/d13/d1a/f21 x:0 0 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/141: write f1 [730795,39850] 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/142: write d11/d13/d1a/f1c [351542,100502] 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/143: rmdir d11 39 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/144: mknod d11/d13/d1a/c22 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/145: symlink d11/d13/d1a/d1e/l23 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/146: chown f2 397953817 1 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/147: dread d11/f16 [0,4194304] 0 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/148: rmdir d11/d13/d1a/d1e 39 2024-04-18T21:06:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/149: creat d11/d13/d1a/d1e/f24 x:0 0 0 2024-04-18T21:06:57.011 INFO:tasks.workunit.client.0.smithi096.stdout:2/150: link d11/d13/f15 d11/f25 0 2024-04-18T21:06:57.011 INFO:tasks.workunit.client.0.smithi096.stdout:2/151: rename d11/d13/d1a/f21 to d11/d13/d1a/f26 0 2024-04-18T21:06:57.012 INFO:tasks.workunit.client.0.smithi096.stdout:2/152: dwrite fb [0,4194304] 0 2024-04-18T21:06:57.012 INFO:tasks.workunit.client.0.smithi096.stdout:2/153: symlink d11/l27 0 2024-04-18T21:06:57.012 INFO:tasks.workunit.client.0.smithi096.stdout:2/154: chown d11/c12 5674 1 2024-04-18T21:06:57.022 INFO:tasks.workunit.client.0.smithi096.stdout:2/155: dread fe [0,4194304] 0 2024-04-18T21:06:57.022 INFO:tasks.workunit.client.0.smithi096.stdout:2/156: mkdir d11/d13/d1a/d1e/d28 0 2024-04-18T21:06:57.023 INFO:tasks.workunit.client.0.smithi096.stdout:2/157: truncate fb 4807770 0 2024-04-18T21:06:57.024 INFO:tasks.workunit.client.0.smithi096.stdout:2/158: rename d11/c17 to d11/d13/d1a/c29 0 2024-04-18T21:06:57.026 INFO:tasks.workunit.client.0.smithi096.stdout:2/159: dread fb [0,4194304] 0 2024-04-18T21:06:57.027 INFO:tasks.workunit.client.0.smithi096.stdout:2/160: creat d11/d13/d1d/f2a x:0 0 0 2024-04-18T21:06:57.028 INFO:tasks.workunit.client.0.smithi096.stdout:2/161: chown d11 54113 1 2024-04-18T21:06:57.028 INFO:tasks.workunit.client.0.smithi096.stdout:2/162: mkdir d11/d13/d1d/d2b 0 2024-04-18T21:06:57.029 INFO:tasks.workunit.client.0.smithi096.stdout:2/163: dread d11/f25 [0,4194304] 0 2024-04-18T21:06:57.029 INFO:tasks.workunit.client.0.smithi096.stdout:2/164: read d11/d13/f15 [69229,323] 0 2024-04-18T21:06:57.030 INFO:tasks.workunit.client.0.smithi096.stdout:2/165: mknod d11/d13/d1a/d1e/d28/c2c 0 2024-04-18T21:06:57.030 INFO:tasks.workunit.client.0.smithi096.stdout:2/166: read ff [2752972,114824] 0 2024-04-18T21:06:57.031 INFO:tasks.workunit.client.0.smithi096.stdout:2/167: creat d11/d13/f2d x:0 0 0 2024-04-18T21:06:57.031 INFO:tasks.workunit.client.0.smithi096.stdout:2/168: write ff [142512,25473] 0 2024-04-18T21:06:57.037 INFO:tasks.workunit.client.0.smithi096.stdout:2/169: getdents d11/d13/d1d 0 2024-04-18T21:06:57.037 INFO:tasks.workunit.client.0.smithi096.stdout:2/170: creat d11/d13/d1a/d1e/d28/f2e x:0 0 0 2024-04-18T21:06:57.038 INFO:tasks.workunit.client.0.smithi096.stdout:2/171: truncate d11/f19 5198903 0 2024-04-18T21:06:57.042 INFO:tasks.workunit.client.0.smithi096.stdout:2/172: truncate ff 2136718 0 2024-04-18T21:06:57.046 INFO:tasks.workunit.client.0.smithi096.stdout:2/173: write d11/d13/f15 [1193170,6245] 0 2024-04-18T21:06:57.046 INFO:tasks.workunit.client.0.smithi096.stdout:2/174: creat d11/d13/f2f x:0 0 0 2024-04-18T21:06:57.047 INFO:tasks.workunit.client.0.smithi096.stdout:2/175: fsync d11/d13/d1a/f26 0 2024-04-18T21:06:57.059 INFO:tasks.workunit.client.0.smithi096.stdout:2/176: dread ff [0,4194304] 0 2024-04-18T21:06:57.059 INFO:tasks.workunit.client.0.smithi096.stdout:2/177: unlink d11/f25 0 2024-04-18T21:06:57.060 INFO:tasks.workunit.client.0.smithi096.stdout:2/178: mknod d11/d13/d1a/d1e/d28/c30 0 2024-04-18T21:06:57.061 INFO:tasks.workunit.client.0.smithi096.stdout:2/179: rename d11/d13/d1a/f1b to d11/d13/f31 0 2024-04-18T21:06:57.062 INFO:tasks.workunit.client.0.smithi096.stdout:2/180: truncate d11/d13/d1a/f26 609848 0 2024-04-18T21:06:57.062 INFO:tasks.workunit.client.0.smithi096.stdout:2/181: dread - d11/d13/f31 zero size 2024-04-18T21:06:57.062 INFO:tasks.workunit.client.0.smithi096.stdout:2/182: chown d11/d13/d1a/d1e/d28/c30 25723122 1 2024-04-18T21:06:57.063 INFO:tasks.workunit.client.0.smithi096.stdout:2/183: creat d11/d13/f32 x:0 0 0 2024-04-18T21:06:57.063 INFO:tasks.workunit.client.0.smithi096.stdout:2/184: creat d11/d13/d1a/d1e/f33 x:0 0 0 2024-04-18T21:06:57.064 INFO:tasks.workunit.client.0.smithi096.stdout:2/185: rename d11/d13/d1a/d1e/d28/c30 to d11/d13/d1d/c34 0 2024-04-18T21:06:57.065 INFO:tasks.workunit.client.0.smithi096.stdout:2/186: creat d11/d13/d1a/f35 x:0 0 0 2024-04-18T21:06:57.066 INFO:tasks.workunit.client.0.smithi096.stdout:2/187: symlink d11/d13/d1a/d1e/d28/l36 0 2024-04-18T21:06:57.067 INFO:tasks.workunit.client.0.smithi096.stdout:2/188: creat d11/f37 x:0 0 0 2024-04-18T21:06:57.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/189: read d11/d13/f15 [213073,70029] 0 2024-04-18T21:06:57.073 INFO:tasks.workunit.client.0.smithi096.stdout:2/190: link d11/d13/d1a/c29 d11/d13/c38 0 2024-04-18T21:06:57.073 INFO:tasks.workunit.client.0.smithi096.stdout:2/191: fdatasync d11/d13/d1a/d1e/f33 0 2024-04-18T21:06:57.073 INFO:tasks.workunit.client.0.smithi096.stdout:2/192: dread - d11/d13/f2d zero size 2024-04-18T21:06:57.074 INFO:tasks.workunit.client.0.smithi096.stdout:2/193: creat d11/f39 x:0 0 0 2024-04-18T21:06:57.074 INFO:tasks.workunit.client.0.smithi096.stdout:2/194: symlink d11/d13/l3a 0 2024-04-18T21:06:57.075 INFO:tasks.workunit.client.0.smithi096.stdout:2/195: rename c4 to d11/d13/d1a/d1e/c3b 0 2024-04-18T21:06:57.076 INFO:tasks.workunit.client.0.smithi096.stdout:2/196: symlink d11/d13/d1a/l3c 0 2024-04-18T21:06:57.084 INFO:tasks.workunit.client.0.smithi096.stdout:2/197: dwrite d11/f19 [4194304,4194304] 0 2024-04-18T21:06:57.092 INFO:tasks.workunit.client.0.smithi096.stdout:2/198: dwrite fe [0,4194304] 0 2024-04-18T21:06:57.093 INFO:tasks.workunit.client.0.smithi096.stdout:2/199: write d11/d13/d1a/d1e/f33 [490734,115889] 0 2024-04-18T21:06:57.096 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:57.095+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:57.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/200: dwrite d11/d13/f15 [0,4194304] 0 2024-04-18T21:06:57.107 INFO:tasks.workunit.client.0.smithi096.stdout:2/201: write d11/d13/f2d [337327,95303] 0 2024-04-18T21:06:57.108 INFO:tasks.workunit.client.0.smithi096.stdout:2/202: dread - d11/d13/d1a/d1e/d28/f2e zero size 2024-04-18T21:06:57.108 INFO:tasks.workunit.client.0.smithi096.stdout:2/203: write d11/d13/d1d/f2a [387382,66939] 0 2024-04-18T21:06:57.109 INFO:tasks.workunit.client.0.smithi096.stdout:2/204: creat d11/d13/d1d/d2b/f3d x:0 0 0 2024-04-18T21:06:57.110 INFO:tasks.workunit.client.0.smithi096.stdout:2/205: truncate d11/d13/d1d/d2b/f3d 84935 0 2024-04-18T21:06:57.111 INFO:tasks.workunit.client.0.smithi096.stdout:2/206: creat d11/d13/d1a/d1e/d28/f3e x:0 0 0 2024-04-18T21:06:57.111 INFO:tasks.workunit.client.0.smithi096.stdout:2/207: creat d11/d13/f3f x:0 0 0 2024-04-18T21:06:57.112 INFO:tasks.workunit.client.0.smithi096.stdout:2/208: chown d11/d13/d1a/f26 231937 1 2024-04-18T21:06:57.116 INFO:tasks.workunit.client.0.smithi096.stdout:2/209: dread d11/d13/d1a/f1c [0,4194304] 0 2024-04-18T21:06:57.116 INFO:tasks.workunit.client.0.smithi096.stdout:2/210: mkdir d11/d13/d1d/d2b/d40 0 2024-04-18T21:06:57.117 INFO:tasks.workunit.client.0.smithi096.stdout:2/211: write d11/d13/f2f [315648,125646] 0 2024-04-18T21:06:57.121 INFO:tasks.workunit.client.0.smithi096.stdout:2/212: fsync d11/d13/f3f 0 2024-04-18T21:06:57.122 INFO:tasks.workunit.client.0.smithi096.stdout:2/213: link d11/d13/d1d/f2a d11/d13/f41 0 2024-04-18T21:06:57.128 INFO:tasks.workunit.client.0.smithi096.stdout:2/214: dwrite d11/d13/d1a/f35 [0,4194304] 0 2024-04-18T21:06:57.129 INFO:tasks.workunit.client.0.smithi096.stdout:2/215: creat d11/d13/d1d/d2b/d40/f42 x:0 0 0 2024-04-18T21:06:57.130 INFO:tasks.workunit.client.0.smithi096.stdout:2/216: fdatasync d11/d13/f41 0 2024-04-18T21:06:57.130 INFO:tasks.workunit.client.0.smithi096.stdout:2/217: symlink d11/d13/d1d/l43 0 2024-04-18T21:06:57.131 INFO:tasks.workunit.client.0.smithi096.stdout:2/218: write d11/d13/f2f [17856,14115] 0 2024-04-18T21:06:57.132 INFO:tasks.workunit.client.0.smithi096.stdout:2/219: chown d11/d13/l3a 37 1 2024-04-18T21:06:57.132 INFO:tasks.workunit.client.0.smithi096.stdout:2/220: mknod d11/c44 0 2024-04-18T21:06:57.132 INFO:tasks.workunit.client.0.smithi096.stdout:2/221: fdatasync d11/d13/f2d 0 2024-04-18T21:06:57.133 INFO:tasks.workunit.client.0.smithi096.stdout:2/222: read ff [1711660,46450] 0 2024-04-18T21:06:57.133 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:57.133 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:57.133 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:06:57.134 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:57.137 INFO:tasks.workunit.client.0.smithi096.stdout:2/223: dread d11/d13/d1a/d1e/f33 [0,4194304] 0 2024-04-18T21:06:57.138 INFO:tasks.workunit.client.0.smithi096.stdout:2/224: readlink d11/d13/d1a/l3c 0 2024-04-18T21:06:57.142 INFO:tasks.workunit.client.0.smithi096.stdout:2/225: truncate d11/f16 3214146 0 2024-04-18T21:06:57.144 INFO:tasks.workunit.client.0.smithi096.stdout:2/226: dread ff [0,4194304] 0 2024-04-18T21:06:57.145 INFO:tasks.workunit.client.0.smithi096.stdout:2/227: link d11/d13/f3f d11/d13/d1d/f45 0 2024-04-18T21:06:57.145 INFO:tasks.workunit.client.0.smithi096.stdout:2/228: creat d11/d13/f46 x:0 0 0 2024-04-18T21:06:57.145 INFO:tasks.workunit.client.0.smithi096.stdout:2/229: chown d11/d13/d1a/d1e/d28 4897 1 2024-04-18T21:06:57.146 INFO:tasks.workunit.client.0.smithi096.stdout:2/230: stat d11/d13/d1a/f35 0 2024-04-18T21:06:57.146 INFO:tasks.workunit.client.0.smithi096.stdout:2/231: readlink d11/l27 0 2024-04-18T21:06:57.146 INFO:tasks.workunit.client.0.smithi096.stdout:2/232: mkdir d11/d13/d47 0 2024-04-18T21:06:57.147 INFO:tasks.workunit.client.0.smithi096.stdout:2/233: symlink d11/l48 0 2024-04-18T21:06:57.150 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:57.152 INFO:tasks.workunit.client.0.smithi096.stdout:2/234: dwrite d11/d13/d1a/f35 [0,4194304] 0 2024-04-18T21:06:57.155 INFO:tasks.workunit.client.0.smithi096.stdout:2/235: dread fe [0,4194304] 0 2024-04-18T21:06:57.156 INFO:tasks.workunit.client.0.smithi096.stdout:2/236: rename d11/d13/f41 to d11/d13/d1d/d2b/d40/f49 0 2024-04-18T21:06:57.157 INFO:tasks.workunit.client.0.smithi096.stdout:2/237: truncate d11/d13/f46 750635 0 2024-04-18T21:06:57.157 INFO:tasks.workunit.client.0.smithi096.stdout:2/238: chown d11/d13/d1a/f1c 3866206 1 2024-04-18T21:06:57.157 INFO:tasks.workunit.client.0.smithi096.stdout:2/239: symlink d11/d13/d47/l4a 0 2024-04-18T21:06:57.158 INFO:tasks.workunit.client.0.smithi096.stdout:2/240: fdatasync d11/d13/d1d/f2a 0 2024-04-18T21:06:57.159 INFO:tasks.workunit.client.0.smithi096.stdout:2/241: link d11/d13/d1a/f1c d11/d13/d1d/d2b/f4b 0 2024-04-18T21:06:57.197 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:57.197+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:57.266 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:57.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:06:57.266 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:06:57.267 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:06:57.267 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:57.280 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:57.288 INFO:tasks.workunit.client.0.smithi096.stdout:7/16: sync 2024-04-18T21:06:57.288 INFO:tasks.workunit.client.0.smithi096.stdout:7/17: truncate - no filename 2024-04-18T21:06:57.288 INFO:tasks.workunit.client.0.smithi096.stdout:3/69: sync 2024-04-18T21:06:57.289 INFO:tasks.workunit.client.0.smithi096.stdout:8/88: sync 2024-04-18T21:06:57.289 INFO:tasks.workunit.client.0.smithi096.stdout:1/21: sync 2024-04-18T21:06:57.289 INFO:tasks.workunit.client.0.smithi096.stdout:5/35: sync 2024-04-18T21:06:57.289 INFO:tasks.workunit.client.0.smithi096.stdout:1/22: creat d0/f4 x:0 0 0 2024-04-18T21:06:57.290 INFO:tasks.workunit.client.0.smithi096.stdout:5/36: mkdir d2/d11 0 2024-04-18T21:06:57.290 INFO:tasks.workunit.client.0.smithi096.stdout:7/18: creat d0/d1/f4 x:0 0 0 2024-04-18T21:06:57.291 INFO:tasks.workunit.client.0.smithi096.stdout:1/23: symlink d0/l5 0 2024-04-18T21:06:57.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/37: rename d2/f9 to d2/f12 0 2024-04-18T21:06:57.292 INFO:tasks.workunit.client.0.smithi096.stdout:1/24: creat d0/f6 x:0 0 0 2024-04-18T21:06:57.292 INFO:tasks.workunit.client.0.smithi096.stdout:7/19: write d0/d1/f4 [73597,126768] 0 2024-04-18T21:06:57.293 INFO:tasks.workunit.client.0.smithi096.stdout:1/25: rmdir d0 39 2024-04-18T21:06:57.293 INFO:tasks.workunit.client.0.smithi096.stdout:5/38: unlink d2/f6 0 2024-04-18T21:06:57.293 INFO:tasks.workunit.client.0.smithi096.stdout:7/20: symlink d0/d1/l5 0 2024-04-18T21:06:57.294 INFO:tasks.workunit.client.0.smithi096.stdout:5/39: symlink d2/l13 0 2024-04-18T21:06:57.294 INFO:tasks.workunit.client.0.smithi096.stdout:1/26: creat d0/f7 x:0 0 0 2024-04-18T21:06:57.294 INFO:tasks.workunit.client.0.smithi096.stdout:5/40: readlink d2/l4 0 2024-04-18T21:06:57.295 INFO:tasks.workunit.client.0.smithi096.stdout:7/21: mknod d0/c6 0 2024-04-18T21:06:57.295 INFO:tasks.workunit.client.0.smithi096.stdout:1/27: creat d0/f8 x:0 0 0 2024-04-18T21:06:57.295 INFO:tasks.workunit.client.0.smithi096.stdout:5/41: chown d2/lf 7979265 1 2024-04-18T21:06:57.295 INFO:tasks.workunit.client.0.smithi096.stdout:7/22: readlink d0/d1/l5 0 2024-04-18T21:06:57.296 INFO:tasks.workunit.client.0.smithi096.stdout:1/28: rename d0/f8 to d0/f9 0 2024-04-18T21:06:57.297 INFO:tasks.workunit.client.0.smithi096.stdout:5/42: link d2/f10 d2/da/f14 0 2024-04-18T21:06:57.297 INFO:tasks.workunit.client.0.smithi096.stdout:1/29: mknod d0/ca 0 2024-04-18T21:06:57.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:57.294+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:57.305 INFO:tasks.workunit.client.0.smithi096.stdout:7/23: rename d0/d1 to d0/d7 0 2024-04-18T21:06:57.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/43: fsync d2/f10 0 2024-04-18T21:06:57.305 INFO:tasks.workunit.client.0.smithi096.stdout:1/30: getdents d0 0 2024-04-18T21:06:57.305 INFO:tasks.workunit.client.0.smithi096.stdout:7/24: chown d0 64007725 1 2024-04-18T21:06:57.306 INFO:tasks.workunit.client.0.smithi096.stdout:7/25: mkdir d0/d7/d8 0 2024-04-18T21:06:57.306 INFO:tasks.workunit.client.0.smithi096.stdout:1/31: mknod d0/cb 0 2024-04-18T21:06:57.307 INFO:tasks.workunit.client.0.smithi096.stdout:5/44: rename d2/da/fb to d2/f15 0 2024-04-18T21:06:57.308 INFO:tasks.workunit.client.0.smithi096.stdout:5/45: rename d2/f12 to d2/f16 0 2024-04-18T21:06:57.324 INFO:tasks.workunit.client.0.smithi096.stdout:7/26: dwrite d0/d7/f4 [0,4194304] 0 2024-04-18T21:06:57.324 INFO:tasks.workunit.client.0.smithi096.stdout:1/32: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:57.325 INFO:tasks.workunit.client.0.smithi096.stdout:1/33: rename d0 to d0/dc 22 2024-04-18T21:06:57.330 INFO:tasks.workunit.client.0.smithi096.stdout:7/27: dread d0/d7/f4 [0,4194304] 0 2024-04-18T21:06:57.330 INFO:tasks.workunit.client.0.smithi096.stdout:1/34: truncate d0/f4 670672 0 2024-04-18T21:06:57.331 INFO:tasks.workunit.client.0.smithi096.stdout:7/28: unlink d0/d7/f4 0 2024-04-18T21:06:57.331 INFO:tasks.workunit.client.0.smithi096.stdout:7/29: write - no filename 2024-04-18T21:06:57.333 INFO:tasks.workunit.client.0.smithi096.stdout:7/30: mknod d0/d7/d8/c9 0 2024-04-18T21:06:57.333 INFO:tasks.workunit.client.0.smithi096.stdout:7/31: dread - no filename 2024-04-18T21:06:57.334 INFO:tasks.workunit.client.0.smithi096.stdout:7/32: chown d0/d7/l5 336418253 1 2024-04-18T21:06:57.334 INFO:tasks.workunit.client.0.smithi096.stdout:7/33: dread - no filename 2024-04-18T21:06:57.334 INFO:tasks.workunit.client.0.smithi096.stdout:7/34: dwrite - no filename 2024-04-18T21:06:57.334 INFO:tasks.workunit.client.0.smithi096.stdout:7/35: dwrite - no filename 2024-04-18T21:06:57.336 INFO:tasks.workunit.client.0.smithi096.stdout:7/36: rename d0/c6 to d0/d7/ca 0 2024-04-18T21:06:57.338 INFO:tasks.workunit.client.0.smithi096.stdout:7/37: chown d0/d7 997392272 1 2024-04-18T21:06:57.338 INFO:tasks.workunit.client.0.smithi096.stdout:7/38: fdatasync - no filename 2024-04-18T21:06:57.344 INFO:tasks.workunit.client.0.smithi096.stdout:1/35: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:57.346 INFO:tasks.workunit.client.0.smithi096.stdout:1/36: getdents d0 0 2024-04-18T21:06:57.347 INFO:tasks.workunit.client.0.smithi096.stdout:1/37: chown d0/l2 1263277360 1 2024-04-18T21:06:57.348 INFO:tasks.workunit.client.0.smithi096.stdout:1/38: rename d0/l5 to d0/ld 0 2024-04-18T21:06:57.349 INFO:tasks.workunit.client.0.smithi096.stdout:1/39: mknod d0/ce 0 2024-04-18T21:06:57.350 INFO:tasks.workunit.client.0.smithi096.stdout:1/40: mkdir d0/df 0 2024-04-18T21:06:57.351 INFO:tasks.workunit.client.0.smithi096.stdout:1/41: rename d0/df to d0/df/d10 22 2024-04-18T21:06:57.355 INFO:tasks.workunit.client.0.smithi096.stdout:1/42: readlink d0/ld 0 2024-04-18T21:06:57.356 INFO:tasks.workunit.client.0.smithi096.stdout:1/43: mkdir d0/df/d11 0 2024-04-18T21:06:57.357 INFO:tasks.workunit.client.0.smithi096.stdout:1/44: mknod d0/df/d11/c12 0 2024-04-18T21:06:57.358 INFO:tasks.workunit.client.0.smithi096.stdout:1/45: truncate d0/f4 1190438 0 2024-04-18T21:06:57.359 INFO:tasks.workunit.client.0.smithi096.stdout:1/46: creat d0/f13 x:0 0 0 2024-04-18T21:06:57.360 INFO:tasks.workunit.client.0.smithi096.stdout:1/47: creat d0/df/d11/f14 x:0 0 0 2024-04-18T21:06:57.366 INFO:tasks.workunit.client.0.smithi096.stdout:1/48: getdents d0/df/d11 0 2024-04-18T21:06:57.370 INFO:tasks.workunit.client.0.smithi096.stdout:1/49: read d0/f4 [68298,41574] 0 2024-04-18T21:06:57.371 INFO:tasks.workunit.client.0.smithi096.stdout:1/50: dread - d0/f13 zero size 2024-04-18T21:06:57.373 INFO:tasks.workunit.client.0.smithi096.stdout:1/51: truncate d0/f7 5038150 0 2024-04-18T21:06:57.384 INFO:tasks.workunit.client.0.smithi096.stdout:1/52: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:57.385 INFO:tasks.workunit.client.0.smithi096.stdout:1/53: dread - d0/f13 zero size 2024-04-18T21:06:57.387 INFO:tasks.workunit.client.0.smithi096.stdout:1/54: symlink d0/l15 0 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:9/120: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:3/70: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:6/45: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:0/111: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:2/242: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:8/89: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:4/75: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:7/39: sync 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:7/40: fsync - no filename 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:7/41: dread - no filename 2024-04-18T21:06:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:7/42: dwrite - no filename 2024-04-18T21:06:57.397 INFO:tasks.workunit.client.0.smithi096.stdout:0/112: fdatasync d1/d1c/f1f 0 2024-04-18T21:06:57.397 INFO:tasks.workunit.client.0.smithi096.stdout:2/243: fdatasync d11/f19 0 2024-04-18T21:06:57.397 INFO:tasks.workunit.client.0.smithi096.stdout:7/43: creat d0/d7/fb x:0 0 0 2024-04-18T21:06:57.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:57.398+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:57.399 INFO:tasks.workunit.client.0.smithi096.stdout:8/90: chown d0/d3/d14/d1b/f20 860209 1 2024-04-18T21:06:57.399 INFO:tasks.workunit.client.0.smithi096.stdout:7/44: dread - d0/d7/fb zero size 2024-04-18T21:06:57.399 INFO:tasks.workunit.client.0.smithi096.stdout:2/244: unlink d11/d13/d47/l4a 0 2024-04-18T21:06:57.399 INFO:tasks.workunit.client.0.smithi096.stdout:6/46: creat d1/d5/da/fc x:0 0 0 2024-04-18T21:06:57.400 INFO:tasks.workunit.client.0.smithi096.stdout:4/76: dread f1 [0,4194304] 0 2024-04-18T21:06:57.400 INFO:tasks.workunit.client.0.smithi096.stdout:6/47: rmdir d1/d5 39 2024-04-18T21:06:57.401 INFO:tasks.workunit.client.0.smithi096.stdout:8/91: write d0/d3/d14/d1b/f20 [72336,61383] 0 2024-04-18T21:06:57.402 INFO:tasks.workunit.client.0.smithi096.stdout:7/45: creat d0/fc x:0 0 0 2024-04-18T21:06:57.402 INFO:tasks.workunit.client.0.smithi096.stdout:1/55: dwrite d0/f13 [0,4194304] 0 2024-04-18T21:06:57.403 INFO:tasks.workunit.client.0.smithi096.stdout:2/245: creat d11/d13/d1d/d2b/d40/f4c x:0 0 0 2024-04-18T21:06:57.404 INFO:tasks.workunit.client.0.smithi096.stdout:0/113: symlink d1/d23/l26 0 2024-04-18T21:06:57.405 INFO:tasks.workunit.client.0.smithi096.stdout:1/56: write d0/f13 [142312,18744] 0 2024-04-18T21:06:57.405 INFO:tasks.workunit.client.0.smithi096.stdout:7/46: unlink d0/d7/l5 0 2024-04-18T21:06:57.406 INFO:tasks.workunit.client.0.smithi096.stdout:6/48: symlink d1/ld 0 2024-04-18T21:06:57.406 INFO:tasks.workunit.client.0.smithi096.stdout:7/47: chown d0/d7 27797 1 2024-04-18T21:06:57.406 INFO:tasks.workunit.client.0.smithi096.stdout:2/246: symlink d11/d13/d1d/d2b/d40/l4d 0 2024-04-18T21:06:57.409 INFO:tasks.workunit.client.0.smithi096.stdout:9/121: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:57.409 INFO:tasks.workunit.client.0.smithi096.stdout:3/71: dwrite d4/d8/fa [0,4194304] 0 2024-04-18T21:06:57.410 INFO:tasks.workunit.client.0.smithi096.stdout:8/92: write d0/d3/d14/d1b/f25 [746641,74443] 0 2024-04-18T21:06:57.411 INFO:tasks.workunit.client.0.smithi096.stdout:4/77: dread d2/fc [0,4194304] 0 2024-04-18T21:06:57.411 INFO:tasks.workunit.client.0.smithi096.stdout:6/49: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:57.412 INFO:tasks.workunit.client.0.smithi096.stdout:6/50: read d1/f3 [1330206,10359] 0 2024-04-18T21:06:57.413 INFO:tasks.workunit.client.0.smithi096.stdout:6/51: chown d1 1 1 2024-04-18T21:06:57.414 INFO:tasks.workunit.client.0.smithi096.stdout:3/72: mknod d4/d6/d7/c14 0 2024-04-18T21:06:57.414 INFO:tasks.workunit.client.0.smithi096.stdout:7/48: getdents d0/d7 0 2024-04-18T21:06:57.414 INFO:tasks.workunit.client.0.smithi096.stdout:9/122: creat d0/dc/f25 x:0 0 0 2024-04-18T21:06:57.414 INFO:tasks.workunit.client.0.smithi096.stdout:4/78: rename d2/d7/fe to d2/d7/f17 0 2024-04-18T21:06:57.414 INFO:tasks.workunit.client.0.smithi096.stdout:6/52: readlink d1/l2 0 2024-04-18T21:06:57.414 INFO:tasks.workunit.client.0.smithi096.stdout:7/49: fdatasync d0/d7/fb 0 2024-04-18T21:06:57.414 INFO:tasks.workunit.client.0.smithi096.stdout:9/123: creat d0/dc/f26 x:0 0 0 2024-04-18T21:06:57.416 INFO:tasks.workunit.client.0.smithi096.stdout:9/124: truncate d0/d8/d16/f22 1846414 0 2024-04-18T21:06:57.417 INFO:tasks.workunit.client.0.smithi096.stdout:2/247: dwrite d11/d13/d1a/f26 [0,4194304] 0 2024-04-18T21:06:57.417 INFO:tasks.workunit.client.0.smithi096.stdout:9/125: fdatasync d0/dc/f26 0 2024-04-18T21:06:57.419 INFO:tasks.workunit.client.0.smithi096.stdout:8/93: rename d0/d3/f4 to d0/f27 0 2024-04-18T21:06:57.422 INFO:tasks.workunit.client.0.smithi096.stdout:8/94: write d0/d3/db/f15 [834882,72052] 0 2024-04-18T21:06:57.422 INFO:tasks.workunit.client.0.smithi096.stdout:3/73: dwrite d4/d8/ff [0,4194304] 0 2024-04-18T21:06:57.423 INFO:tasks.workunit.client.0.smithi096.stdout:6/53: creat d1/d5/d7/fe x:0 0 0 2024-04-18T21:06:57.425 INFO:tasks.workunit.client.0.smithi096.stdout:8/95: mknod d0/d3/c28 0 2024-04-18T21:06:57.425 INFO:tasks.workunit.client.0.smithi096.stdout:7/50: dwrite d0/fc [0,4194304] 0 2024-04-18T21:06:57.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/74: dread - d4/d8/fb zero size 2024-04-18T21:06:57.426 INFO:tasks.workunit.client.0.smithi096.stdout:6/54: creat d1/d5/ff x:0 0 0 2024-04-18T21:06:57.428 INFO:tasks.workunit.client.0.smithi096.stdout:6/55: write d1/d5/ff [2263,20385] 0 2024-04-18T21:06:57.428 INFO:tasks.workunit.client.0.smithi096.stdout:8/96: truncate d0/d3/db/f13 963305 0 2024-04-18T21:06:57.429 INFO:tasks.workunit.client.0.smithi096.stdout:4/79: getdents d2/d7 0 2024-04-18T21:06:57.430 INFO:tasks.workunit.client.0.smithi096.stdout:4/80: fdatasync d2/d7/f15 0 2024-04-18T21:06:57.430 INFO:tasks.workunit.client.0.smithi096.stdout:8/97: fdatasync d0/d3/d14/d1b/f20 0 2024-04-18T21:06:57.431 INFO:tasks.workunit.client.0.smithi096.stdout:2/248: dwrite d11/d13/d1d/d2b/f3d [0,4194304] 0 2024-04-18T21:06:57.432 INFO:tasks.workunit.client.0.smithi096.stdout:9/126: dwrite d0/d8/d11/f19 [0,4194304] 0 2024-04-18T21:06:57.432 INFO:tasks.workunit.client.0.smithi096.stdout:4/81: creat d2/f18 x:0 0 0 2024-04-18T21:06:57.432 INFO:tasks.workunit.client.0.smithi096.stdout:8/98: chown d0/d3/d1d 1 1 2024-04-18T21:06:57.433 INFO:tasks.workunit.client.0.smithi096.stdout:9/127: write d0/d8/d16/f17 [9248488,79139] 0 2024-04-18T21:06:57.433 INFO:tasks.workunit.client.0.smithi096.stdout:4/82: creat d2/f19 x:0 0 0 2024-04-18T21:06:57.433 INFO:tasks.workunit.client.0.smithi096.stdout:8/99: dread - d0/d3/d1d/f24 zero size 2024-04-18T21:06:57.435 INFO:tasks.workunit.client.0.smithi096.stdout:9/128: truncate d0/d8/d9/f20 1046039 0 2024-04-18T21:06:57.435 INFO:tasks.workunit.client.0.smithi096.stdout:8/100: truncate d0/f8 4404729 0 2024-04-18T21:06:57.436 INFO:tasks.workunit.client.0.smithi096.stdout:9/129: dread - d0/d8/d9/f23 zero size 2024-04-18T21:06:57.436 INFO:tasks.workunit.client.0.smithi096.stdout:8/101: chown d0/l26 14 1 2024-04-18T21:06:57.438 INFO:tasks.workunit.client.0.smithi096.stdout:6/56: dwrite d1/d6/f9 [0,4194304] 0 2024-04-18T21:06:57.438 INFO:tasks.workunit.client.0.smithi096.stdout:8/102: mkdir d0/d3/d14/d1b/d29 0 2024-04-18T21:06:57.438 INFO:tasks.workunit.client.0.smithi096.stdout:9/130: creat d0/dc/d18/f27 x:0 0 0 2024-04-18T21:06:57.439 INFO:tasks.workunit.client.0.smithi096.stdout:9/131: fdatasync d0/f4 0 2024-04-18T21:06:57.439 INFO:tasks.workunit.client.0.smithi096.stdout:6/57: read d1/d6/f9 [571250,93696] 0 2024-04-18T21:06:57.439 INFO:tasks.workunit.client.0.smithi096.stdout:8/103: creat d0/d3/d14/f2a x:0 0 0 2024-04-18T21:06:57.440 INFO:tasks.workunit.client.0.smithi096.stdout:9/132: fdatasync d0/dc/d18/f27 0 2024-04-18T21:06:57.441 INFO:tasks.workunit.client.0.smithi096.stdout:3/75: dread d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:57.442 INFO:tasks.workunit.client.0.smithi096.stdout:9/133: write d0/dc/f25 [384633,24102] 0 2024-04-18T21:06:57.442 INFO:tasks.workunit.client.0.smithi096.stdout:8/104: symlink d0/d3/d14/d1b/d29/l2b 0 2024-04-18T21:06:57.443 INFO:tasks.workunit.client.0.smithi096.stdout:9/134: chown d0/d8 10 1 2024-04-18T21:06:57.443 INFO:tasks.workunit.client.0.smithi096.stdout:4/83: dwrite d2/d7/fb [0,4194304] 0 2024-04-18T21:06:57.443 INFO:tasks.workunit.client.0.smithi096.stdout:6/58: dread d1/d5/d7/fb [0,4194304] 0 2024-04-18T21:06:57.443 INFO:tasks.workunit.client.0.smithi096.stdout:3/76: creat d4/d6/d7/f15 x:0 0 0 2024-04-18T21:06:57.444 INFO:tasks.workunit.client.0.smithi096.stdout:4/84: symlink d2/l1a 0 2024-04-18T21:06:57.444 INFO:tasks.workunit.client.0.smithi096.stdout:8/105: mkdir d0/d3/d1d/d2c 0 2024-04-18T21:06:57.444 INFO:tasks.workunit.client.0.smithi096.stdout:3/77: mknod d4/d6/c16 0 2024-04-18T21:06:57.444 INFO:tasks.workunit.client.0.smithi096.stdout:4/85: mknod d2/d7/c1b 0 2024-04-18T21:06:57.445 INFO:tasks.workunit.client.0.smithi096.stdout:4/86: write d2/d7/f15 [287096,39040] 0 2024-04-18T21:06:57.445 INFO:tasks.workunit.client.0.smithi096.stdout:6/59: dread d1/d5/d7/fb [0,4194304] 0 2024-04-18T21:06:57.445 INFO:tasks.workunit.client.0.smithi096.stdout:6/60: fdatasync d1/d5/d7/fe 0 2024-04-18T21:06:57.447 INFO:tasks.workunit.client.0.smithi096.stdout:6/61: getdents d1/d5 0 2024-04-18T21:06:57.455 INFO:tasks.workunit.client.0.smithi096.stdout:4/87: dwrite d2/fc [4194304,4194304] 0 2024-04-18T21:06:57.456 INFO:tasks.workunit.client.0.smithi096.stdout:6/62: dwrite d1/d6/f9 [4194304,4194304] 0 2024-04-18T21:06:57.457 INFO:tasks.workunit.client.0.smithi096.stdout:6/63: chown d1/d5/d7/fe 0 1 2024-04-18T21:06:57.461 INFO:tasks.workunit.client.0.smithi096.stdout:7/51: fdatasync d0/fc 0 2024-04-18T21:06:57.462 INFO:tasks.workunit.client.0.smithi096.stdout:6/64: truncate d1/d5/da/fc 98361 0 2024-04-18T21:06:57.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/52: write d0/fc [956880,22794] 0 2024-04-18T21:06:57.464 INFO:tasks.workunit.client.0.smithi096.stdout:6/65: dread - d1/d5/d7/fe zero size 2024-04-18T21:06:57.464 INFO:tasks.workunit.client.0.smithi096.stdout:7/53: read d0/fc [2413480,113326] 0 2024-04-18T21:06:57.465 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:06:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:06:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:06:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:06:57.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 119.335343956, 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022639665, 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 187 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129146+0000", 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129151+0000", 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129160+0000", 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9060000000000008e-06 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129167+0000", 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6170000000000003e-06 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146836+0000", 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017669118000000001 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.146972+0000", 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013570699999999999 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.147174+0000", 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201938 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150538+0000", 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033642939999999999 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151643+0000", 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011047349999999999 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151723+0000", 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9881000000000003e-05 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151785+0000", 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2584999999999998e-05 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:57.471 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 119.33531169299999, 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022995254999999999, 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 188 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129178+0000", 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9299999999999997e-07 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129260+0000", 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1187999999999996e-05 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129271+0000", 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1372999999999999e-05 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129280+0000", 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148222+0000", 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018941535999999998 2024-04-18T21:06:57.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148522+0000", 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030066899999999999 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.148898+0000", 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037591300000000002 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151804+0000", 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029059630000000001 2024-04-18T21:06:57.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.151900+0000", 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5643999999999994e-05 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152060+0000", 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160796 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152173+0000", 2024-04-18T21:06:57.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112553 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 119.335196142, 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:06:57.477 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.86776221700001, 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.483 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:06:57.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:06:57.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.488 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.867649093, 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:57.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.867570011, 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.494 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.499 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.867466807, 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:06:57.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:06:57.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.867377035, 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.505 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:06:57.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:06:57.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.867290997, 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.511 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:06:57.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:57.516 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.86722691200001, 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:06:57.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:06:57.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.86714131399999, 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:06:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:06:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.867075121, 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:06:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:06:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.86700574299999, 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:06:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.86669207600001, 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:06:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.866642567, 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:06:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:06:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.86657730500001, 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:06:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:06:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.866443125, 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:06:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:06:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 108.86633965999999, 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:06:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.027299862, 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:206 3.1d e57/15 3:bf8dcf43:::200.00000008:head v 57'8, mlcod=56'6)", 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:51.889593+0000", 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.5748962989999997, 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022213417999999999, 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.889593+0000", 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.889593+0000", 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.889595+0000", 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.137e-06 2024-04-18T21:06:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895137+0000", 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055418919999999997 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895171+0000", 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3476999999999998e-05 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895185+0000", 2024-04-18T21:06:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4093e-05 2024-04-18T21:06:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895325+0000", 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139825 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.895392+0000", 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7385999999999995e-05 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:06:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.911709+0000", 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016317071999999998 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:51.911807+0000", 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7535999999999996e-05 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:06:57.579 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:06:57.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:57.586 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:57.579+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:6/66: stat d1/d5 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/54: mknod d0/d7/d8/cd 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/55: readlink - no filename 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/56: creat d0/d7/fe x:0 0 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:6/67: truncate d1/d5/da/fc 457917 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/88: dwrite d2/f19 [0,4194304] 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/89: truncate d2/fd 532510 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/57: creat d0/d7/ff x:0 0 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/90: write d2/d7/f17 [3958603,43839] 0 2024-04-18T21:06:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/58: mknod d0/c10 0 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:7/59: fdatasync d0/d7/fb 0 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:4/91: symlink d2/l1c 0 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:4/92: fsync d2/f5 0 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:5/46: sync 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:6/68: dwrite d1/d5/d7/fe [0,4194304] 0 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:7/60: dread d0/fc [0,4194304] 0 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:9/135: sync 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:2/249: sync 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:3/78: sync 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:1/57: sync 2024-04-18T21:06:57.606 INFO:tasks.workunit.client.0.smithi096.stdout:8/106: sync 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:1/58: sync 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:3/79: rmdir d4 39 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/47: symlink d2/da/l17 0 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:6/69: chown d1/d5/d7 10609207 1 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:8/107: fsync d0/d3/f23 0 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:7/61: read - d0/d7/fe zero size 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:1/59: getdents d0/df/d11 0 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:6/70: mknod d1/d5/d7/c10 0 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:4/93: dwrite d2/d7/f17 [0,4194304] 0 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:1/60: read - d0/df/d11/f14 zero size 2024-04-18T21:06:57.607 INFO:tasks.workunit.client.0.smithi096.stdout:7/62: mkdir d0/d11 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:3/80: link d4/d6/d7/lc d4/d6/l17 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:7/63: symlink d0/l12 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:6/71: rename d1/d5/d7/c10 to d1/d5/da/c11 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:1/61: write d0/f6 [847194,5456] 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:7/64: symlink d0/d7/l13 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:3/81: write d4/f5 [1299687,91580] 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:6/72: truncate d1/d5/da/fc 912585 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:4/94: dread f0 [0,4194304] 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:3/82: unlink d4/d6/d7/f15 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:6/73: symlink d1/l12 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:3/83: rmdir d4 39 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:4/95: rename d2/d7 to d2/d1d 0 2024-04-18T21:06:57.608 INFO:tasks.workunit.client.0.smithi096.stdout:9/136: dwrite d0/d8/d9/f20 [0,4194304] 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:8/108: dread d0/d3/f6 [0,4194304] 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:6/74: write d1/f3 [128022,10725] 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:9/137: stat d0/d8 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/65: fsync d0/d7/ff 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:5/48: rename d2/da to d2/d18 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:3/84: mknod d4/d6/d7/c18 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:9/138: mkdir d0/d28 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:6/75: creat d1/f13 x:0 0 0 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:9/139: chown d0/dc 131210321 1 2024-04-18T21:06:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:5/49: link l1 d2/d11/l19 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:3/85: read - d4/d6/dd/f13 zero size 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:1/62: dwrite d0/f6 [0,4194304] 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:9/140: fsync d0/d8/d11/f19 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/50: dread - d2/f10 zero size 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/51: sync 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:4/96: dread d2/d1d/f17 [0,4194304] 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:2/250: dwrite d11/f16 [0,4194304] 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/52: write d2/f7 [2031715,50815] 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:9/141: getdents d0/d8/d16 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:4/97: rename d2/f13 to d2/f1e 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:8/109: dwrite d0/d3/f23 [0,4194304] 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:7/66: dwrite d0/d7/fb [0,4194304] 0 2024-04-18T21:06:57.610 INFO:tasks.workunit.client.0.smithi096.stdout:4/98: dread - d2/f16 zero size 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/142: creat d0/dc/d18/f29 x:0 0 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:4/99: fdatasync d2/f18 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:7/67: creat d0/f14 x:0 0 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:2/251: rename d11/d13/d1d/d2b to d11/d13/d1a/d1e/d28/d4e 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/143: symlink d0/dc/l2a 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:6/76: dwrite d1/d6/f9 [4194304,4194304] 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:4/100: creat d2/f1f x:0 0 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/144: mknod d0/c2b 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:4/101: rename d2/l1c to d2/l20 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:3/86: truncate d4/d8/fa 35094 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:6/77: creat d1/f14 x:0 0 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:2/252: link d11/l20 d11/d13/d1a/l4f 0 2024-04-18T21:06:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/145: write d0/dc/d18/f27 [979644,83499] 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:1/63: truncate d0/f6 1524266 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/102: unlink d2/f1e 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/253: mkdir d11/d50 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:8/110: truncate d0/f27 3606757 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:8/111: chown d0/d3/d14/d1b 141059 1 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:1/64: mkdir d0/df/d16 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/103: link d2/d1d/f17 d2/f21 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/254: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:6/78: dread d1/d5/d7/fb [0,4194304] 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:6/79: sync 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/104: rmdir d2 39 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:1/65: creat d0/f17 x:0 0 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:7/68: dwrite d0/d7/fb [4194304,4194304] 0 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:6/80: chown d1/l12 218514162 1 2024-04-18T21:06:57.612 INFO:tasks.workunit.client.0.smithi096.stdout:5/53: dwrite d2/f10 [0,4194304] 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:1/66: write d0/df/d11/f14 [75033,52948] 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/69: stat d0/d7 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:2/255: fsync d11/d13/d1a/d1e/f33 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:6/81: chown d1/f13 441605 1 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:4/105: symlink d2/l22 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/70: symlink d0/d7/d8/l15 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:9/146: dwrite d0/d8/d11/f12 [4194304,4194304] 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:6/82: write d1/d5/d7/fe [3960416,76440] 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:9/147: fsync d0/d8/d11/f19 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/71: creat d0/d7/d8/f16 x:0 0 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:4/106: getdents d2/d1d 0 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/72: sync 2024-04-18T21:06:57.613 INFO:tasks.workunit.client.0.smithi096.stdout:9/148: fdatasync d0/f4 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:4/107: rmdir d2 39 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:6/83: write d1/d5/da/fc [1400190,61972] 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/67: symlink d0/df/d16/l18 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/68: sync 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:6/84: chown d1/l2 89 1 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/69: creat d0/df/d16/f19 x:0 0 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:6/85: readlink d1/l12 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:4/108: truncate d2/fd 1105968 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/70: write d0/f17 [213853,104153] 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:4/109: rmdir d2/d1d 39 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:6/86: rename d1/f4 to d1/d5/f15 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:4/110: write d2/f5 [65612,12281] 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/71: creat d0/df/f1a x:0 0 0 2024-04-18T21:06:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:9/149: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:2/256: write ff [2560329,95678] 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:5/54: dwrite d2/fd [0,4194304] 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/87: symlink d1/l16 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:4/111: mknod d2/d1d/c23 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:1/72: rmdir d0/df/d16 39 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:7/73: dwrite d0/d7/fe [0,4194304] 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:9/150: write d0/dc/d18/f29 [610569,117851] 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:5/55: creat d2/d11/f1a x:0 0 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/88: mkdir d1/d17 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:4/112: mknod d2/c24 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:2/257: write d11/d13/d1a/d1e/d28/d4e/d40/f49 [422491,88251] 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:5/56: dread - d2/d18/fe zero size 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/89: fsync d1/d5/ff 0 2024-04-18T21:06:57.615 INFO:tasks.workunit.client.0.smithi096.stdout:4/113: chown d2/f9 684744418 1 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:1/73: truncate d0/df/d16/f19 2243 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:5/57: creat d2/f1b x:0 0 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:8/112: dwrite d0/f12 [0,4194304] 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:8/113: sync 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/114: chown d2/f19 2 1 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:3/87: dwrite d4/d8/fa [0,4194304] 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:2/258: symlink d11/d13/d1a/d1e/d28/l52 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:6/90: rmdir d1/d6 39 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:7/74: dread d0/fc [0,4194304] 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:3/88: fsync d4/d6/d7/f10 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:6/91: creat d1/d17/f18 x:0 0 0 2024-04-18T21:06:57.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/115: getdents d2/d1d 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/114: getdents d0/d3/d14/d1b 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:3/89: fsync d4/d8/ff 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:2/259: chown d11/d13/d1a/f35 16857899 1 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:4/116: stat d2/f8 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:6/92: write d1/f3 [1449482,92229] 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/115: creat d0/d3/db/f2d x:0 0 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:3/90: dread - d4/d6/dd/f13 zero size 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:4/117: fsync d2/d1d/f17 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:5/58: dread d2/f3 [0,4194304] 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:2/260: creat d11/d13/d1a/d1e/d28/d4e/f53 x:0 0 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:6/93: mkdir d1/d6/d19 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/116: mkdir d0/d2e 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:9/151: dwrite d0/dc/d18/f29 [0,4194304] 0 2024-04-18T21:06:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:3/91: mknod d4/d6/dd/c19 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:8/117: readlink d0/l9 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:2/261: write d11/d13/f15 [2432061,60706] 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/59: symlink d2/d18/l1c 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:6/94: creat d1/d5/f1a x:0 0 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:9/152: mknod d0/dc/c2c 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:6/95: fdatasync d1/f14 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/60: dread - d2/d11/f1a zero size 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/61: sync 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:3/92: truncate d4/d6/dd/f13 60321 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:9/153: chown d0/dc/c2c 24155839 1 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:8/118: mkdir d0/d3/d14/d1b/d29/d2f 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:2/262: readlink d11/d13/d1a/d1e/d28/d4e/d40/l4d 0 2024-04-18T21:06:57.618 INFO:tasks.workunit.client.0.smithi096.stdout:6/96: creat d1/d5/f1b x:0 0 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:5/62: creat d2/f1d x:0 0 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:8/119: read - d0/d3/db/f2d zero size 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:3/93: unlink d4/d6/dd/f13 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:7/75: dwrite d0/f14 [0,4194304] 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:5/63: readlink l1 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:6/97: write d1/f14 [229176,91296] 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:6/98: chown d1/d6 13 1 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:3/94: chown l3 52 1 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:6/99: chown d1 632 1 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:4/118: dread d2/d1d/fb [0,4194304] 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:5/64: symlink d2/l1e 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:2/263: creat d11/d13/d1a/d1e/f54 x:0 0 0 2024-04-18T21:06:57.619 INFO:tasks.workunit.client.0.smithi096.stdout:3/95: creat d4/d8/f1a x:0 0 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:7/76: creat d0/d11/f17 x:0 0 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:8/120: symlink d0/d3/d14/d1b/d29/d2f/l30 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:2/264: chown d11/d13/d1a/d1e/f24 309746 1 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:6/100: creat d1/f1c x:0 0 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:8/121: creat d0/d3/d14/f31 x:0 0 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/65: rename d2/f5 to d2/d11/f1f 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/66: creat d2/f20 x:0 0 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:1/74: read d0/f17 [146314,36906] 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:8/122: creat d0/f32 x:0 0 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:2/265: link d11/l20 d11/d13/d1a/d1e/d28/l55 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/67: fsync d2/f16 0 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/68: chown d2 275383292 1 2024-04-18T21:06:57.620 INFO:tasks.workunit.client.0.smithi096.stdout:1/75: creat d0/df/d16/f1b x:0 0 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:5/69: chown d2/f7 7642 1 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:1/76: write d0/df/f1a [1041560,124510] 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:2/266: truncate d11/d13/d1a/d1e/f33 1615630 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:3/96: dwrite d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/77: dwrite d0/f14 [0,4194304] 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:1/77: write d0/f4 [1427713,8580] 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:6/101: dwrite d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:9/154: dread d0/dc/f25 [0,4194304] 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:3/97: unlink d4/d8/f1a 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:9/155: stat d0/d8/d11/f12 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:1/78: link d0/f4 d0/df/f1c 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:4/119: truncate d2/fd 326919 0 2024-04-18T21:06:57.621 INFO:tasks.workunit.client.0.smithi096.stdout:3/98: chown d4/d6/dd/d11 0 1 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:8/123: dwrite d0/d3/db/f15 [0,4194304] 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:9/156: fsync d0/d8/d11/f19 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/79: chown d0/l15 90 1 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/80: sync 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:5/70: dwrite d2/f1b [0,4194304] 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:2/267: dread d11/d13/d1a/f26 [0,4194304] 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:3/99: unlink d4/f5 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/81: chown d0/ca 38818 1 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:9/157: symlink d0/dc/l2d 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:3/100: mkdir d4/d6/d1b 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:4/120: link d2/d1d/f17 d2/f25 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:9/158: mkdir d0/d8/d2e 0 2024-04-18T21:06:57.622 INFO:tasks.workunit.client.0.smithi096.stdout:7/78: dwrite d0/fc [0,4194304] 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/102: dwrite d1/d5/f1b [0,4194304] 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/159: write d0/d8/d9/f20 [2719575,68164] 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:2/268: getdents d11/d13/d47 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:8/124: dread d0/d3/f23 [0,4194304] 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/103: symlink d1/d5/da/l1d 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/160: dread - d0/d8/d9/f23 zero size 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:4/121: creat d2/f26 x:0 0 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/161: readlink d0/ld 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/104: mknod d1/d5/d7/c1e 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:8/125: write d0/d3/db/f2d [97184,77837] 0 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:2/269: chown d11/d13/d1a/d1e/d28/c2c 303768817 1 2024-04-18T21:06:57.623 INFO:tasks.workunit.client.0.smithi096.stdout:5/71: dwrite d2/f10 [0,4194304] 0 2024-04-18T21:06:57.624 INFO:tasks.workunit.client.0.smithi096.stdout:5/72: dread - d2/d11/f1f zero size 2024-04-18T21:06:57.624 INFO:tasks.workunit.client.0.smithi096.stdout:8/126: write d0/d3/d14/d1b/f25 [1073723,46351] 0 2024-04-18T21:06:57.624 INFO:tasks.workunit.client.0.smithi096.stdout:7/79: dwrite d0/d7/fe [0,4194304] 0 2024-04-18T21:06:57.624 INFO:tasks.workunit.client.0.smithi096.stdout:9/162: rename d0/d8/d16 to d0/d28/d2f 0 2024-04-18T21:06:57.628 INFO:tasks.workunit.client.0.smithi096.stdout:5/73: creat d2/d11/f21 x:0 0 0 2024-04-18T21:06:57.628 INFO:tasks.workunit.client.0.smithi096.stdout:3/101: dwrite d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:57.628 INFO:tasks.workunit.client.0.smithi096.stdout:7/80: chown d0/d7/d8/c9 2825417 1 2024-04-18T21:06:57.628 INFO:tasks.workunit.client.0.smithi096.stdout:3/102: stat d4/d6 0 2024-04-18T21:06:57.628 INFO:tasks.workunit.client.0.smithi096.stdout:5/74: truncate d2/f16 805565 0 2024-04-18T21:06:57.628 INFO:tasks.workunit.client.0.smithi096.stdout:3/103: rmdir d4/d8 39 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:5/75: read - d2/f1d zero size 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:6/105: dwrite d1/d5/ff [0,4194304] 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:6/106: sync 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:5/76: chown d2/d11 0 1 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:2/270: dwrite d11/d13/d1a/d1e/f24 [0,4194304] 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:3/104: write d4/d8/ff [4041248,77263] 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:8/127: dwrite d0/f12 [4194304,4194304] 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:6/107: fdatasync d1/d5/da/fc 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:3/105: stat d4/d6/d1b 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:2/271: creat d11/d13/d47/f56 x:0 0 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:3/106: fsync d4/d8/fa 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:6/108: fsync d1/d5/d7/fb 0 2024-04-18T21:06:57.629 INFO:tasks.workunit.client.0.smithi096.stdout:3/107: unlink d4/d8/c12 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/128: write d0/d3/f23 [3759329,51602] 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:6/109: chown d1/ld 96 1 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:7/81: dwrite d0/d7/ff [0,4194304] 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:4/122: dread d2/d1d/f15 [0,4194304] 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/129: mkdir d0/d3/d14/d33 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:2/272: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:1/82: dread d0/df/f1a [0,4194304] 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/130: mknod d0/d3/d14/d1b/d29/d2f/c34 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:2/273: chown d11/d13/d1a/d1e/d28/f3e 24043392 1 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:1/83: chown d0/c1 353643 1 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:1/84: fsync d0/f7 0 2024-04-18T21:06:57.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/131: read d0/d3/f6 [766534,65978] 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:8/132: stat d0/d3/d1d 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:1/85: dread - d0/f9 zero size 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:1/86: sync 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:2/274: write d11/d13/d1a/f26 [162805,39980] 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:2/275: read fe [4161692,40388] 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:8/133: write d0/d3/db/f13 [281091,82870] 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:7/82: dread d0/d7/fb [0,4194304] 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:9/163: truncate d0/d8/d9/f20 2159770 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:2/276: symlink d11/d13/d1a/d1e/d28/d4e/l58 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:9/164: mknod d0/dc/c30 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:2/277: rmdir d11/d13/d1a/d1e/d28/d4e/d40/d51 39 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:5/77: fsync d2/d18/f14 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:4/123: dread d2/f21 [0,4194304] 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:5/78: unlink d2/f1d 0 2024-04-18T21:06:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:2/278: write d11/d13/d1a/d1e/d28/f3e [508721,64033] 0 2024-04-18T21:06:57.632 INFO:tasks.workunit.client.0.smithi096.stdout:5/79: mknod d2/d18/c22 0 2024-04-18T21:06:57.632 INFO:tasks.workunit.client.0.smithi096.stdout:7/83: dread d0/d7/fb [4194304,4194304] 0 2024-04-18T21:06:57.632 INFO:tasks.workunit.client.0.smithi096.stdout:5/80: symlink d2/l23 0 2024-04-18T21:06:57.633 INFO:tasks.workunit.client.0.smithi096.stdout:1/87: dwrite d0/f6 [0,4194304] 0 2024-04-18T21:06:57.633 INFO:tasks.workunit.client.0.smithi096.stdout:5/81: unlink d2/f3 0 2024-04-18T21:06:57.633 INFO:tasks.workunit.client.0.smithi096.stdout:7/84: write d0/d7/fb [371156,63012] 0 2024-04-18T21:06:57.633 INFO:tasks.workunit.client.0.smithi096.stdout:1/88: chown d0/f13 1467 1 2024-04-18T21:06:57.633 INFO:tasks.workunit.client.0.smithi096.stdout:8/134: dwrite d0/d3/f23 [4194304,4194304] 0 2024-04-18T21:06:57.635 INFO:tasks.workunit.client.0.smithi096.stdout:7/85: write d0/d7/fe [4935240,125358] 0 2024-04-18T21:06:57.636 INFO:tasks.workunit.client.0.smithi096.stdout:9/165: dwrite d0/dc/d18/f29 [0,4194304] 0 2024-04-18T21:06:57.636 INFO:tasks.workunit.client.0.smithi096.stdout:3/108: truncate d4/d8/f9 3596373 0 2024-04-18T21:06:57.636 INFO:tasks.workunit.client.0.smithi096.stdout:7/86: write d0/d11/f17 [456505,17529] 0 2024-04-18T21:06:57.636 INFO:tasks.workunit.client.0.smithi096.stdout:9/166: stat d0/d8 0 2024-04-18T21:06:57.637 INFO:tasks.workunit.client.0.smithi096.stdout:7/87: chown d0/fc 1535165 1 2024-04-18T21:06:57.640 INFO:tasks.workunit.client.0.smithi096.stdout:1/89: dwrite d0/f13 [4194304,4194304] 0 2024-04-18T21:06:57.641 INFO:tasks.workunit.client.0.smithi096.stdout:1/90: mknod d0/c1d 0 2024-04-18T21:06:57.641 INFO:tasks.workunit.client.0.smithi096.stdout:3/109: dread d4/d8/ff [0,4194304] 0 2024-04-18T21:06:57.643 INFO:tasks.workunit.client.0.smithi096.stdout:8/135: dwrite d0/d3/f23 [0,4194304] 0 2024-04-18T21:06:57.643 INFO:tasks.workunit.client.0.smithi096.stdout:6/110: truncate d1/d5/f1a 1780767 0 2024-04-18T21:06:57.643 INFO:tasks.workunit.client.0.smithi096.stdout:7/88: dread d0/d7/fb [4194304,4194304] 0 2024-04-18T21:06:57.643 INFO:tasks.workunit.client.0.smithi096.stdout:1/91: symlink d0/l1e 0 2024-04-18T21:06:57.644 INFO:tasks.workunit.client.0.smithi096.stdout:3/110: mkdir d4/d8/d1c 0 2024-04-18T21:06:57.644 INFO:tasks.workunit.client.0.smithi096.stdout:7/89: truncate d0/d11/f17 1378632 0 2024-04-18T21:06:57.644 INFO:tasks.workunit.client.0.smithi096.stdout:3/111: chown d4/d8/fa 7396 1 2024-04-18T21:06:57.646 INFO:tasks.workunit.client.0.smithi096.stdout:3/112: mkdir d4/d6/d1b/d1d 0 2024-04-18T21:06:57.646 INFO:tasks.workunit.client.0.smithi096.stdout:3/113: readlink l3 0 2024-04-18T21:06:57.647 INFO:tasks.workunit.client.0.smithi096.stdout:2/279: dwrite d11/d13/f3f [0,4194304] 0 2024-04-18T21:06:57.648 INFO:tasks.workunit.client.0.smithi096.stdout:2/280: write ff [827642,115785] 0 2024-04-18T21:06:57.649 INFO:tasks.workunit.client.0.smithi096.stdout:2/281: chown d11/d13/d1a/d1e/f54 6530 1 2024-04-18T21:06:57.649 INFO:tasks.workunit.client.0.smithi096.stdout:3/114: symlink d4/d8/d1c/l1e 0 2024-04-18T21:06:57.650 INFO:tasks.workunit.client.0.smithi096.stdout:2/282: write d11/d13/d1a/d1e/f24 [1614283,106394] 0 2024-04-18T21:06:57.650 INFO:tasks.workunit.client.0.smithi096.stdout:8/136: dwrite d0/d3/d1d/f24 [0,4194304] 0 2024-04-18T21:06:57.650 INFO:tasks.workunit.client.0.smithi096.stdout:2/283: stat d11/d13/f3f 0 2024-04-18T21:06:57.651 INFO:tasks.workunit.client.0.smithi096.stdout:2/284: write d11/d13/f46 [972980,48750] 0 2024-04-18T21:06:57.652 INFO:tasks.workunit.client.0.smithi096.stdout:2/285: rename d11/d13/f31 to d11/d13/d1a/d1e/d28/f59 0 2024-04-18T21:06:57.653 INFO:tasks.workunit.client.0.smithi096.stdout:2/286: read ff [478497,115842] 0 2024-04-18T21:06:57.657 INFO:tasks.workunit.client.0.smithi096.stdout:9/167: truncate d0/dc/f25 396707 0 2024-04-18T21:06:57.657 INFO:tasks.workunit.client.0.smithi096.stdout:1/92: write d0/f4 [2113325,75133] 0 2024-04-18T21:06:57.657 INFO:tasks.workunit.client.0.smithi096.stdout:9/168: stat d0/dc/d18 0 2024-04-18T21:06:57.658 INFO:tasks.workunit.client.0.smithi096.stdout:1/93: chown d0/l15 119 1 2024-04-18T21:06:57.659 INFO:tasks.workunit.client.0.smithi096.stdout:1/94: fsync d0/f17 0 2024-04-18T21:06:57.659 INFO:tasks.workunit.client.0.smithi096.stdout:3/115: dwrite d4/d8/ff [0,4194304] 0 2024-04-18T21:06:57.659 INFO:tasks.workunit.client.0.smithi096.stdout:2/287: dread d11/d13/d1a/f35 [0,4194304] 0 2024-04-18T21:06:57.659 INFO:tasks.workunit.client.0.smithi096.stdout:3/116: readlink d4/d6/d7/lc 0 2024-04-18T21:06:57.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/124: read d2/f5 [76517,89515] 0 2024-04-18T21:06:57.660 INFO:tasks.workunit.client.0.smithi096.stdout:2/288: write d11/d13/d1a/d1e/d28/f3e [247362,73396] 0 2024-04-18T21:06:57.660 INFO:tasks.workunit.client.0.smithi096.stdout:4/125: mknod d2/c27 0 2024-04-18T21:06:57.660 INFO:tasks.workunit.client.0.smithi096.stdout:1/95: link d0/ld d0/l1f 0 2024-04-18T21:06:57.663 INFO:tasks.workunit.client.0.smithi096.stdout:7/90: fdatasync d0/d7/fe 0 2024-04-18T21:06:57.663 INFO:tasks.workunit.client.0.smithi096.stdout:9/169: dwrite d0/dc/d18/f27 [0,4194304] 0 2024-04-18T21:06:57.664 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:06:57.664 INFO:tasks.workunit.client.0.smithi096.stdout:9/170: write d0/d8/d11/f19 [2893902,108722] 0 2024-04-18T21:06:57.665 INFO:tasks.workunit.client.0.smithi096.stdout:9/171: write d0/d28/d2f/f22 [262229,97726] 0 2024-04-18T21:06:57.666 INFO:tasks.workunit.client.0.smithi096.stdout:1/96: rename d0/ld to d0/df/d11/l20 0 2024-04-18T21:06:57.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/126: creat d2/f28 x:0 0 0 2024-04-18T21:06:57.666 INFO:tasks.workunit.client.0.smithi096.stdout:7/91: getdents d0/d7/d8 0 2024-04-18T21:06:57.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/127: readlink d2/l20 0 2024-04-18T21:06:57.666 INFO:tasks.workunit.client.0.smithi096.stdout:7/92: readlink d0/l12 0 2024-04-18T21:06:57.667 INFO:tasks.workunit.client.0.smithi096.stdout:7/93: write d0/f14 [1393638,16215] 0 2024-04-18T21:06:57.667 INFO:tasks.workunit.client.0.smithi096.stdout:4/128: creat d2/d1d/f29 x:0 0 0 2024-04-18T21:06:57.667 INFO:tasks.workunit.client.0.smithi096.stdout:4/129: write d2/f1f [690852,68403] 0 2024-04-18T21:06:57.669 INFO:tasks.workunit.client.0.smithi096.stdout:9/172: dread d0/d8/d11/f12 [4194304,4194304] 0 2024-04-18T21:06:57.670 INFO:tasks.workunit.client.0.smithi096.stdout:9/173: chown d0/d8/d9/f23 16489416 1 2024-04-18T21:06:57.671 INFO:tasks.workunit.client.0.smithi096.stdout:9/174: write d0/f4 [4075188,96113] 0 2024-04-18T21:06:57.671 INFO:tasks.workunit.client.0.smithi096.stdout:9/175: rmdir d0/d8/d11 39 2024-04-18T21:06:57.672 INFO:tasks.workunit.client.0.smithi096.stdout:9/176: creat d0/d28/f31 x:0 0 0 2024-04-18T21:06:57.673 INFO:tasks.workunit.client.0.smithi096.stdout:7/94: dwrite d0/d7/ff [0,4194304] 0 2024-04-18T21:06:57.674 INFO:tasks.workunit.client.0.smithi096.stdout:7/95: write d0/fc [2841139,78176] 0 2024-04-18T21:06:57.674 INFO:tasks.workunit.client.0.smithi096.stdout:7/96: readlink d0/l12 0 2024-04-18T21:06:57.677 INFO:tasks.workunit.client.0.smithi096.stdout:7/97: getdents d0/d7 0 2024-04-18T21:06:57.677 INFO:tasks.workunit.client.0.smithi096.stdout:7/98: getdents d0/d7/d8 0 2024-04-18T21:06:57.678 INFO:tasks.workunit.client.0.smithi096.stdout:4/130: fsync d2/d1d/f29 0 2024-04-18T21:06:57.678 INFO:tasks.workunit.client.0.smithi096.stdout:1/97: getdents d0 0 2024-04-18T21:06:57.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/99: write d0/d7/fb [1365510,25637] 0 2024-04-18T21:06:57.679 INFO:tasks.workunit.client.0.smithi096.stdout:9/177: dwrite d0/dc/d18/f29 [0,4194304] 0 2024-04-18T21:06:57.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/100: write d0/d7/fb [543372,121157] 0 2024-04-18T21:06:57.680 INFO:tasks.workunit.client.0.smithi096.stdout:7/101: write d0/d11/f17 [2007572,90712] 0 2024-04-18T21:06:57.682 INFO:tasks.workunit.client.0.smithi096.stdout:1/98: symlink d0/df/l21 0 2024-04-18T21:06:57.682 INFO:tasks.workunit.client.0.smithi096.stdout:9/178: unlink d0/d28/f31 0 2024-04-18T21:06:57.682 INFO:tasks.workunit.client.0.smithi096.stdout:7/102: mkdir d0/d11/d18 0 2024-04-18T21:06:57.682 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:57.679+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:57.683 INFO:tasks.workunit.client.0.smithi096.stdout:7/103: dread - d0/d7/d8/f16 zero size 2024-04-18T21:06:57.683 INFO:tasks.workunit.client.0.smithi096.stdout:1/99: write d0/df/f1a [1644307,10635] 0 2024-04-18T21:06:57.683 INFO:tasks.workunit.client.0.smithi096.stdout:9/179: write d0/d28/d2f/f22 [1997852,112481] 0 2024-04-18T21:06:57.684 INFO:tasks.workunit.client.0.smithi096.stdout:7/104: chown d0/d7/fe 189 1 2024-04-18T21:06:57.684 INFO:tasks.workunit.client.0.smithi096.stdout:1/100: symlink d0/l22 0 2024-04-18T21:06:57.684 INFO:tasks.workunit.client.0.smithi096.stdout:4/131: dwrite d2/f1f [0,4194304] 0 2024-04-18T21:06:57.685 INFO:tasks.workunit.client.0.smithi096.stdout:7/105: getdents d0/d7/d8 0 2024-04-18T21:06:57.685 INFO:tasks.workunit.client.0.smithi096.stdout:1/101: mknod d0/df/c23 0 2024-04-18T21:06:57.686 INFO:tasks.workunit.client.0.smithi096.stdout:4/132: mkdir d2/d2a 0 2024-04-18T21:06:57.686 INFO:tasks.workunit.client.0.smithi096.stdout:7/106: fdatasync d0/d7/d8/f16 0 2024-04-18T21:06:57.686 INFO:tasks.workunit.client.0.smithi096.stdout:4/133: dread - d2/f28 zero size 2024-04-18T21:06:57.687 INFO:tasks.workunit.client.0.smithi096.stdout:4/134: unlink d2/c14 0 2024-04-18T21:06:57.688 INFO:tasks.workunit.client.0.smithi096.stdout:0/114: dread d1/db/f1b [0,4194304] 0 2024-04-18T21:06:57.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/135: write d2/d1d/fb [1995890,42726] 0 2024-04-18T21:06:57.690 INFO:tasks.workunit.client.0.smithi096.stdout:0/115: rename d1/l19 to d1/d1c/l27 0 2024-04-18T21:06:57.690 INFO:tasks.workunit.client.0.smithi096.stdout:5/82: sync 2024-04-18T21:06:57.691 INFO:tasks.workunit.client.0.smithi096.stdout:0/116: fsync d1/f2 0 2024-04-18T21:06:57.692 INFO:tasks.workunit.client.0.smithi096.stdout:5/83: symlink d2/d11/l24 0 2024-04-18T21:06:57.692 INFO:tasks.workunit.client.0.smithi096.stdout:0/117: link d1/d1c/d21/fd d1/db/d25/f28 0 2024-04-18T21:06:57.692 INFO:tasks.workunit.client.0.smithi096.stdout:0/118: rmdir d1/db/d25 39 2024-04-18T21:06:57.693 INFO:tasks.workunit.client.0.smithi096.stdout:9/180: truncate d0/d28/d2f/f22 8509 0 2024-04-18T21:06:57.693 INFO:tasks.workunit.client.0.smithi096.stdout:7/107: dwrite d0/d11/f17 [0,4194304] 0 2024-04-18T21:06:57.694 INFO:tasks.workunit.client.0.smithi096.stdout:1/102: truncate d0/f4 1789716 0 2024-04-18T21:06:57.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/181: creat d0/dc/f32 x:0 0 0 2024-04-18T21:06:57.695 INFO:tasks.workunit.client.0.smithi096.stdout:7/108: write d0/f14 [1441874,13687] 0 2024-04-18T21:06:57.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/182: readlink d0/dc/l2d 0 2024-04-18T21:06:57.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/183: rmdir d0/d8 39 2024-04-18T21:06:57.696 INFO:tasks.workunit.client.0.smithi096.stdout:7/109: mknod d0/d7/d8/c19 0 2024-04-18T21:06:57.696 INFO:tasks.workunit.client.0.smithi096.stdout:7/110: creat d0/d7/d8/f1a x:0 0 0 2024-04-18T21:06:57.701 INFO:tasks.workunit.client.0.smithi096.stdout:9/184: dwrite d0/d8/f1c [0,4194304] 0 2024-04-18T21:06:57.703 INFO:tasks.workunit.client.0.smithi096.stdout:9/185: symlink d0/d8/l33 0 2024-04-18T21:06:57.704 INFO:tasks.workunit.client.0.smithi096.stdout:7/111: truncate d0/d7/ff 2098883 0 2024-04-18T21:06:57.705 INFO:tasks.workunit.client.0.smithi096.stdout:7/112: chown d0/f14 173711563 1 2024-04-18T21:06:57.709 INFO:tasks.workunit.client.0.smithi096.stdout:6/111: sync 2024-04-18T21:06:57.709 INFO:tasks.workunit.client.0.smithi096.stdout:7/113: dwrite d0/d7/fe [0,4194304] 0 2024-04-18T21:06:57.709 INFO:tasks.workunit.client.0.smithi096.stdout:1/103: write d0/df/f1c [2719854,41710] 0 2024-04-18T21:06:57.710 INFO:tasks.workunit.client.0.smithi096.stdout:6/112: rmdir d1/d6/d19 0 2024-04-18T21:06:57.710 INFO:tasks.workunit.client.0.smithi096.stdout:7/114: write d0/fc [1505952,80750] 0 2024-04-18T21:06:57.715 INFO:tasks.workunit.client.0.smithi096.stdout:6/113: dwrite d1/f14 [0,4194304] 0 2024-04-18T21:06:57.719 INFO:tasks.workunit.client.0.smithi096.stdout:1/104: dread d0/df/f1a [0,4194304] 0 2024-04-18T21:06:57.719 INFO:tasks.workunit.client.0.smithi096.stdout:0/119: dread d1/f12 [0,4194304] 0 2024-04-18T21:06:57.720 INFO:tasks.workunit.client.0.smithi096.stdout:1/105: fdatasync d0/df/d16/f19 0 2024-04-18T21:06:57.721 INFO:tasks.workunit.client.0.smithi096.stdout:0/120: rename d1/d1c/d1e/l22 to d1/l29 0 2024-04-18T21:06:57.722 INFO:tasks.workunit.client.0.smithi096.stdout:6/114: dwrite d1/f14 [0,4194304] 0 2024-04-18T21:06:57.723 INFO:tasks.workunit.client.0.smithi096.stdout:0/121: truncate d1/d1c/d21/f1d 409678 0 2024-04-18T21:06:57.724 INFO:tasks.workunit.client.0.smithi096.stdout:7/115: dwrite d0/d7/ff [0,4194304] 0 2024-04-18T21:06:57.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/106: dread d0/f6 [0,4194304] 0 2024-04-18T21:06:57.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/107: write d0/df/d16/f1b [200915,35784] 0 2024-04-18T21:06:57.727 INFO:tasks.workunit.client.0.smithi096.stdout:1/108: mkdir d0/df/d16/d24 0 2024-04-18T21:06:57.727 INFO:tasks.workunit.client.0.smithi096.stdout:0/122: dread d1/f2 [0,4194304] 0 2024-04-18T21:06:57.728 INFO:tasks.workunit.client.0.smithi096.stdout:1/109: creat d0/df/d16/d24/f25 x:0 0 0 2024-04-18T21:06:57.729 INFO:tasks.workunit.client.0.smithi096.stdout:7/116: dread d0/d7/fe [0,4194304] 0 2024-04-18T21:06:57.729 INFO:tasks.workunit.client.0.smithi096.stdout:6/115: dwrite d1/d5/f15 [0,4194304] 0 2024-04-18T21:06:57.729 INFO:tasks.workunit.client.0.smithi096.stdout:0/123: rename d1/d1c/d21/l1a to d1/l2a 0 2024-04-18T21:06:57.730 INFO:tasks.workunit.client.0.smithi096.stdout:1/110: mknod d0/df/d16/d24/c26 0 2024-04-18T21:06:57.730 INFO:tasks.workunit.client.0.smithi096.stdout:6/116: rmdir d1/d17 39 2024-04-18T21:06:57.730 INFO:tasks.workunit.client.0.smithi096.stdout:0/124: symlink d1/d23/l2b 0 2024-04-18T21:06:57.730 INFO:tasks.workunit.client.0.smithi096.stdout:6/117: read d1/d5/ff [3752074,39096] 0 2024-04-18T21:06:57.731 INFO:tasks.workunit.client.0.smithi096.stdout:1/111: rename d0/df/d11 to d0/d27 0 2024-04-18T21:06:57.731 INFO:tasks.workunit.client.0.smithi096.stdout:0/125: mknod d1/db/d25/c2c 0 2024-04-18T21:06:57.731 INFO:tasks.workunit.client.0.smithi096.stdout:6/118: dread - d1/d17/f18 zero size 2024-04-18T21:06:57.731 INFO:tasks.workunit.client.0.smithi096.stdout:1/112: mknod d0/df/d16/d24/c28 0 2024-04-18T21:06:57.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/119: symlink d1/d17/l1f 0 2024-04-18T21:06:57.732 INFO:tasks.workunit.client.0.smithi096.stdout:0/126: creat d1/f2d x:0 0 0 2024-04-18T21:06:57.733 INFO:tasks.workunit.client.0.smithi096.stdout:1/113: dread d0/df/d16/f1b [0,4194304] 0 2024-04-18T21:06:57.734 INFO:tasks.workunit.client.0.smithi096.stdout:1/114: mknod d0/df/d16/d24/c29 0 2024-04-18T21:06:57.734 INFO:tasks.workunit.client.0.smithi096.stdout:1/115: readlink d0/l1e 0 2024-04-18T21:06:57.735 INFO:tasks.workunit.client.0.smithi096.stdout:1/116: chown d0/d27/l20 56 1 2024-04-18T21:06:57.736 INFO:tasks.workunit.client.0.smithi096.stdout:6/120: dread d1/d5/ff [0,4194304] 0 2024-04-18T21:06:57.736 INFO:tasks.workunit.client.0.smithi096.stdout:1/117: creat d0/df/f2a x:0 0 0 2024-04-18T21:06:57.737 INFO:tasks.workunit.client.0.smithi096.stdout:1/118: write d0/f13 [7357416,103030] 0 2024-04-18T21:06:57.738 INFO:tasks.workunit.client.0.smithi096.stdout:0/127: dwrite d1/d1c/d21/f9 [0,4194304] 0 2024-04-18T21:06:57.738 INFO:tasks.workunit.client.0.smithi096.stdout:0/128: read - d1/f2d zero size 2024-04-18T21:06:57.739 INFO:tasks.workunit.client.0.smithi096.stdout:0/129: dread d1/f2 [0,4194304] 0 2024-04-18T21:06:57.742 INFO:tasks.workunit.client.0.smithi096.stdout:7/117: truncate d0/f14 2812532 0 2024-04-18T21:06:57.742 INFO:tasks.workunit.client.0.smithi096.stdout:7/118: readlink d0/d7/l13 0 2024-04-18T21:06:57.742 INFO:tasks.workunit.client.0.smithi096.stdout:7/119: chown d0 4 1 2024-04-18T21:06:57.743 INFO:tasks.workunit.client.0.smithi096.stdout:7/120: mknod d0/d11/d18/c1b 0 2024-04-18T21:06:57.745 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:11004 4.29 4:95ba8783:::100000031be.00000000:head [write 0~4194304 [2@2098883] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.730685+0000", 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.017121460000000002, 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017150805000000002, 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11004 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.730685+0000", 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.730685+0000", 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.730686+0000", 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.189e-06 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736130+0000", 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054440909999999999 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736143+0000", 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2527999999999999e-05 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736149+0000", 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1670000000000004e-06 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736197+0000", 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7951999999999998e-05 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736259+0000", 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2620999999999996e-05 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736355+0000", 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6000000000000002e-05 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.740708+0000", 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043527289999999996 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:11009 4.26 4:641e23f3:::10000003132.00000000:head [write 0~4194304 [2@2981562] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.736167+0000", 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011639442, 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011720727, 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11009 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736167+0000", 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736167+0000", 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.736168+0000", 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7300000000000005e-07 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.739953+0000", 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003785395 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.739971+0000", 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8102e-05 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.739980+0000", 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0019999999999995e-06 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.740054+0000", 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3479000000000006e-05 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.740135+0000", 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0809999999999994e-05 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.740247+0000", 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112558 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.745454+0000", 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052064650000000004 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:11012 4.1b 4:daad7050:::100000031a1.00000001:head [write 3163112~103030 in=103030b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.741014+0000", 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0067922010000000003, 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069177309999999999, 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11012 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741014+0000", 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741014+0000", 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741016+0000", 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5990000000000001e-06 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741150+0000", 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133912 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741161+0000", 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1537e-05 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741167+0000", 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6230000000000002e-06 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741234+0000", 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7349999999999997e-05 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741312+0000", 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7441999999999995e-05 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.741406+0000", 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3950999999999995e-05 2024-04-18T21:06:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.742572+0000", 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001165997 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 3 2024-04-18T21:06:57.759 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:7/121: dwrite d0/d7/d8/f16 [0,4194304] 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:1/119: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:6/121: dwrite d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:7/122: read d0/d7/ff [164119,113489] 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:1/120: creat d0/df/d16/d24/f2b x:0 0 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:0/130: write d1/db/d25/f28 [926368,91745] 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:0/131: fdatasync d1/f2 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:1/121: unlink d0/df/c23 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:1/122: read d0/f4 [1890304,48520] 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:7/123: rename d0/f14 to d0/d7/d8/f1c 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:1/123: readlink d0/df/l21 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:0/132: link d1/f15 d1/d1c/d1e/f2e 0 2024-04-18T21:06:57.762 INFO:tasks.workunit.client.0.smithi096.stdout:7/124: write d0/d7/ff [1768719,84422] 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:7/125: fsync d0/d7/d8/f1a 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:0/133: link d1/l2a d1/d1c/l2f 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:7/126: rmdir d0/d7 39 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:7/127: creat d0/f1d x:0 0 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:7/128: fdatasync d0/d7/d8/f1a 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:0/134: read d1/d1c/d21/fa [155814,426] 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:7/129: write d0/d11/f17 [272496,86535] 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/122: dwrite d1/d5/ff [0,4194304] 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/123: creat d1/d5/d7/f20 x:0 0 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:1/124: dread d0/f17 [0,4194304] 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/124: readlink d1/ld 0 2024-04-18T21:06:57.763 INFO:tasks.workunit.client.0.smithi096.stdout:1/125: mknod d0/df/d16/d24/c2c 0 2024-04-18T21:06:57.764 INFO:tasks.workunit.client.0.smithi096.stdout:1/126: write d0/f4 [1564706,39881] 0 2024-04-18T21:06:57.764 INFO:tasks.workunit.client.0.smithi096.stdout:1/127: creat d0/df/d16/f2d x:0 0 0 2024-04-18T21:06:57.764 INFO:tasks.workunit.client.0.smithi096.stdout:1/128: write d0/f17 [745630,66473] 0 2024-04-18T21:06:57.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:57.767 INFO:tasks.workunit.client.0.smithi096.stdout:6/125: dwrite d1/d17/f18 [0,4194304] 0 2024-04-18T21:06:57.767 INFO:tasks.workunit.client.0.smithi096.stdout:6/126: creat d1/d5/da/f21 x:0 0 0 2024-04-18T21:06:57.769 INFO:tasks.workunit.client.0.smithi096.stdout:0/135: truncate d1/d1c/d21/f9 2508989 0 2024-04-18T21:06:57.770 INFO:tasks.workunit.client.0.smithi096.stdout:0/136: getdents d1/d23 0 2024-04-18T21:06:57.771 INFO:tasks.workunit.client.0.smithi096.stdout:6/127: dread d1/d6/f9 [4194304,4194304] 0 2024-04-18T21:06:57.771 INFO:tasks.workunit.client.0.smithi096.stdout:6/128: symlink d1/d5/l22 0 2024-04-18T21:06:57.775 INFO:tasks.workunit.client.0.smithi096.stdout:0/137: dwrite d1/f2 [0,4194304] 0 2024-04-18T21:06:57.777 INFO:tasks.workunit.client.0.smithi096.stdout:0/138: mkdir d1/db/d30 0 2024-04-18T21:06:57.777 INFO:tasks.workunit.client.0.smithi096.stdout:0/139: unlink d1/db/d25/c2c 0 2024-04-18T21:06:57.778 INFO:tasks.workunit.client.0.smithi096.stdout:6/129: truncate d1/d6/f9 3473987 0 2024-04-18T21:06:57.778 INFO:tasks.workunit.client.0.smithi096.stdout:8/137: sync 2024-04-18T21:06:57.778 INFO:tasks.workunit.client.0.smithi096.stdout:2/289: sync 2024-04-18T21:06:57.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/117: sync 2024-04-18T21:06:57.778 INFO:tasks.workunit.client.0.smithi096.stdout:0/140: write d1/d1c/d21/fe [560114,8082] 0 2024-04-18T21:06:57.779 INFO:tasks.workunit.client.0.smithi096.stdout:3/118: chown d4/d6/l17 488718816 1 2024-04-18T21:06:57.779 INFO:tasks.workunit.client.0.smithi096.stdout:2/290: chown d11/d13/d1a/d1e/d28/f3e 2582115 1 2024-04-18T21:06:57.779 INFO:tasks.workunit.client.0.smithi096.stdout:8/138: mknod d0/d3/d14/d33/c35 0 2024-04-18T21:06:57.780 INFO:tasks.workunit.client.0.smithi096.stdout:0/141: rename d1/d1c/d1e to d1/db/d30/d31 0 2024-04-18T21:06:57.780 INFO:tasks.workunit.client.0.smithi096.stdout:8/139: creat d0/d3/db/f36 x:0 0 0 2024-04-18T21:06:57.780 INFO:tasks.workunit.client.0.smithi096.stdout:0/142: unlink d1/db/d30/d31/f2e 0 2024-04-18T21:06:57.780 INFO:tasks.workunit.client.0.smithi096.stdout:2/291: link d11/l48 d11/d13/d1a/d1e/d28/d4e/l5a 0 2024-04-18T21:06:57.781 INFO:tasks.workunit.client.0.smithi096.stdout:2/292: mkdir d11/d50/d5b 0 2024-04-18T21:06:57.781 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:57.781+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:57.782 INFO:tasks.workunit.client.0.smithi096.stdout:2/293: mkdir d11/d13/d1a/d1e/d28/d4e/d5c 0 2024-04-18T21:06:57.782 INFO:tasks.workunit.client.0.smithi096.stdout:3/119: dread d4/d8/fa [0,4194304] 0 2024-04-18T21:06:57.783 INFO:tasks.workunit.client.0.smithi096.stdout:3/120: write d4/fe [895014,112301] 0 2024-04-18T21:06:57.783 INFO:tasks.workunit.client.0.smithi096.stdout:3/121: read d4/d8/f9 [3115980,73838] 0 2024-04-18T21:06:57.787 INFO:tasks.workunit.client.0.smithi096.stdout:2/294: dwrite d11/f19 [0,4194304] 0 2024-04-18T21:06:57.787 INFO:tasks.workunit.client.0.smithi096.stdout:6/130: fsync d1/d6/f9 0 2024-04-18T21:06:57.788 INFO:tasks.workunit.client.0.smithi096.stdout:0/143: getdents d1/db/d30/d31 0 2024-04-18T21:06:57.789 INFO:tasks.workunit.client.0.smithi096.stdout:6/131: stat d1/d5/d7/f20 0 2024-04-18T21:06:57.789 INFO:tasks.workunit.client.0.smithi096.stdout:8/140: truncate d0/d3/d14/d1b/f25 353209 0 2024-04-18T21:06:57.789 INFO:tasks.workunit.client.0.smithi096.stdout:0/144: mkdir d1/d23/d32 0 2024-04-18T21:06:57.790 INFO:tasks.workunit.client.0.smithi096.stdout:6/132: dread - d1/d5/da/f21 zero size 2024-04-18T21:06:57.790 INFO:tasks.workunit.client.0.smithi096.stdout:3/122: dwrite d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:57.792 INFO:tasks.workunit.client.0.smithi096.stdout:8/141: mknod d0/d3/d1d/d2c/c37 0 2024-04-18T21:06:57.792 INFO:tasks.workunit.client.0.smithi096.stdout:0/145: mknod d1/db/d30/c33 0 2024-04-18T21:06:57.792 INFO:tasks.workunit.client.0.smithi096.stdout:3/123: creat d4/d8/f1f x:0 0 0 2024-04-18T21:06:57.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/295: dread d11/d13/d1d/f45 [0,4194304] 0 2024-04-18T21:06:57.793 INFO:tasks.workunit.client.0.smithi096.stdout:6/133: creat d1/f23 x:0 0 0 2024-04-18T21:06:57.793 INFO:tasks.workunit.client.0.smithi096.stdout:3/124: dread - d4/d8/f1f zero size 2024-04-18T21:06:57.793 INFO:tasks.workunit.client.0.smithi096.stdout:0/146: chown d1/d1c/d21/fa 2 1 2024-04-18T21:06:57.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/296: mkdir d11/d13/d1d/d5d 0 2024-04-18T21:06:57.794 INFO:tasks.workunit.client.0.smithi096.stdout:2/297: symlink d11/d50/d5b/l5e 0 2024-04-18T21:06:57.794 INFO:tasks.workunit.client.0.smithi096.stdout:6/134: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:57.794 INFO:tasks.workunit.client.0.smithi096.stdout:0/147: dread d1/db/f1b [0,4194304] 0 2024-04-18T21:06:57.794 INFO:tasks.workunit.client.0.smithi096.stdout:2/298: write f1 [4005802,38370] 0 2024-04-18T21:06:57.795 INFO:tasks.workunit.client.0.smithi096.stdout:6/135: write d1/f23 [853898,27149] 0 2024-04-18T21:06:57.795 INFO:tasks.workunit.client.0.smithi096.stdout:6/136: symlink d1/d5/da/l24 0 2024-04-18T21:06:57.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/299: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/f5f x:0 0 0 2024-04-18T21:06:57.796 INFO:tasks.workunit.client.0.smithi096.stdout:6/137: mknod d1/d5/c25 0 2024-04-18T21:06:57.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/300: rmdir d11 39 2024-04-18T21:06:57.797 INFO:tasks.workunit.client.0.smithi096.stdout:8/142: unlink d0/d3/d14/d1b/f25 0 2024-04-18T21:06:57.797 INFO:tasks.workunit.client.0.smithi096.stdout:6/138: rename d1/d5/d7 to d1/d6/d26 0 2024-04-18T21:06:57.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/143: write d0/d3/db/f15 [2111025,33344] 0 2024-04-18T21:06:57.798 INFO:tasks.workunit.client.0.smithi096.stdout:6/139: mknod d1/d5/c27 0 2024-04-18T21:06:57.798 INFO:tasks.workunit.client.0.smithi096.stdout:2/301: rename d11/d13/f3f to d11/d13/d1a/d1e/d28/d4e/d40/f60 0 2024-04-18T21:06:57.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/144: fdatasync d0/f12 0 2024-04-18T21:06:57.798 INFO:tasks.workunit.client.0.smithi096.stdout:6/140: rename d1/ld to d1/d6/l28 0 2024-04-18T21:06:57.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/302: creat d11/f61 x:0 0 0 2024-04-18T21:06:57.799 INFO:tasks.workunit.client.0.smithi096.stdout:6/141: creat d1/d6/d26/f29 x:0 0 0 2024-04-18T21:06:57.800 INFO:tasks.workunit.client.0.smithi096.stdout:6/142: creat d1/d5/da/f2a x:0 0 0 2024-04-18T21:06:57.800 INFO:tasks.workunit.client.0.smithi096.stdout:2/303: rename d11/f37 to d11/d13/d1a/d1e/d28/d4e/f62 0 2024-04-18T21:06:57.800 INFO:tasks.workunit.client.0.smithi096.stdout:6/143: mknod d1/d5/da/c2b 0 2024-04-18T21:06:57.801 INFO:tasks.workunit.client.0.smithi096.stdout:6/144: fdatasync d1/f1c 0 2024-04-18T21:06:57.801 INFO:tasks.workunit.client.0.smithi096.stdout:2/304: write d11/d13/d1a/d1e/d28/d4e/d40/f49 [1047577,95855] 0 2024-04-18T21:06:57.802 INFO:tasks.workunit.client.0.smithi096.stdout:2/305: mkdir d11/d13/d1a/d1e/d28/d4e/d63 0 2024-04-18T21:06:57.803 INFO:tasks.workunit.client.0.smithi096.stdout:2/306: unlink d11/d13/f46 0 2024-04-18T21:06:57.804 INFO:tasks.workunit.client.0.smithi096.stdout:3/125: dwrite d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:57.805 INFO:tasks.workunit.client.0.smithi096.stdout:3/126: write d4/d8/fa [3460074,103481] 0 2024-04-18T21:06:57.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/307: creat d11/d13/d1a/d1e/d28/d4e/d40/f64 x:0 0 0 2024-04-18T21:06:57.806 INFO:tasks.workunit.client.0.smithi096.stdout:3/127: chown d4/d6/d7/lc 1156210372 1 2024-04-18T21:06:57.807 INFO:tasks.workunit.client.0.smithi096.stdout:2/308: dread - d11/d13/d1a/d1e/d28/f59 zero size 2024-04-18T21:06:57.807 INFO:tasks.workunit.client.0.smithi096.stdout:3/128: mkdir d4/d8/d1c/d20 0 2024-04-18T21:06:57.808 INFO:tasks.workunit.client.0.smithi096.stdout:2/309: fdatasync d11/d13/d1a/d1e/d28/d4e/d40/f49 0 2024-04-18T21:06:57.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/145: dwrite d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:57.809 INFO:tasks.workunit.client.0.smithi096.stdout:3/129: rename d4/d8/ff to d4/d8/d1c/f21 0 2024-04-18T21:06:57.809 INFO:tasks.workunit.client.0.smithi096.stdout:6/146: write d1/d5/da/f21 [195079,95744] 0 2024-04-18T21:06:57.810 INFO:tasks.workunit.client.0.smithi096.stdout:6/147: creat d1/d5/f2c x:0 0 0 2024-04-18T21:06:57.812 INFO:tasks.workunit.client.0.smithi096.stdout:6/148: truncate d1/f3 373986 0 2024-04-18T21:06:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:3/130: dread d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:2/310: dread d11/d13/f2d [0,4194304] 0 2024-04-18T21:06:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:6/149: getdents d1/d6 0 2024-04-18T21:06:57.814 INFO:tasks.workunit.client.0.smithi096.stdout:6/150: symlink d1/d5/da/l2d 0 2024-04-18T21:06:57.814 INFO:tasks.workunit.client.0.smithi096.stdout:6/151: chown d1/d6/l28 211 1 2024-04-18T21:06:57.814 INFO:tasks.workunit.client.0.smithi096.stdout:2/311: creat d11/d13/d1a/d1e/d28/d4e/d63/f65 x:0 0 0 2024-04-18T21:06:57.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/312: rmdir d11/d50/d5b 39 2024-04-18T21:06:57.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/313: unlink d11/d13/d1d/l43 0 2024-04-18T21:06:57.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/314: fdatasync d11/d13/f2f 0 2024-04-18T21:06:57.816 INFO:tasks.workunit.client.0.smithi096.stdout:3/131: rename d4/d8/d1c to d4/d6/d22 0 2024-04-18T21:06:57.817 INFO:tasks.workunit.client.0.smithi096.stdout:6/152: dread d1/d5/da/f21 [0,4194304] 0 2024-04-18T21:06:57.817 INFO:tasks.workunit.client.0.smithi096.stdout:3/132: symlink d4/d6/l23 0 2024-04-18T21:06:57.817 INFO:tasks.workunit.client.0.smithi096.stdout:8/145: dread d0/d3/fd [0,4194304] 0 2024-04-18T21:06:57.818 INFO:tasks.workunit.client.0.smithi096.stdout:6/153: truncate d1/d5/da/f2a 268819 0 2024-04-18T21:06:57.818 INFO:tasks.workunit.client.0.smithi096.stdout:8/146: rmdir d0/d3/d14 39 2024-04-18T21:06:57.819 INFO:tasks.workunit.client.0.smithi096.stdout:0/148: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:57.819 INFO:tasks.workunit.client.0.smithi096.stdout:8/147: symlink d0/d3/d1d/d2c/l38 0 2024-04-18T21:06:57.819 INFO:tasks.workunit.client.0.smithi096.stdout:0/149: chown d1/d23 2547 1 2024-04-18T21:06:57.820 INFO:tasks.workunit.client.0.smithi096.stdout:0/150: stat d1/db/l18 0 2024-04-18T21:06:57.820 INFO:tasks.workunit.client.0.smithi096.stdout:2/315: dread d11/f16 [0,4194304] 0 2024-04-18T21:06:57.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/148: dread - d0/d3/d14/f31 zero size 2024-04-18T21:06:57.820 INFO:tasks.workunit.client.0.smithi096.stdout:6/154: read d1/d6/f9 [2234166,43187] 0 2024-04-18T21:06:57.821 INFO:tasks.workunit.client.0.smithi096.stdout:6/155: truncate d1/d5/f1a 4733082 0 2024-04-18T21:06:57.821 INFO:tasks.workunit.client.0.smithi096.stdout:8/149: unlink d0/d3/d14/d33/c35 0 2024-04-18T21:06:57.821 INFO:tasks.workunit.client.0.smithi096.stdout:0/151: rename d1/l17 to d1/d1c/d21/l34 0 2024-04-18T21:06:57.821 INFO:tasks.workunit.client.0.smithi096.stdout:3/133: dread d4/d8/fa [0,4194304] 0 2024-04-18T21:06:57.822 INFO:tasks.workunit.client.0.smithi096.stdout:8/150: dread - d0/d3/db/f36 zero size 2024-04-18T21:06:57.822 INFO:tasks.workunit.client.0.smithi096.stdout:6/156: mkdir d1/d5/d2e 0 2024-04-18T21:06:57.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/316: rename d11/d13/d1a/d1e/f54 to d11/d13/d1a/d1e/d28/d4e/d40/d51/f66 0 2024-04-18T21:06:57.822 INFO:tasks.workunit.client.0.smithi096.stdout:3/134: write d4/d8/f9 [675124,43210] 0 2024-04-18T21:06:57.823 INFO:tasks.workunit.client.0.smithi096.stdout:6/157: creat d1/d17/f2f x:0 0 0 2024-04-18T21:06:57.823 INFO:tasks.workunit.client.0.smithi096.stdout:6/158: chown d1/f13 3084460 1 2024-04-18T21:06:57.823 INFO:tasks.workunit.client.0.smithi096.stdout:2/317: write d11/d13/d1a/d1e/d28/d4e/d63/f65 [804292,20899] 0 2024-04-18T21:06:57.824 INFO:tasks.workunit.client.0.smithi096.stdout:2/318: rmdir d11/d13 39 2024-04-18T21:06:57.824 INFO:tasks.workunit.client.0.smithi096.stdout:6/159: write d1/d6/d26/f29 [518570,70841] 0 2024-04-18T21:06:57.825 INFO:tasks.workunit.client.0.smithi096.stdout:2/319: unlink d11/d13/d1a/d1e/f24 0 2024-04-18T21:06:57.825 INFO:tasks.workunit.client.0.smithi096.stdout:6/160: creat d1/f30 x:0 0 0 2024-04-18T21:06:57.825 INFO:tasks.workunit.client.0.smithi096.stdout:0/152: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:57.825 INFO:tasks.workunit.client.0.smithi096.stdout:0/153: mkdir d1/d1c/d35 0 2024-04-18T21:06:57.826 INFO:tasks.workunit.client.0.smithi096.stdout:0/154: chown d1/db 35939040 1 2024-04-18T21:06:57.826 INFO:tasks.workunit.client.0.smithi096.stdout:2/320: link d11/d50/d5b/l5e d11/l67 0 2024-04-18T21:06:57.826 INFO:tasks.workunit.client.0.smithi096.stdout:3/135: dread d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:57.827 INFO:tasks.workunit.client.0.smithi096.stdout:2/321: creat d11/d13/d1a/d1e/f68 x:0 0 0 2024-04-18T21:06:57.827 INFO:tasks.workunit.client.0.smithi096.stdout:3/136: creat d4/d6/d1b/d1d/f24 x:0 0 0 2024-04-18T21:06:57.828 INFO:tasks.workunit.client.0.smithi096.stdout:3/137: read d4/d6/d22/f21 [156630,117392] 0 2024-04-18T21:06:57.829 INFO:tasks.workunit.client.0.smithi096.stdout:2/322: rmdir d11/d13/d1a/d1e/d28/d4e/d40/d51 39 2024-04-18T21:06:57.829 INFO:tasks.workunit.client.0.smithi096.stdout:6/161: dread d1/d5/f15 [0,4194304] 0 2024-04-18T21:06:57.829 INFO:tasks.workunit.client.0.smithi096.stdout:3/138: mknod d4/d8/c25 0 2024-04-18T21:06:57.829 INFO:tasks.workunit.client.0.smithi096.stdout:2/323: write d11/d13/d1d/f2a [407185,22027] 0 2024-04-18T21:06:57.830 INFO:tasks.workunit.client.0.smithi096.stdout:6/162: mknod d1/d5/c31 0 2024-04-18T21:06:57.830 INFO:tasks.workunit.client.0.smithi096.stdout:3/139: stat d4/d6/d7/c14 0 2024-04-18T21:06:57.831 INFO:tasks.workunit.client.0.smithi096.stdout:6/163: unlink d1/d5/da/l2d 0 2024-04-18T21:06:57.831 INFO:tasks.workunit.client.0.smithi096.stdout:2/324: unlink d11/d13/d1a/d1e/d28/d4e/d40/l4d 0 2024-04-18T21:06:57.831 INFO:tasks.workunit.client.0.smithi096.stdout:3/140: write d4/d8/f1f [477787,94483] 0 2024-04-18T21:06:57.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/325: write d11/d13/d1a/d1e/f68 [478896,114048] 0 2024-04-18T21:06:57.834 INFO:tasks.workunit.client.0.smithi096.stdout:3/141: rename d4/d6/d7/lc to d4/d8/l26 0 2024-04-18T21:06:57.834 INFO:tasks.workunit.client.0.smithi096.stdout:0/155: dwrite d1/d1c/d21/fd [0,4194304] 0 2024-04-18T21:06:57.835 INFO:tasks.workunit.client.0.smithi096.stdout:6/164: dread d1/d5/ff [0,4194304] 0 2024-04-18T21:06:57.837 INFO:tasks.workunit.client.0.smithi096.stdout:3/142: rename d4/d8/c25 to d4/d6/d22/d20/c27 0 2024-04-18T21:06:57.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/326: write f2 [721713,27398] 0 2024-04-18T21:06:57.841 INFO:tasks.workunit.client.0.smithi096.stdout:2/327: chown d11/d13/d1a/d1e/d28/d4e/d40/d51/d57 48295 1 2024-04-18T21:06:57.841 INFO:tasks.workunit.client.0.smithi096.stdout:0/156: dwrite d1/db/f1b [0,4194304] 0 2024-04-18T21:06:57.841 INFO:tasks.workunit.client.0.smithi096.stdout:4/136: sync 2024-04-18T21:06:57.841 INFO:tasks.workunit.client.0.smithi096.stdout:5/84: sync 2024-04-18T21:06:57.841 INFO:tasks.workunit.client.0.smithi096.stdout:1/129: sync 2024-04-18T21:06:57.842 INFO:tasks.workunit.client.0.smithi096.stdout:0/157: creat d1/d23/f36 x:0 0 0 2024-04-18T21:06:57.843 INFO:tasks.workunit.client.0.smithi096.stdout:4/137: fdatasync d2/d1d/f17 0 2024-04-18T21:06:57.843 INFO:tasks.workunit.client.0.smithi096.stdout:2/328: mknod d11/d13/d1a/d1e/d28/d4e/c69 0 2024-04-18T21:06:57.843 INFO:tasks.workunit.client.0.smithi096.stdout:1/130: creat d0/df/f2e x:0 0 0 2024-04-18T21:06:57.843 INFO:tasks.workunit.client.0.smithi096.stdout:4/138: symlink d2/d1d/l2b 0 2024-04-18T21:06:57.844 INFO:tasks.workunit.client.0.smithi096.stdout:3/143: dwrite d4/d8/fb [0,4194304] 0 2024-04-18T21:06:57.844 INFO:tasks.workunit.client.0.smithi096.stdout:0/158: chown d1/d1c/d21/f9 86430 1 2024-04-18T21:06:57.844 INFO:tasks.workunit.client.0.smithi096.stdout:2/329: mknod d11/d13/d1a/d1e/c6a 0 2024-04-18T21:06:57.844 INFO:tasks.workunit.client.0.smithi096.stdout:1/131: chown d0/d27/l20 502381131 1 2024-04-18T21:06:57.844 INFO:tasks.workunit.client.0.smithi096.stdout:3/144: stat d4/d8 0 2024-04-18T21:06:57.845 INFO:tasks.workunit.client.0.smithi096.stdout:1/132: stat d0/l22 0 2024-04-18T21:06:57.846 INFO:tasks.workunit.client.0.smithi096.stdout:6/165: truncate d1/d5/ff 3367932 0 2024-04-18T21:06:57.846 INFO:tasks.workunit.client.0.smithi096.stdout:2/330: readlink d11/l20 0 2024-04-18T21:06:57.847 INFO:tasks.workunit.client.0.smithi096.stdout:0/159: unlink d1/d1c/d21/f24 0 2024-04-18T21:06:57.847 INFO:tasks.workunit.client.0.smithi096.stdout:1/133: mknod d0/df/d16/d24/c2f 0 2024-04-18T21:06:57.847 INFO:tasks.workunit.client.0.smithi096.stdout:3/145: creat d4/d6/d1b/d1d/f28 x:0 0 0 2024-04-18T21:06:57.847 INFO:tasks.workunit.client.0.smithi096.stdout:6/166: write d1/d6/d26/f20 [667106,19653] 0 2024-04-18T21:06:57.848 INFO:tasks.workunit.client.0.smithi096.stdout:4/139: rename d2/fd to d2/f2c 0 2024-04-18T21:06:57.849 INFO:tasks.workunit.client.0.smithi096.stdout:3/146: mkdir d4/d6/d1b/d29 0 2024-04-18T21:06:57.849 INFO:tasks.workunit.client.0.smithi096.stdout:2/331: creat d11/d13/d47/f6b x:0 0 0 2024-04-18T21:06:57.849 INFO:tasks.workunit.client.0.smithi096.stdout:1/134: write d0/df/d16/f1b [427719,29093] 0 2024-04-18T21:06:57.850 INFO:tasks.workunit.client.0.smithi096.stdout:1/135: readlink d0/l22 0 2024-04-18T21:06:57.850 INFO:tasks.workunit.client.0.smithi096.stdout:5/85: dwrite d2/f16 [0,4194304] 0 2024-04-18T21:06:57.851 INFO:tasks.workunit.client.0.smithi096.stdout:5/86: write f0 [1076686,52167] 0 2024-04-18T21:06:57.852 INFO:tasks.workunit.client.0.smithi096.stdout:5/87: truncate f0 1509466 0 2024-04-18T21:06:57.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/160: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:57.853 INFO:tasks.workunit.client.0.smithi096.stdout:5/88: symlink d2/d11/l25 0 2024-04-18T21:06:57.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/161: chown d1/db/d30 51387 1 2024-04-18T21:06:57.854 INFO:tasks.workunit.client.0.smithi096.stdout:5/89: chown d2/d18/c22 34 1 2024-04-18T21:06:57.855 INFO:tasks.workunit.client.0.smithi096.stdout:0/162: rename d1/d23/f36 to d1/db/d25/f37 0 2024-04-18T21:06:57.856 INFO:tasks.workunit.client.0.smithi096.stdout:0/163: chown d1 393 1 2024-04-18T21:06:57.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/140: dwrite d2/f8 [0,4194304] 0 2024-04-18T21:06:57.858 INFO:tasks.workunit.client.0.smithi096.stdout:5/90: truncate d2/f10 2358256 0 2024-04-18T21:06:57.859 INFO:tasks.workunit.client.0.smithi096.stdout:7/130: sync 2024-04-18T21:06:57.859 INFO:tasks.workunit.client.0.smithi096.stdout:8/151: sync 2024-04-18T21:06:57.860 INFO:tasks.workunit.client.0.smithi096.stdout:9/186: sync 2024-04-18T21:06:57.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/147: dread d4/d8/fb [0,4194304] 0 2024-04-18T21:06:57.860 INFO:tasks.workunit.client.0.smithi096.stdout:1/136: dwrite d0/df/d16/d24/f25 [0,4194304] 0 2024-04-18T21:06:57.860 INFO:tasks.workunit.client.0.smithi096.stdout:5/91: symlink d2/d11/l26 0 2024-04-18T21:06:57.860 INFO:tasks.workunit.client.0.smithi096.stdout:2/332: dwrite d11/d13/d1d/f2a [0,4194304] 0 2024-04-18T21:06:57.860 INFO:tasks.workunit.client.0.smithi096.stdout:1/137: read d0/df/f1c [2070626,115074] 0 2024-04-18T21:06:57.862 INFO:tasks.workunit.client.0.smithi096.stdout:1/138: chown d0/df/d16/d24/c2f 18451435 1 2024-04-18T21:06:57.862 INFO:tasks.workunit.client.0.smithi096.stdout:3/148: symlink d4/d6/dd/l2a 0 2024-04-18T21:06:57.864 INFO:tasks.workunit.client.0.smithi096.stdout:1/139: mkdir d0/df/d30 0 2024-04-18T21:06:57.864 INFO:tasks.workunit.client.0.smithi096.stdout:7/131: dread d0/d7/ff [0,4194304] 0 2024-04-18T21:06:57.865 INFO:tasks.workunit.client.0.smithi096.stdout:3/149: rmdir d4/d6/d1b 39 2024-04-18T21:06:57.866 INFO:tasks.workunit.client.0.smithi096.stdout:1/140: creat d0/df/d16/d24/f31 x:0 0 0 2024-04-18T21:06:57.866 INFO:tasks.workunit.client.0.smithi096.stdout:7/132: creat d0/d7/d8/f1e x:0 0 0 2024-04-18T21:06:57.868 INFO:tasks.workunit.client.0.smithi096.stdout:9/187: dwrite d0/d28/d2f/f17 [8388608,4194304] 0 2024-04-18T21:06:57.868 INFO:tasks.workunit.client.0.smithi096.stdout:1/141: write d0/df/d16/f19 [758206,50922] 0 2024-04-18T21:06:57.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/167: write d1/d6/d26/fb [663565,40036] 0 2024-04-18T21:06:57.868 INFO:tasks.workunit.client.0.smithi096.stdout:1/142: stat d0/ce 0 2024-04-18T21:06:57.869 INFO:tasks.workunit.client.0.smithi096.stdout:6/168: truncate d1/d5/da/f2a 339348 0 2024-04-18T21:06:57.870 INFO:tasks.workunit.client.0.smithi096.stdout:3/150: rename d4/d8/fb to d4/d6/d1b/d1d/f2b 0 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi096.stdout:2/333: dwrite d11/f16 [4194304,4194304] 0 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi096.stdout:7/133: link d0/d11/d18/c1b d0/d11/c1f 0 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi096.stdout:6/169: dread - d1/f13 zero size 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi096.stdout:9/188: creat d0/f34 x:0 0 0 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi096.stdout:6/170: unlink d1/f23 0 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi096.stdout:7/134: write d0/d11/f17 [497496,123274] 0 2024-04-18T21:06:57.872 INFO:tasks.workunit.client.0.smithi096.stdout:6/171: chown d1/d6/l28 0 1 2024-04-18T21:06:57.872 INFO:tasks.workunit.client.0.smithi096.stdout:9/189: unlink d0/d28/d2f/f22 0 2024-04-18T21:06:57.873 INFO:tasks.workunit.client.0.smithi096.stdout:6/172: mkdir d1/d6/d32 0 2024-04-18T21:06:57.873 INFO:tasks.workunit.client.0.smithi096.stdout:7/135: write d0/d11/f17 [3334153,127875] 0 2024-04-18T21:06:57.873 INFO:tasks.workunit.client.0.smithi096.stdout:2/334: rename d11/l48 to d11/d50/d5b/l6c 0 2024-04-18T21:06:57.873 INFO:tasks.workunit.client.0.smithi096.stdout:7/136: fdatasync d0/d7/fb 0 2024-04-18T21:06:57.873 INFO:tasks.workunit.client.0.smithi096.stdout:2/335: write fb [8008509,54521] 0 2024-04-18T21:06:57.874 INFO:tasks.workunit.client.0.smithi096.stdout:1/143: dread d0/f6 [0,4194304] 0 2024-04-18T21:06:57.874 INFO:tasks.workunit.client.0.smithi096.stdout:9/190: link d0/d8/d9/c13 d0/d28/c35 0 2024-04-18T21:06:57.874 INFO:tasks.workunit.client.0.smithi096.stdout:6/173: creat d1/f33 x:0 0 0 2024-04-18T21:06:57.875 INFO:tasks.workunit.client.0.smithi096.stdout:7/137: mkdir d0/d20 0 2024-04-18T21:06:57.875 INFO:tasks.workunit.client.0.smithi096.stdout:1/144: mkdir d0/df/d16/d32 0 2024-04-18T21:06:57.875 INFO:tasks.workunit.client.0.smithi096.stdout:6/174: fdatasync d1/d6/d26/fe 0 2024-04-18T21:06:57.876 INFO:tasks.workunit.client.0.smithi096.stdout:7/138: read d0/d7/d8/f16 [680235,62178] 0 2024-04-18T21:06:57.876 INFO:tasks.workunit.client.0.smithi096.stdout:6/175: stat d1/d17/f2f 0 2024-04-18T21:06:57.876 INFO:tasks.workunit.client.0.smithi096.stdout:1/145: mkdir d0/d27/d33 0 2024-04-18T21:06:57.876 INFO:tasks.workunit.client.0.smithi096.stdout:2/336: write d11/d13/d1a/d1e/d28/d4e/d40/f4c [68398,72137] 0 2024-04-18T21:06:57.877 INFO:tasks.workunit.client.0.smithi096.stdout:7/139: dread - d0/d7/d8/f1a zero size 2024-04-18T21:06:57.877 INFO:tasks.workunit.client.0.smithi096.stdout:1/146: dread - d0/df/d16/f2d zero size 2024-04-18T21:06:57.878 INFO:tasks.workunit.client.0.smithi096.stdout:7/140: dread - d0/d7/d8/f1a zero size 2024-04-18T21:06:57.878 INFO:tasks.workunit.client.0.smithi096.stdout:3/151: dwrite d4/d6/d22/f21 [4194304,4194304] 0 2024-04-18T21:06:57.882 INFO:tasks.workunit.client.0.smithi096.stdout:1/147: mkdir d0/df/d34 0 2024-04-18T21:06:57.882 INFO:tasks.workunit.client.0.smithi096.stdout:9/191: dwrite d0/d8/f1c [4194304,4194304] 0 2024-04-18T21:06:57.882 INFO:tasks.workunit.client.0.smithi096.stdout:2/337: rename d11/d13/d47 to d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d 0 2024-04-18T21:06:57.882 INFO:tasks.workunit.client.0.smithi096.stdout:7/141: rename d0/d11 to d0/d11/d18/d21 22 2024-04-18T21:06:57.883 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:57.883+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:57.883 INFO:tasks.workunit.client.0.smithi096.stdout:9/192: dread - d0/dc/f32 zero size 2024-04-18T21:06:57.883 INFO:tasks.workunit.client.0.smithi096.stdout:7/142: mknod d0/d11/d18/c22 0 2024-04-18T21:06:57.884 INFO:tasks.workunit.client.0.smithi096.stdout:1/148: rmdir d0/df/d34 0 2024-04-18T21:06:57.884 INFO:tasks.workunit.client.0.smithi096.stdout:2/338: rename d11/d13/d1a/d1e/d28/l36 to d11/d13/d1d/d5d/l6e 0 2024-04-18T21:06:57.884 INFO:tasks.workunit.client.0.smithi096.stdout:9/193: write d0/dc/d18/f27 [2170859,64120] 0 2024-04-18T21:06:57.885 INFO:tasks.workunit.client.0.smithi096.stdout:9/194: chown d0/d8/cb 63312636 1 2024-04-18T21:06:57.885 INFO:tasks.workunit.client.0.smithi096.stdout:7/143: write d0/d7/ff [308836,39306] 0 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi096.stdout:3/152: dwrite d4/d6/d22/f21 [4194304,4194304] 0 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi096.stdout:1/149: dread d0/df/f1a [0,4194304] 0 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi096.stdout:3/153: write d4/fe [976340,68646] 0 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi096.stdout:2/339: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f 0 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi096.stdout:7/144: mknod d0/d11/c23 0 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi096.stdout:1/150: unlink d0/ca 0 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi096.stdout:3/154: dread - d4/d6/d1b/d1d/f28 zero size 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi096.stdout:7/145: rename d0/c10 to d0/d11/c24 0 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi096.stdout:1/151: rename d0/df/f1c to d0/df/d16/d24/f35 0 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi096.stdout:2/340: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70 0 2024-04-18T21:06:57.889 INFO:tasks.workunit.client.0.smithi096.stdout:7/146: write d0/d7/d8/f16 [331829,51582] 0 2024-04-18T21:06:57.889 INFO:tasks.workunit.client.0.smithi096.stdout:6/176: fdatasync d1/d6/d26/fb 0 2024-04-18T21:06:57.890 INFO:tasks.workunit.client.0.smithi096.stdout:2/341: rmdir d11/d13/d1a/d1e/d28/d4e/d63 39 2024-04-18T21:06:57.891 INFO:tasks.workunit.client.0.smithi096.stdout:6/177: unlink d1/d6/d26/f20 0 2024-04-18T21:06:57.891 INFO:tasks.workunit.client.0.smithi096.stdout:1/152: rename d0/d27/f14 to d0/df/f36 0 2024-04-18T21:06:57.891 INFO:tasks.workunit.client.0.smithi096.stdout:7/147: fsync d0/d7/d8/f1c 0 2024-04-18T21:06:57.892 INFO:tasks.workunit.client.0.smithi096.stdout:6/178: unlink d1/d5/da/c11 0 2024-04-18T21:06:57.893 INFO:tasks.workunit.client.0.smithi096.stdout:2/342: rename d11/d13/d1a/d1e/d28/d4e/d40/f42 to d11/d50/f71 0 2024-04-18T21:06:57.893 INFO:tasks.workunit.client.0.smithi096.stdout:7/148: truncate d0/d7/d8/f1e 353124 0 2024-04-18T21:06:57.893 INFO:tasks.workunit.client.0.smithi096.stdout:1/153: dread d0/df/f1a [0,4194304] 0 2024-04-18T21:06:57.893 INFO:tasks.workunit.client.0.smithi096.stdout:6/179: dread d1/d5/da/f21 [0,4194304] 0 2024-04-18T21:06:57.894 INFO:tasks.workunit.client.0.smithi096.stdout:3/155: dwrite d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:57.894 INFO:tasks.workunit.client.0.smithi096.stdout:7/149: symlink d0/d7/d8/l25 0 2024-04-18T21:06:57.894 INFO:tasks.workunit.client.0.smithi096.stdout:1/154: write d0/df/d16/f1b [871532,117349] 0 2024-04-18T21:06:57.895 INFO:tasks.workunit.client.0.smithi096.stdout:3/156: fdatasync d4/d6/d1b/d1d/f24 0 2024-04-18T21:06:57.895 INFO:tasks.workunit.client.0.smithi096.stdout:7/150: rename d0/d7/d8/f1c to d0/d7/d8/f26 0 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi096.stdout:1/155: rmdir d0/df/d16 39 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi096.stdout:3/157: mkdir d4/d6/d1b/d2c 0 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi096.stdout:6/180: creat d1/f34 x:0 0 0 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi096.stdout:7/151: fsync d0/d7/d8/f1e 0 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi096.stdout:3/158: rmdir d4/d6/d22 39 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi096.stdout:3/159: fsync d4/fe 0 2024-04-18T21:06:57.897 INFO:tasks.workunit.client.0.smithi096.stdout:7/152: mknod d0/c27 0 2024-04-18T21:06:57.897 INFO:tasks.workunit.client.0.smithi096.stdout:6/181: mknod d1/d5/d2e/c35 0 2024-04-18T21:06:57.904 INFO:tasks.workunit.client.0.smithi096.stdout:1/156: dwrite d0/df/d16/f19 [0,4194304] 0 2024-04-18T21:06:57.904 INFO:tasks.workunit.client.0.smithi096.stdout:3/160: symlink d4/l2d 0 2024-04-18T21:06:57.904 INFO:tasks.workunit.client.0.smithi096.stdout:1/157: chown d0/df/f1a 560506 1 2024-04-18T21:06:57.905 INFO:tasks.workunit.client.0.smithi096.stdout:1/158: chown d0/df/d16/d24/c26 61949 1 2024-04-18T21:06:57.905 INFO:tasks.workunit.client.0.smithi096.stdout:9/195: read d0/dc/f25 [350828,38523] 0 2024-04-18T21:06:57.905 INFO:tasks.workunit.client.0.smithi096.stdout:9/196: dread - d0/dc/f32 zero size 2024-04-18T21:06:57.912 INFO:tasks.workunit.client.0.smithi096.stdout:7/153: mknod d0/d7/d8/c28 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi096.stdout:6/182: rename d1/d6/d32 to d1/d5/d2e/d36 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi096.stdout:3/161: creat d4/d6/d1b/d1d/f2e x:0 0 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi096.stdout:9/197: creat d0/dc/f36 x:0 0 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi096.stdout:7/154: creat d0/d11/f29 x:0 0 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi096.stdout:6/183: truncate d1/d6/f9 3839425 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi096.stdout:9/198: truncate d0/d8/d9/f23 982741 0 2024-04-18T21:06:57.914 INFO:tasks.workunit.client.0.smithi096.stdout:6/184: read d1/f14 [184181,81305] 0 2024-04-18T21:06:57.914 INFO:tasks.workunit.client.0.smithi096.stdout:9/199: dread - d0/dc/f32 zero size 2024-04-18T21:06:57.914 INFO:tasks.workunit.client.0.smithi096.stdout:7/155: truncate d0/d7/d8/f1a 485870 0 2024-04-18T21:06:57.915 INFO:tasks.workunit.client.0.smithi096.stdout:6/185: chown d1/d5/da/f21 46965 1 2024-04-18T21:06:57.915 INFO:tasks.workunit.client.0.smithi096.stdout:7/156: read d0/d7/d8/f16 [3956361,36553] 0 2024-04-18T21:06:57.915 INFO:tasks.workunit.client.0.smithi096.stdout:6/186: mknod d1/c37 0 2024-04-18T21:06:57.916 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:06:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:06:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:06:57.917 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:57.917 INFO:tasks.workunit.client.0.smithi096.stdout:7/157: write d0/d7/d8/f26 [1197502,10817] 0 2024-04-18T21:06:57.917 INFO:tasks.workunit.client.0.smithi096.stdout:6/187: mkdir d1/d38 0 2024-04-18T21:06:57.917 INFO:tasks.workunit.client.0.smithi096.stdout:8/152: sync 2024-04-18T21:06:57.918 INFO:tasks.workunit.client.0.smithi096.stdout:4/141: sync 2024-04-18T21:06:57.918 INFO:tasks.workunit.client.0.smithi096.stdout:0/164: sync 2024-04-18T21:06:57.918 INFO:tasks.workunit.client.0.smithi096.stdout:7/158: write d0/d7/d8/f1a [1273062,79546] 0 2024-04-18T21:06:57.918 INFO:tasks.workunit.client.0.smithi096.stdout:0/165: rmdir d1/d23 39 2024-04-18T21:06:57.919 INFO:tasks.workunit.client.0.smithi096.stdout:8/153: symlink d0/d3/d14/l39 0 2024-04-18T21:06:57.920 INFO:tasks.workunit.client.0.smithi096.stdout:0/166: symlink d1/d1c/l38 0 2024-04-18T21:06:57.920 INFO:tasks.workunit.client.0.smithi096.stdout:7/159: truncate d0/d7/d8/f1a 2372795 0 2024-04-18T21:06:57.920 INFO:tasks.workunit.client.0.smithi096.stdout:3/162: dwrite d4/d6/d1b/d1d/f24 [0,4194304] 0 2024-04-18T21:06:57.920 INFO:tasks.workunit.client.0.smithi096.stdout:8/154: mkdir d0/d3/d3a 0 2024-04-18T21:06:57.921 INFO:tasks.workunit.client.0.smithi096.stdout:9/200: dwrite d0/d28/d2f/f17 [0,4194304] 0 2024-04-18T21:06:57.924 INFO:tasks.workunit.client.0.smithi096.stdout:6/188: dwrite d1/d5/f15 [0,4194304] 0 2024-04-18T21:06:57.924 INFO:tasks.workunit.client.0.smithi096.stdout:3/163: unlink d4/d6/d1b/d1d/f24 0 2024-04-18T21:06:57.925 INFO:tasks.workunit.client.0.smithi096.stdout:8/155: truncate d0/f12 1802049 0 2024-04-18T21:06:57.925 INFO:tasks.workunit.client.0.smithi096.stdout:6/189: mknod d1/d5/d2e/d36/c39 0 2024-04-18T21:06:57.925 INFO:tasks.workunit.client.0.smithi096.stdout:7/160: dread d0/d7/fe [0,4194304] 0 2024-04-18T21:06:57.926 INFO:tasks.workunit.client.0.smithi096.stdout:8/156: chown d0/d3/d1d/c22 162220 1 2024-04-18T21:06:57.926 INFO:tasks.workunit.client.0.smithi096.stdout:3/164: symlink d4/d6/d1b/d1d/l2f 0 2024-04-18T21:06:57.926 INFO:tasks.workunit.client.0.smithi096.stdout:9/201: link d0/ld d0/d8/d11/l37 0 2024-04-18T21:06:57.927 INFO:tasks.workunit.client.0.smithi096.stdout:3/165: symlink d4/d6/d1b/d1d/l30 0 2024-04-18T21:06:57.928 INFO:tasks.workunit.client.0.smithi096.stdout:7/161: link d0/d7/d8/c9 d0/d7/c2a 0 2024-04-18T21:06:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:7/162: chown d0/d11/f29 34855351 1 2024-04-18T21:06:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/142: dread d2/f2c [0,4194304] 0 2024-04-18T21:06:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:7/163: fsync d0/d7/d8/f1e 0 2024-04-18T21:06:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:7/164: mknod d0/d7/c2b 0 2024-04-18T21:06:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:5/92: dread d2/f7 [0,4194304] 0 2024-04-18T21:06:57.932 INFO:tasks.workunit.client.0.smithi096.stdout:4/143: symlink d2/l2d 0 2024-04-18T21:06:57.932 INFO:tasks.workunit.client.0.smithi096.stdout:7/165: fsync d0/f1d 0 2024-04-18T21:06:57.932 INFO:tasks.workunit.client.0.smithi096.stdout:0/167: read d1/f15 [48236,77864] 0 2024-04-18T21:06:57.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:7/166: write d0/fc [2196110,85333] 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:4/144: truncate d2/d1d/f29 998368 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:5/93: getdents d2/d18 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:0/168: mkdir d1/db/d30/d31/d39 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:5/94: readlink d2/d11/l26 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/190: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:4/145: truncate d2/d1d/f29 1744438 0 2024-04-18T21:06:57.935 INFO:tasks.workunit.client.0.smithi096.stdout:0/169: mknod d1/db/c3a 0 2024-04-18T21:06:57.935 INFO:tasks.workunit.client.0.smithi096.stdout:4/146: write d2/f16 [885890,89337] 0 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi096.stdout:5/95: truncate d2/f10 2091649 0 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi096.stdout:5/96: chown d2/d18 33413783 1 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi096.stdout:4/147: creat d2/f2e x:0 0 0 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi096.stdout:4/148: stat d2/f28 0 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi096.stdout:4/149: mkdir d2/d2f 0 2024-04-18T21:06:57.937 INFO:tasks.workunit.client.0.smithi096.stdout:4/150: mknod d2/c30 0 2024-04-18T21:06:57.937 INFO:tasks.workunit.client.0.smithi096.stdout:4/151: write d2/f28 [82501,97672] 0 2024-04-18T21:06:57.939 INFO:tasks.workunit.client.0.smithi096.stdout:7/167: read d0/d7/d8/f1a [607983,124109] 0 2024-04-18T21:06:57.939 INFO:tasks.workunit.client.0.smithi096.stdout:4/152: creat d2/f31 x:0 0 0 2024-04-18T21:06:57.939 INFO:tasks.workunit.client.0.smithi096.stdout:5/97: dread d2/f7 [0,4194304] 0 2024-04-18T21:06:57.939 INFO:tasks.workunit.client.0.smithi096.stdout:7/168: rmdir d0 39 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi096.stdout:5/98: fsync d2/f1b 0 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi096.stdout:4/153: rename d2/c30 to d2/d2a/c32 0 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi096.stdout:7/169: chown d0/d11/f17 9 1 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi096.stdout:0/170: dwrite d1/d1c/d21/f16 [0,4194304] 0 2024-04-18T21:06:57.945 INFO:tasks.workunit.client.0.smithi096.stdout:8/157: dread d0/d3/db/f2d [0,4194304] 0 2024-04-18T21:06:57.954 INFO:tasks.workunit.client.0.smithi096.stdout:8/158: dread d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:06:57.955 INFO:tasks.workunit.client.0.smithi096.stdout:1/159: write d0/df/d16/d24/f35 [2614787,84740] 0 2024-04-18T21:06:57.956 INFO:tasks.workunit.client.0.smithi096.stdout:7/170: mknod d0/d7/c2c 0 2024-04-18T21:06:57.956 INFO:tasks.workunit.client.0.smithi096.stdout:0/171: creat d1/db/d30/d31/f3b x:0 0 0 2024-04-18T21:06:57.956 INFO:tasks.workunit.client.0.smithi096.stdout:5/99: creat d2/f27 x:0 0 0 2024-04-18T21:06:57.956 INFO:tasks.workunit.client.0.smithi096.stdout:1/160: fsync d0/df/d16/d24/f2b 0 2024-04-18T21:06:57.956 INFO:tasks.workunit.client.0.smithi096.stdout:2/343: sync 2024-04-18T21:06:57.957 INFO:tasks.workunit.client.0.smithi096.stdout:0/172: creat d1/d1c/f3c x:0 0 0 2024-04-18T21:06:57.957 INFO:tasks.workunit.client.0.smithi096.stdout:8/159: link d0/d3/db/f2d d0/d3/d14/d33/f3b 0 2024-04-18T21:06:57.957 INFO:tasks.workunit.client.0.smithi096.stdout:1/161: creat d0/df/d16/f37 x:0 0 0 2024-04-18T21:06:57.957 INFO:tasks.workunit.client.0.smithi096.stdout:0/173: truncate d1/d1c/f3c 533025 0 2024-04-18T21:06:57.957 INFO:tasks.workunit.client.0.smithi096.stdout:2/344: mknod d11/d13/d1d/c72 0 2024-04-18T21:06:57.958 INFO:tasks.workunit.client.0.smithi096.stdout:0/174: dread - d1/f2d zero size 2024-04-18T21:06:57.958 INFO:tasks.workunit.client.0.smithi096.stdout:1/162: creat d0/d27/f38 x:0 0 0 2024-04-18T21:06:57.959 INFO:tasks.workunit.client.0.smithi096.stdout:5/100: mkdir d2/d11/d28 0 2024-04-18T21:06:57.959 INFO:tasks.workunit.client.0.smithi096.stdout:0/175: fsync d1/d1c/d21/f16 0 2024-04-18T21:06:57.959 INFO:tasks.workunit.client.0.smithi096.stdout:2/345: symlink d11/d13/d1a/d1e/d28/d4e/d40/d51/l73 0 2024-04-18T21:06:57.960 INFO:tasks.workunit.client.0.smithi096.stdout:2/346: chown f1 19984672 1 2024-04-18T21:06:57.960 INFO:tasks.workunit.client.0.smithi096.stdout:1/163: link d0/df/d16/d24/f35 d0/f39 0 2024-04-18T21:06:57.960 INFO:tasks.workunit.client.0.smithi096.stdout:2/347: rmdir d11/d50 39 2024-04-18T21:06:57.961 INFO:tasks.workunit.client.0.smithi096.stdout:1/164: unlink d0/df/d16/d24/c29 0 2024-04-18T21:06:57.962 INFO:tasks.workunit.client.0.smithi096.stdout:7/171: dwrite d0/f1d [0,4194304] 0 2024-04-18T21:06:57.963 INFO:tasks.workunit.client.0.smithi096.stdout:7/172: write d0/d7/fb [5186259,12602] 0 2024-04-18T21:06:57.964 INFO:tasks.workunit.client.0.smithi096.stdout:1/165: creat d0/df/d16/d24/f3a x:0 0 0 2024-04-18T21:06:57.964 INFO:tasks.workunit.client.0.smithi096.stdout:1/166: chown d0/d27/d33 29371828 1 2024-04-18T21:06:57.965 INFO:tasks.workunit.client.0.smithi096.stdout:1/167: write d0/df/d16/d24/f31 [428618,46747] 0 2024-04-18T21:06:57.965 INFO:tasks.workunit.client.0.smithi096.stdout:0/176: dwrite d1/db/f1b [4194304,4194304] 0 2024-04-18T21:06:57.965 INFO:tasks.workunit.client.0.smithi096.stdout:0/177: readlink d1/db/l18 0 2024-04-18T21:06:57.967 INFO:tasks.workunit.client.0.smithi096.stdout:5/101: rename d2/d18/f14 to d2/d11/f29 0 2024-04-18T21:06:57.967 INFO:tasks.workunit.client.0.smithi096.stdout:1/168: symlink d0/d27/d33/l3b 0 2024-04-18T21:06:57.968 INFO:tasks.workunit.client.0.smithi096.stdout:5/102: rename d2/lf to d2/d18/l2a 0 2024-04-18T21:06:57.969 INFO:tasks.workunit.client.0.smithi096.stdout:4/154: dread d2/fc [0,4194304] 0 2024-04-18T21:06:57.970 INFO:tasks.workunit.client.0.smithi096.stdout:5/103: write d2/d11/f1f [850957,7462] 0 2024-04-18T21:06:57.970 INFO:tasks.workunit.client.0.smithi096.stdout:4/155: mkdir d2/d2f/d33 0 2024-04-18T21:06:57.975 INFO:tasks.workunit.client.0.smithi096.stdout:1/169: truncate d0/df/d16/d24/f25 4090350 0 2024-04-18T21:06:57.975 INFO:tasks.workunit.client.0.smithi096.stdout:5/104: getdents d2/d11 0 2024-04-18T21:06:57.976 INFO:tasks.workunit.client.0.smithi096.stdout:1/170: chown d0/f4 330 1 2024-04-18T21:06:57.976 INFO:tasks.workunit.client.0.smithi096.stdout:4/156: dwrite d2/f16 [0,4194304] 0 2024-04-18T21:06:57.977 INFO:tasks.workunit.client.0.smithi096.stdout:1/171: chown d0/df/d16/d24/c2f 19552 1 2024-04-18T21:06:57.978 INFO:tasks.workunit.client.0.smithi096.stdout:5/105: unlink d2/d18/l2a 0 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:0/178: dwrite d1/f15 [0,4194304] 0 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/106: dread - d2/d11/f1a zero size 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/107: chown f0 851 1 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:4/157: creat d2/d2f/d33/f34 x:0 0 0 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:1/172: dread d0/f39 [0,4194304] 0 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/108: creat d2/f2b x:0 0 0 2024-04-18T21:06:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/158: link d2/f2e d2/d2f/d33/f35 0 2024-04-18T21:06:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:5/109: write d2/f20 [683255,118272] 0 2024-04-18T21:06:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/159: rmdir d2/d1d 39 2024-04-18T21:06:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:5/110: write d2/d11/f1f [895991,52496] 0 2024-04-18T21:06:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/160: creat d2/d2f/f36 x:0 0 0 2024-04-18T21:06:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/161: stat d2/l20 0 2024-04-18T21:06:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/162: write d2/f18 [217672,130673] 0 2024-04-18T21:06:57.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:57.982+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:57.985 INFO:tasks.workunit.client.0.smithi096.stdout:4/163: write d2/d2f/d33/f34 [592510,74843] 0 2024-04-18T21:06:57.988 INFO:tasks.workunit.client.0.smithi096.stdout:5/111: dwrite d2/f15 [0,4194304] 0 2024-04-18T21:06:57.990 INFO:tasks.workunit.client.0.smithi096.stdout:2/348: dread d11/d13/d1a/d1e/d28/d4e/d63/f65 [0,4194304] 0 2024-04-18T21:06:57.990 INFO:tasks.workunit.client.0.smithi096.stdout:5/112: chown d2/d11/f1f 117391 1 2024-04-18T21:06:57.990 INFO:tasks.workunit.client.0.smithi096.stdout:4/164: dwrite d2/f31 [0,4194304] 0 2024-04-18T21:06:57.992 INFO:tasks.workunit.client.0.smithi096.stdout:2/349: fsync d11/d13/d1a/d1e/d28/d4e/f4b 0 2024-04-18T21:06:57.997 INFO:tasks.workunit.client.0.smithi096.stdout:2/350: dwrite d11/d13/d1d/f45 [0,4194304] 0 2024-04-18T21:06:57.999 INFO:tasks.workunit.client.0.smithi096.stdout:2/351: truncate d11/d13/d1a/d1e/d28/d4e/d40/f64 937635 0 2024-04-18T21:06:58.005 INFO:tasks.workunit.client.0.smithi096.stdout:2/352: dwrite d11/d13/d1a/d1e/d28/f2e [0,4194304] 0 2024-04-18T21:06:58.005 INFO:tasks.workunit.client.0.smithi096.stdout:8/160: dread d0/d3/f5 [0,4194304] 0 2024-04-18T21:06:58.006 INFO:tasks.workunit.client.0.smithi096.stdout:0/179: dread d1/d1c/d21/fe [0,4194304] 0 2024-04-18T21:06:58.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/180: creat d1/db/d25/f3d x:0 0 0 2024-04-18T21:06:58.007 INFO:tasks.workunit.client.0.smithi096.stdout:8/161: link d0/d3/c28 d0/d3/d1d/d2c/c3c 0 2024-04-18T21:06:58.007 INFO:tasks.workunit.client.0.smithi096.stdout:2/353: dread - d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f56 zero size 2024-04-18T21:06:58.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/165: dread d2/d1d/f15 [0,4194304] 0 2024-04-18T21:06:58.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/181: read d1/db/d25/f28 [3866447,67505] 0 2024-04-18T21:06:58.008 INFO:tasks.workunit.client.0.smithi096.stdout:8/162: write d0/d3/d14/d1b/f20 [788555,39876] 0 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/354: dread - d11/d13/d1a/d1e/d28/d4e/f62 zero size 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:0/182: mknod d1/db/d25/c3e 0 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:8/163: dread - d0/f32 zero size 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:4/166: getdents d2/d1d 0 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:8/164: fdatasync d0/f32 0 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:0/183: readlink d1/d1c/l38 0 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:9/202: sync 2024-04-18T21:06:58.010 INFO:tasks.workunit.client.0.smithi096.stdout:6/191: sync 2024-04-18T21:06:58.010 INFO:tasks.workunit.client.0.smithi096.stdout:3/166: sync 2024-04-18T21:06:58.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/203: stat d0/d8 0 2024-04-18T21:06:58.010 INFO:tasks.workunit.client.0.smithi096.stdout:6/192: dread - d1/f30 zero size 2024-04-18T21:06:58.010 INFO:tasks.workunit.client.0.smithi096.stdout:2/355: chown d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70 49 1 2024-04-18T21:06:58.011 INFO:tasks.workunit.client.0.smithi096.stdout:6/193: write d1/d5/f1a [2597225,75109] 0 2024-04-18T21:06:58.011 INFO:tasks.workunit.client.0.smithi096.stdout:0/184: dread d1/d1c/d21/f1d [0,4194304] 0 2024-04-18T21:06:58.011 INFO:tasks.workunit.client.0.smithi096.stdout:9/204: creat d0/d8/d11/f38 x:0 0 0 2024-04-18T21:06:58.011 INFO:tasks.workunit.client.0.smithi096.stdout:3/167: rename d4/d6/dd to d4/d6/d1b/d2c/d31 0 2024-04-18T21:06:58.012 INFO:tasks.workunit.client.0.smithi096.stdout:6/194: chown d1/d6/l28 117 1 2024-04-18T21:06:58.012 INFO:tasks.workunit.client.0.smithi096.stdout:0/185: readlink d1/d1c/l27 0 2024-04-18T21:06:58.012 INFO:tasks.workunit.client.0.smithi096.stdout:3/168: chown d4/l2d 440563940 1 2024-04-18T21:06:58.013 INFO:tasks.workunit.client.0.smithi096.stdout:3/169: write d4/d6/d7/f10 [4387299,84419] 0 2024-04-18T21:06:58.014 INFO:tasks.workunit.client.0.smithi096.stdout:3/170: creat d4/d6/f32 x:0 0 0 2024-04-18T21:06:58.014 INFO:tasks.workunit.client.0.smithi096.stdout:6/195: read d1/d6/f9 [913227,37805] 0 2024-04-18T21:06:58.014 INFO:tasks.workunit.client.0.smithi096.stdout:3/171: rmdir d4/d6/d1b/d1d 39 2024-04-18T21:06:58.015 INFO:tasks.workunit.client.0.smithi096.stdout:6/196: read - d1/f1c zero size 2024-04-18T21:06:58.015 INFO:tasks.workunit.client.0.smithi096.stdout:6/197: readlink d1/l2 0 2024-04-18T21:06:58.016 INFO:tasks.workunit.client.0.smithi096.stdout:6/198: stat d1/d6/d26/f29 0 2024-04-18T21:06:58.018 INFO:tasks.workunit.client.0.smithi096.stdout:9/205: dwrite d0/f5 [4194304,4194304] 0 2024-04-18T21:06:58.018 INFO:tasks.workunit.client.0.smithi096.stdout:0/186: dwrite d1/f2d [0,4194304] 0 2024-04-18T21:06:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:0/187: fsync d1/d1c/d21/f5 0 2024-04-18T21:06:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/206: mkdir d0/d8/d11/d39 0 2024-04-18T21:06:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:5/113: dread d2/f10 [0,4194304] 0 2024-04-18T21:06:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:0/188: stat d1/f12 0 2024-04-18T21:06:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/207: fdatasync d0/f34 0 2024-04-18T21:06:58.020 INFO:tasks.workunit.client.0.smithi096.stdout:5/114: write d2/d11/f1f [1054231,12319] 0 2024-04-18T21:06:58.021 INFO:tasks.workunit.client.0.smithi096.stdout:0/189: rename d1/db/f1b to d1/d1c/d21/f3f 0 2024-04-18T21:06:58.021 INFO:tasks.workunit.client.0.smithi096.stdout:9/208: truncate d0/dc/f36 118354 0 2024-04-18T21:06:58.022 INFO:tasks.workunit.client.0.smithi096.stdout:3/172: dwrite d4/fe [0,4194304] 0 2024-04-18T21:06:58.022 INFO:tasks.workunit.client.0.smithi096.stdout:2/356: write d11/d13/d1a/d1e/d28/d4e/f4b [580449,4648] 0 2024-04-18T21:06:58.023 INFO:tasks.workunit.client.0.smithi096.stdout:5/115: creat d2/f2c x:0 0 0 2024-04-18T21:06:58.023 INFO:tasks.workunit.client.0.smithi096.stdout:9/209: chown d0/d28/d2f 1918292 1 2024-04-18T21:06:58.025 INFO:tasks.workunit.client.0.smithi096.stdout:0/190: creat d1/db/d30/d31/d39/f40 x:0 0 0 2024-04-18T21:06:58.025 INFO:tasks.workunit.client.0.smithi096.stdout:2/357: symlink d11/d13/d1d/l74 0 2024-04-18T21:06:58.025 INFO:tasks.workunit.client.0.smithi096.stdout:9/210: stat d0/l15 0 2024-04-18T21:06:58.026 INFO:tasks.workunit.client.0.smithi096.stdout:6/199: dwrite d1/d5/f15 [0,4194304] 0 2024-04-18T21:06:58.026 INFO:tasks.workunit.client.0.smithi096.stdout:5/116: creat d2/d11/f2d x:0 0 0 2024-04-18T21:06:58.026 INFO:tasks.workunit.client.0.smithi096.stdout:3/173: symlink d4/d6/d1b/d2c/d31/l33 0 2024-04-18T21:06:58.027 INFO:tasks.workunit.client.0.smithi096.stdout:9/211: unlink d0/d8/f1c 0 2024-04-18T21:06:58.027 INFO:tasks.workunit.client.0.smithi096.stdout:5/117: write d2/f2b [846761,56361] 0 2024-04-18T21:06:58.028 INFO:tasks.workunit.client.0.smithi096.stdout:8/165: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:58.028 INFO:tasks.workunit.client.0.smithi096.stdout:4/167: dwrite d2/f2e [0,4194304] 0 2024-04-18T21:06:58.029 INFO:tasks.workunit.client.0.smithi096.stdout:3/174: write d4/d6/d22/f21 [8462371,84070] 0 2024-04-18T21:06:58.031 INFO:tasks.workunit.client.0.smithi096.stdout:9/212: creat d0/d8/d9/f3a x:0 0 0 2024-04-18T21:06:58.031 INFO:tasks.workunit.client.0.smithi096.stdout:4/168: dread d2/f2c [0,4194304] 0 2024-04-18T21:06:58.032 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:58.033 INFO:tasks.workunit.client.0.smithi096.stdout:6/200: rename d1/d5/d2e to d1/d3a 0 2024-04-18T21:06:58.033 INFO:tasks.workunit.client.0.smithi096.stdout:2/358: symlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/l75 0 2024-04-18T21:06:58.035 INFO:tasks.workunit.client.0.smithi096.stdout:2/359: chown d11/d13/d1a/d1e/d28/d4e/d5c 10508902 1 2024-04-18T21:06:58.035 INFO:tasks.workunit.client.0.smithi096.stdout:6/201: symlink d1/d3a/d36/l3b 0 2024-04-18T21:06:58.036 INFO:tasks.workunit.client.0.smithi096.stdout:5/118: rename d2/d18/l1c to d2/l2e 0 2024-04-18T21:06:58.037 INFO:tasks.workunit.client.0.smithi096.stdout:6/202: fdatasync d1/d6/d26/f29 0 2024-04-18T21:06:58.037 INFO:tasks.workunit.client.0.smithi096.stdout:5/119: stat d2/d11/f1f 0 2024-04-18T21:06:58.037 INFO:tasks.workunit.client.0.smithi096.stdout:8/166: dwrite d0/d3/f6 [4194304,4194304] 0 2024-04-18T21:06:58.038 INFO:tasks.workunit.client.0.smithi096.stdout:3/175: read d4/d8/f1f [395085,7811] 0 2024-04-18T21:06:58.038 INFO:tasks.workunit.client.0.smithi096.stdout:6/203: chown d1/d5/da/c2b 1498 1 2024-04-18T21:06:58.038 INFO:tasks.workunit.client.0.smithi096.stdout:5/120: symlink d2/d11/l2f 0 2024-04-18T21:06:58.039 INFO:tasks.workunit.client.0.smithi096.stdout:2/360: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/c76 0 2024-04-18T21:06:58.039 INFO:tasks.workunit.client.0.smithi096.stdout:6/204: write d1/f34 [568456,28886] 0 2024-04-18T21:06:58.040 INFO:tasks.workunit.client.0.smithi096.stdout:5/121: symlink d2/d11/l30 0 2024-04-18T21:06:58.040 INFO:tasks.workunit.client.0.smithi096.stdout:8/167: mknod d0/d3/d14/d1b/d29/c3d 0 2024-04-18T21:06:58.040 INFO:tasks.workunit.client.0.smithi096.stdout:3/176: dread - d4/d6/d1b/d1d/f2e zero size 2024-04-18T21:06:58.041 INFO:tasks.workunit.client.0.smithi096.stdout:6/205: rmdir d1/d5 39 2024-04-18T21:06:58.041 INFO:tasks.workunit.client.0.smithi096.stdout:5/122: unlink d2/d11/f1a 0 2024-04-18T21:06:58.041 INFO:tasks.workunit.client.0.smithi096.stdout:9/213: dwrite d0/d8/d9/f20 [0,4194304] 0 2024-04-18T21:06:58.042 INFO:tasks.workunit.client.0.smithi096.stdout:8/168: symlink d0/d3/db/l3e 0 2024-04-18T21:06:58.042 INFO:tasks.workunit.client.0.smithi096.stdout:5/123: fsync d2/d11/f1f 0 2024-04-18T21:06:58.042 INFO:tasks.workunit.client.0.smithi096.stdout:4/169: read d2/f1f [4006431,118982] 0 2024-04-18T21:06:58.042 INFO:tasks.workunit.client.0.smithi096.stdout:9/214: chown d0/d8/d11/d39 12 1 2024-04-18T21:06:58.043 INFO:tasks.workunit.client.0.smithi096.stdout:7/173: sync 2024-04-18T21:06:58.043 INFO:tasks.workunit.client.0.smithi096.stdout:1/173: sync 2024-04-18T21:06:58.043 INFO:tasks.workunit.client.0.smithi096.stdout:0/191: truncate d1/d1c/d21/fd 3855864 0 2024-04-18T21:06:58.044 INFO:tasks.workunit.client.0.smithi096.stdout:9/215: chown d0/d8/d11/f38 425 1 2024-04-18T21:06:58.044 INFO:tasks.workunit.client.0.smithi096.stdout:5/124: mknod d2/d11/c31 0 2024-04-18T21:06:58.044 INFO:tasks.workunit.client.0.smithi096.stdout:4/170: mkdir d2/d2a/d37 0 2024-04-18T21:06:58.044 INFO:tasks.workunit.client.0.smithi096.stdout:1/174: creat d0/d27/f3c x:0 0 0 2024-04-18T21:06:58.045 INFO:tasks.workunit.client.0.smithi096.stdout:7/174: write d0/d7/d8/f26 [1569684,71410] 0 2024-04-18T21:06:58.045 INFO:tasks.workunit.client.0.smithi096.stdout:8/169: rmdir d0/d3/d14/d1b 39 2024-04-18T21:06:58.045 INFO:tasks.workunit.client.0.smithi096.stdout:2/361: creat d11/d50/f77 x:0 0 0 2024-04-18T21:06:58.045 INFO:tasks.workunit.client.0.smithi096.stdout:4/171: truncate d2/f18 471952 0 2024-04-18T21:06:58.045 INFO:tasks.workunit.client.0.smithi096.stdout:0/192: mknod d1/db/c41 0 2024-04-18T21:06:58.046 INFO:tasks.workunit.client.0.smithi096.stdout:2/362: fsync d11/d13/f32 0 2024-04-18T21:06:58.046 INFO:tasks.workunit.client.0.smithi096.stdout:9/216: rmdir d0/d8/d2e 0 2024-04-18T21:06:58.047 INFO:tasks.workunit.client.0.smithi096.stdout:5/125: truncate d2/d18/fe 267962 0 2024-04-18T21:06:58.047 INFO:tasks.workunit.client.0.smithi096.stdout:6/206: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:58.047 INFO:tasks.workunit.client.0.smithi096.stdout:7/175: write d0/d7/d8/f16 [2740814,15124] 0 2024-04-18T21:06:58.048 INFO:tasks.workunit.client.0.smithi096.stdout:0/193: creat d1/db/d30/d31/d39/f42 x:0 0 0 2024-04-18T21:06:58.048 INFO:tasks.workunit.client.0.smithi096.stdout:4/172: truncate d2/f21 3141682 0 2024-04-18T21:06:58.049 INFO:tasks.workunit.client.0.smithi096.stdout:6/207: rmdir d1/d3a 39 2024-04-18T21:06:58.049 INFO:tasks.workunit.client.0.smithi096.stdout:4/173: stat d2/f16 0 2024-04-18T21:06:58.049 INFO:tasks.workunit.client.0.smithi096.stdout:3/177: dwrite d4/d8/f1f [0,4194304] 0 2024-04-18T21:06:58.050 INFO:tasks.workunit.client.0.smithi096.stdout:8/170: truncate d0/d3/d14/d1b/f1f 80535 0 2024-04-18T21:06:58.050 INFO:tasks.workunit.client.0.smithi096.stdout:0/194: chown d1/d23/l26 424633 1 2024-04-18T21:06:58.051 INFO:tasks.workunit.client.0.smithi096.stdout:5/126: read d2/f1b [1909763,96417] 0 2024-04-18T21:06:58.051 INFO:tasks.workunit.client.0.smithi096.stdout:8/171: write d0/f8 [5943688,75517] 0 2024-04-18T21:06:58.051 INFO:tasks.workunit.client.0.smithi096.stdout:4/174: dread - d2/d2f/f36 zero size 2024-04-18T21:06:58.052 INFO:tasks.workunit.client.0.smithi096.stdout:0/195: dread - d1/db/d25/f3d zero size 2024-04-18T21:06:58.052 INFO:tasks.workunit.client.0.smithi096.stdout:4/175: write d2/f16 [3905520,80691] 0 2024-04-18T21:06:58.053 INFO:tasks.workunit.client.0.smithi096.stdout:2/363: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f78 x:0 0 0 2024-04-18T21:06:58.053 INFO:tasks.workunit.client.0.smithi096.stdout:2/364: stat cc 0 2024-04-18T21:06:58.055 INFO:tasks.workunit.client.0.smithi096.stdout:6/208: getdents d1/d5 0 2024-04-18T21:06:58.055 INFO:tasks.workunit.client.0.smithi096.stdout:0/196: mkdir d1/d23/d32/d43 0 2024-04-18T21:06:58.055 INFO:tasks.workunit.client.0.smithi096.stdout:1/175: dwrite d0/f6 [0,4194304] 0 2024-04-18T21:06:58.055 INFO:tasks.workunit.client.0.smithi096.stdout:3/178: link d4/d6/l17 d4/d6/d7/l34 0 2024-04-18T21:06:58.056 INFO:tasks.workunit.client.0.smithi096.stdout:4/176: creat d2/f38 x:0 0 0 2024-04-18T21:06:58.057 INFO:tasks.workunit.client.0.smithi096.stdout:6/209: creat d1/d6/d26/f3c x:0 0 0 2024-04-18T21:06:58.057 INFO:tasks.workunit.client.0.smithi096.stdout:4/177: stat d2/d1d/f29 0 2024-04-18T21:06:58.057 INFO:tasks.workunit.client.0.smithi096.stdout:3/179: creat d4/f35 x:0 0 0 2024-04-18T21:06:58.059 INFO:tasks.workunit.client.0.smithi096.stdout:9/217: dwrite d0/dc/d18/f27 [0,4194304] 0 2024-04-18T21:06:58.060 INFO:tasks.workunit.client.0.smithi096.stdout:8/172: dwrite d0/d3/d1d/f24 [0,4194304] 0 2024-04-18T21:06:58.060 INFO:tasks.workunit.client.0.smithi096.stdout:1/176: rename d0/df/d16/f1b to d0/d27/d33/f3d 0 2024-04-18T21:06:58.061 INFO:tasks.workunit.client.0.smithi096.stdout:8/173: chown d0/d3/db/l11 23799 1 2024-04-18T21:06:58.062 INFO:tasks.workunit.client.0.smithi096.stdout:6/210: rmdir d1/d38 0 2024-04-18T21:06:58.062 INFO:tasks.workunit.client.0.smithi096.stdout:1/177: rmdir d0/df 39 2024-04-18T21:06:58.062 INFO:tasks.workunit.client.0.smithi096.stdout:9/218: creat d0/d8/f3b x:0 0 0 2024-04-18T21:06:58.062 INFO:tasks.workunit.client.0.smithi096.stdout:6/211: chown d1/l8 1 1 2024-04-18T21:06:58.062 INFO:tasks.workunit.client.0.smithi096.stdout:9/219: creat d0/d28/d2f/f3c x:0 0 0 2024-04-18T21:06:58.063 INFO:tasks.workunit.client.0.smithi096.stdout:3/180: dread d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:58.063 INFO:tasks.workunit.client.0.smithi096.stdout:9/220: mkdir d0/d28/d3d 0 2024-04-18T21:06:58.067 INFO:tasks.workunit.client.0.smithi096.stdout:3/181: dread d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:58.067 INFO:tasks.workunit.client.0.smithi096.stdout:7/176: truncate d0/d7/d8/f16 2192983 0 2024-04-18T21:06:58.068 INFO:tasks.workunit.client.0.smithi096.stdout:8/174: dwrite d0/fe [0,4194304] 0 2024-04-18T21:06:58.068 INFO:tasks.workunit.client.0.smithi096.stdout:6/212: dwrite d1/f30 [0,4194304] 0 2024-04-18T21:06:58.071 INFO:tasks.workunit.client.0.smithi096.stdout:7/177: write d0/d7/fb [7035326,59747] 0 2024-04-18T21:06:58.071 INFO:tasks.workunit.client.0.smithi096.stdout:3/182: symlink d4/d6/d1b/d2c/l36 0 2024-04-18T21:06:58.071 INFO:tasks.workunit.client.0.smithi096.stdout:4/178: write d2/f2c [1238688,112958] 0 2024-04-18T21:06:58.072 INFO:tasks.workunit.client.0.smithi096.stdout:4/179: stat d2/f8 0 2024-04-18T21:06:58.072 INFO:tasks.workunit.client.0.smithi096.stdout:3/183: mknod d4/d8/c37 0 2024-04-18T21:06:58.072 INFO:tasks.workunit.client.0.smithi096.stdout:7/178: creat d0/d20/f2d x:0 0 0 2024-04-18T21:06:58.072 INFO:tasks.workunit.client.0.smithi096.stdout:8/175: chown d0/d3/d14/d1b/d29 3 1 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi096.stdout:4/180: rename d2/d2a/d37 to d2/d2f/d39 0 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/179: chown d0/d7/d8/cd 1000 0 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi096.stdout:3/184: creat d4/d6/d1b/f38 x:0 0 0 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/176: mknod d0/d3/d14/d1b/d29/d2f/c3f 0 2024-04-18T21:06:58.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/185: mknod d4/d8/c39 0 2024-04-18T21:06:58.075 INFO:tasks.workunit.client.0.smithi096.stdout:8/177: dread - d0/f32 zero size 2024-04-18T21:06:58.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/186: write d4/f35 [138864,105788] 0 2024-04-18T21:06:58.075 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.483149345999999, 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:06:58.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:06:58.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.082 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.470285126, 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:06:58.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:06:58.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:06:58.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.469483656, 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:06:58.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:06:58.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.468709950999999, 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:06:58.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:06:58.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.461464386999999, 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:06:58.101 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:06:58.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:06:58.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.458397726999999, 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:06:58.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:06:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.440553022, 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:06:58.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:06:58.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:06:58.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.439713982000001, 2024-04-18T21:06:58.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:06:58.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:06:58.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:06:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.126 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.435360301999999, 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.127 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:06:58.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.434591989999999, 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:06:58.133 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:06:58.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:06:58.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:06:58.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.431242385999999, 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:06:58.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:06:58.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.417766409, 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:58.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:06:58.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.416112905, 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:06:58.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:06:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:06:58.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.412982136, 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.385669425, 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.384296999, 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.20109022, 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.66842966999999998, 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.66374442, 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.66305675900000005, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:06:58.206 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:58.212 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:58.203+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:3/187: creat d4/d6/d1b/f3a x:0 0 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:4/181: dread d2/f31 [0,4194304] 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/213: dread d1/f30 [0,4194304] 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:4/182: write d2/f38 [325396,7645] 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:3/188: mknod d4/d6/d1b/d2c/d31/c3b 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:7/180: dwrite d0/d7/d8/f1e [0,4194304] 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:4/183: write d2/d1d/f15 [20281,123614] 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/214: link d1/f30 d1/d3a/f3d 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:7/181: mkdir d0/d11/d18/d2e 0 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/215: chown d1/f14 15 1 2024-04-18T21:06:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:4/184: mkdir d2/d1d/d3a 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:7/182: mkdir d0/d7/d2f 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/189: dread d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:7/183: symlink d0/d7/l30 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/190: write d4/d6/d1b/f38 [146948,30205] 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/191: unlink d4/d6/d7/l34 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/192: chown d4/d6/d7/c14 1936 1 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/193: rename d4/d6/d22/d20/c27 to d4/d6/c3c 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/194: chown d4/d6/d7/f10 155185 1 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/195: stat d4/d6/d7/c18 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:1/178: dread d0/df/f36 [0,4194304] 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:1/179: chown d0/d27/l20 61914895 1 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/196: chown d4/d6/d1b/d2c/d31/l33 352632 1 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/197: creat d4/d8/f3d x:0 0 0 2024-04-18T21:06:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/198: creat d4/d6/d22/f3e x:0 0 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/199: fdatasync d4/d6/d22/f3e 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/200: creat d4/d6/d22/d20/f3f x:0 0 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:6/216: dread d1/f34 [0,4194304] 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:6/217: symlink d1/d5/l3e 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/201: dwrite d4/d8/f3d [0,4194304] 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:1/180: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/202: readlink d4/d6/d1b/d1d/l2f 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/203: stat d4/d6/d22/d20 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/204: read - d4/d6/d22/f3e zero size 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/205: chown d4/d6/d1b/d1d 22 1 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:8/178: fdatasync d0/d3/d1d/f24 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/206: fdatasync d4/d6/d1b/d1d/f2b 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:6/218: dread d1/d5/da/fc [0,4194304] 0 2024-04-18T21:06:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/207: fdatasync d4/d6/d7/f10 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:6/219: write d1/d5/f15 [2010880,28875] 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:3/208: read - d4/d6/d22/d20/f3f zero size 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/181: dwrite d0/df/f2e [0,4194304] 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:3/209: fdatasync d4/d6/d22/f3e 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:4/185: dread f0 [0,4194304] 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/182: rename d0/df/f36 to d0/f3e 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:8/179: dwrite d0/d3/f18 [0,4194304] 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/183: unlink d0/df/f2a 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:6/220: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:3/210: creat d4/d6/d1b/d2c/d31/d11/f40 x:0 0 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:6/221: readlink d1/d5/l22 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/184: rmdir d0/df 39 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:6/222: creat d1/d3a/f3f x:0 0 0 2024-04-18T21:06:58.227 INFO:tasks.workunit.client.0.smithi096.stdout:8/180: dwrite d0/fe [0,4194304] 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:8/181: symlink d0/d3/d14/d33/l40 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:1/185: truncate d0/f4 1700233 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:1/186: fdatasync d0/f3e 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/186: dwrite d2/d1d/f17 [0,4194304] 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:1/187: write d0/f17 [1538630,28292] 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/187: fsync d2/d1d/f15 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/188: creat d2/d2f/d33/f3b x:0 0 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/189: rename d2/l20 to d2/d2f/d39/l3c 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:8/182: truncate d0/d3/db/f15 1146791 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/190: rmdir d2/d2a 39 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:8/183: creat d0/d3/db/f41 x:0 0 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:7/184: dread d0/fc [0,4194304] 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:8/184: write d0/fe [644556,85627] 0 2024-04-18T21:06:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:1/188: dwrite d0/df/d16/d24/f2b [0,4194304] 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/185: truncate d0/d3/f6 9169482 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:7/185: rename d0/d11/c24 to d0/d20/c31 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/186: read d0/d3/f5 [2478288,54475] 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/189: truncate d0/d27/f38 220281 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/187: readlink d0/d3/d14/d33/l40 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/190: rmdir d0/d27 39 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/188: chown d0/d3/lf 2495333 1 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/191: dwrite d2/f18 [0,4194304] 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/192: fdatasync d2/d2f/f36 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:0/197: dread d1/d1c/d21/f5 [0,4194304] 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/193: unlink d2/f16 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/189: creat d0/d2e/f42 x:0 0 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:0/198: symlink d1/d23/d32/l44 0 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/194: chown d2/l10 5 1 2024-04-18T21:06:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/190: mkdir d0/d2e/d43 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/195: mknod d2/d1d/c3d 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/196: symlink d2/d1d/l3e 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:7/186: dwrite d0/d7/fe [0,4194304] 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/191: link d0/d3/f23 d0/d3/d1d/d2c/f44 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/197: mknod d2/d2f/d33/c3f 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/192: dread - d0/f32 zero size 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/198: mknod d2/c40 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/193: write d0/d3/d14/f2a [265700,83707] 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:0/199: dread d1/f15 [0,4194304] 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/194: chown d0/d3/db/f36 3379702 1 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/199: symlink d2/l41 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:0/200: fsync d1/d1c/d21/fd 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/195: rename d0/d3/db/f41 to d0/d3/db/f45 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:0/201: mknod d1/d1c/d21/c45 0 2024-04-18T21:06:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/196: mkdir d0/d3/d1d/d2c/d46 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/202: creat d1/d23/d32/d43/f46 x:0 0 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/187: dwrite d0/d7/ff [0,4194304] 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/203: link d1/d23/d32/d43/f46 d1/db/d30/d31/f47 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/204: chown d1/lc 22394 1 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/205: symlink d1/db/d30/d31/l48 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/206: dread d1/d1c/d21/f5 [0,4194304] 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/188: dwrite d0/d7/d8/f1e [4194304,4194304] 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/189: write d0/d7/ff [449919,124143] 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/207: truncate d1/d1c/d21/f9 622569 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/208: chown d1/db/d30/d31/d39/f40 633296095 1 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/209: rename d1/l29 to d1/d23/d32/d43/l49 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:4/200: dread d2/f28 [0,4194304] 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:8/197: write d0/d3/db/f13 [602364,2672] 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/210: unlink d1/db/d30/d31/l48 0 2024-04-18T21:06:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:4/201: write d2/f28 [235269,30221] 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:8/198: write d0/d3/d14/d1b/f20 [1139766,28519] 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:8/199: creat d0/d3/d3a/f47 x:0 0 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:8/200: unlink d0/c16 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:8/201: creat d0/d3/d14/d33/f48 x:0 0 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/190: dwrite d0/d7/d8/f1a [0,4194304] 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:5/127: sync 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:2/365: sync 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:3/211: sync 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:9/221: sync 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:1/191: sync 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:0/211: dwrite d1/d1c/d21/f16 [0,4194304] 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/191: write d0/d7/ff [2690177,122754] 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/192: chown d0/d7/ca 188359 1 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:8/202: creat d0/d3/f49 x:0 0 0 2024-04-18T21:06:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/193: readlink d0/l12 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:9/222: unlink d0/d8/d9/l21 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:1/192: fsync d0/d27/d33/f3d 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:7/194: write d0/fc [3682025,125578] 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/202: truncate d2/d1d/fb 2851119 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:2/366: dread d11/d13/d1a/d1e/d28/d4e/f4b [0,4194304] 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:0/212: dwrite d1/d1c/d21/f16 [4194304,4194304] 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:1/193: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/203: mknod d2/c42 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:5/128: dwrite d2/f15 [0,4194304] 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:7/195: link d0/d20/f2d d0/d11/f32 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:3/212: dwrite d4/d6/f32 [0,4194304] 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:2/367: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d79 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:8/203: dwrite d0/d3/d14/d1b/f20 [0,4194304] 0 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:5/129: chown d2/f27 2 1 2024-04-18T21:06:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/204: mkdir d2/d2f/d39/d43 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:8/204: write d0/fe [854892,36844] 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:7/196: mknod d0/d7/c33 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:4/205: write d2/d2f/f36 [359155,113578] 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:8/205: truncate d0/d3/fd 489202 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/194: link d0/l1e d0/df/d16/l3f 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:3/213: dread d4/d8/f3d [0,4194304] 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:7/197: unlink d0/d7/c2c 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:7/198: chown d0/d7 1062484509 1 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:0/213: dwrite d1/d1c/d21/f16 [4194304,4194304] 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/195: rmdir d0/df 39 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:2/368: dwrite d11/d13/d1a/d1e/d28/d4e/d40/f64 [0,4194304] 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/196: stat d0 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:4/206: dread d2/d2f/d33/f35 [0,4194304] 0 2024-04-18T21:06:58.234 INFO:tasks.workunit.client.0.smithi096.stdout:0/214: dread - d1/db/d30/d31/f47 zero size 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:3/214: rename d4/d6/d22/f21 to d4/d6/d1b/d2c/d31/f41 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:1/197: creat d0/df/d16/d24/f40 x:0 0 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/206: dwrite d0/d3/d14/f2a [0,4194304] 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:2/369: creat d11/d13/d1a/d1e/d28/d4e/f7a x:0 0 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:0/215: fdatasync d1/db/d30/d31/f47 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:5/130: dwrite d2/d11/f29 [0,4194304] 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:1/198: fdatasync d0/f9 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/207: creat d0/d2e/d43/f4a x:0 0 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:7/199: dread d0/d7/d8/f1e [4194304,4194304] 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:6/223: dread d1/d6/d26/fe [0,4194304] 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:5/131: creat d2/d18/f32 x:0 0 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:4/207: dread d2/f21 [0,4194304] 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:6/224: write d1/d5/f15 [136464,31076] 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/208: chown d0/d3/d1d/c22 7970 1 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:5/132: creat d2/d11/f33 x:0 0 0 2024-04-18T21:06:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:7/200: write d0/d7/d8/f1a [407895,125221] 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/225: write d1/d5/da/fc [566014,80972] 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:7/201: write d0/d11/f29 [850110,123534] 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:8/209: creat d0/d3/d1d/d2c/f4b x:0 0 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:5/133: symlink d2/d11/d28/l34 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:0/216: dread d1/db/d25/f28 [0,4194304] 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:0/217: fdatasync d1/db/d25/f3d 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:4/208: rename d2/d1d/l2b to d2/d2a/l44 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:8/210: fdatasync d0/d3/fd 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:0/218: write d1/db/d25/f37 [638204,49378] 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:8/211: creat d0/d3/f4c x:0 0 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/226: dwrite d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:58.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/227: mknod d1/d5/c40 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:4/209: dwrite d2/d1d/f29 [0,4194304] 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:4/210: truncate d2/f1f 5151741 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:8/212: dwrite d0/d3/d14/d1b/f1f [0,4194304] 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:7/202: truncate d0/d7/ff 3418866 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:5/134: truncate d2/fd 1651627 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:8/213: sync 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:0/219: truncate d1/f3 3730873 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:4/211: getdents d2/d2f 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:7/203: truncate d0/d11/f29 1540972 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:0/220: mkdir d1/db/d30/d4a 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:5/135: truncate d2/d11/f33 430788 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:7/204: creat d0/d20/f34 x:0 0 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:6/228: dwrite d1/d6/d26/f3c [0,4194304] 0 2024-04-18T21:06:58.237 INFO:tasks.workunit.client.0.smithi096.stdout:0/221: write d1/db/d30/d31/f3b [451134,45242] 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/205: rmdir d0/d11/d18 39 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:4/212: getdents d2/d2f/d39 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/206: truncate d0/d11/f32 495795 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:4/213: write d2/d2f/d33/f3b [27003,85244] 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/207: write d0/d7/d8/f26 [2024854,47126] 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:4/214: stat d2/f8 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:8/214: dread d0/d3/d14/d1b/f1f [0,4194304] 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:8/215: truncate d0/d3/fd 612345 0 2024-04-18T21:06:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/208: unlink d0/d11/c23 0 2024-04-18T21:06:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:8/216: dread d0/fe [0,4194304] 0 2024-04-18T21:06:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:1/199: read d0/df/d16/f19 [3239018,117535] 0 2024-04-18T21:06:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:2/370: dread d11/d13/d1a/d1e/d28/d4e/d40/f4c [0,4194304] 0 2024-04-18T21:06:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:1/200: mknod d0/c41 0 2024-04-18T21:06:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:8/217: write d0/f32 [921190,88508] 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:1/201: chown d0/c1d 116207 1 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:7/209: dwrite d0/d11/f17 [0,4194304] 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:8/218: mkdir d0/d3/d14/d1b/d29/d4d 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:7/210: chown d0/d11/f32 961693916 1 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:6/229: dwrite d1/d6/f9 [4194304,4194304] 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:2/371: write d11/d13/d1a/d1e/d28/d4e/f53 [466003,47654] 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:6/230: read d1/d6/d26/fe [3706425,72897] 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:2/372: chown d11/f39 81470387 1 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:6/231: chown d1/d5/f1a 464 1 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:0/222: dwrite d1/db/d25/f28 [4194304,4194304] 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:6/232: truncate d1/f34 1518211 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:4/215: truncate d2/f1f 3741588 0 2024-04-18T21:06:58.241 INFO:tasks.workunit.client.0.smithi096.stdout:5/136: dread d2/d18/fe [0,4194304] 0 2024-04-18T21:06:58.242 INFO:tasks.workunit.client.0.smithi096.stdout:1/202: dread d0/df/d16/d24/f2b [0,4194304] 0 2024-04-18T21:06:58.242 INFO:tasks.workunit.client.0.smithi096.stdout:5/137: read - d2/d11/f2d zero size 2024-04-18T21:06:58.242 INFO:tasks.workunit.client.0.smithi096.stdout:2/373: unlink d11/d13/d1d/c34 0 2024-04-18T21:06:58.242 INFO:tasks.workunit.client.0.smithi096.stdout:1/203: rmdir d0/df 39 2024-04-18T21:06:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:4/216: creat d2/d1d/d3a/f45 x:0 0 0 2024-04-18T21:06:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/233: creat d1/f41 x:0 0 0 2024-04-18T21:06:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/138: rename d2/d11/l25 to d2/d18/l35 0 2024-04-18T21:06:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/139: fsync f0 0 2024-04-18T21:06:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:9/223: dread d0/d8/d11/f19 [0,4194304] 0 2024-04-18T21:06:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/140: fdatasync d2/d11/f21 0 2024-04-18T21:06:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:2/374: rename d11/f19 to d11/d13/f7b 0 2024-04-18T21:06:58.244 INFO:tasks.workunit.client.0.smithi096.stdout:6/234: link d1/f13 d1/d3a/d36/f42 0 2024-04-18T21:06:58.244 INFO:tasks.workunit.client.0.smithi096.stdout:1/204: rename d0/df/d16/d24/f25 to d0/d27/d33/f42 0 2024-04-18T21:06:58.245 INFO:tasks.workunit.client.0.smithi096.stdout:9/224: link d0/d8/cb d0/d28/d2f/c3e 0 2024-04-18T21:06:58.246 INFO:tasks.workunit.client.0.smithi096.stdout:0/223: dwrite d1/db/d30/d31/f3b [0,4194304] 0 2024-04-18T21:06:58.247 INFO:tasks.workunit.client.0.smithi096.stdout:9/225: symlink d0/d8/l3f 0 2024-04-18T21:06:58.247 INFO:tasks.workunit.client.0.smithi096.stdout:6/235: link d1/l16 d1/l43 0 2024-04-18T21:06:58.248 INFO:tasks.workunit.client.0.smithi096.stdout:0/224: symlink d1/db/l4b 0 2024-04-18T21:06:58.248 INFO:tasks.workunit.client.0.smithi096.stdout:9/226: write d0/f4 [2689624,53127] 0 2024-04-18T21:06:58.249 INFO:tasks.workunit.client.0.smithi096.stdout:6/236: mkdir d1/d5/da/d44 0 2024-04-18T21:06:58.249 INFO:tasks.workunit.client.0.smithi096.stdout:9/227: read d0/dc/d18/f27 [2815988,76433] 0 2024-04-18T21:06:58.251 INFO:tasks.workunit.client.0.smithi096.stdout:9/228: dread - d0/dc/f32 zero size 2024-04-18T21:06:58.251 INFO:tasks.workunit.client.0.smithi096.stdout:7/211: write d0/d20/f2d [350661,91097] 0 2024-04-18T21:06:58.251 INFO:tasks.workunit.client.0.smithi096.stdout:6/237: mkdir d1/d5/d45 0 2024-04-18T21:06:58.252 INFO:tasks.workunit.client.0.smithi096.stdout:0/225: truncate d1/f3 1736876 0 2024-04-18T21:06:58.253 INFO:tasks.workunit.client.0.smithi096.stdout:2/375: dwrite d11/d13/d1d/f45 [0,4194304] 0 2024-04-18T21:06:58.255 INFO:tasks.workunit.client.0.smithi096.stdout:6/238: fsync d1/d5/ff 0 2024-04-18T21:06:58.256 INFO:tasks.workunit.client.0.smithi096.stdout:1/205: dwrite d0/df/d16/f2d [0,4194304] 0 2024-04-18T21:06:58.258 INFO:tasks.workunit.client.0.smithi096.stdout:6/239: mkdir d1/d5/da/d46 0 2024-04-18T21:06:58.258 INFO:tasks.workunit.client.0.smithi096.stdout:0/226: write d1/d1c/d21/fa [1465604,19419] 0 2024-04-18T21:06:58.260 INFO:tasks.workunit.client.0.smithi096.stdout:6/240: chown d1/f34 662997300 1 2024-04-18T21:06:58.260 INFO:tasks.workunit.client.0.smithi096.stdout:1/206: mknod d0/c43 0 2024-04-18T21:06:58.260 INFO:tasks.workunit.client.0.smithi096.stdout:7/212: dread d0/d7/d8/f1a [0,4194304] 0 2024-04-18T21:06:58.260 INFO:tasks.workunit.client.0.smithi096.stdout:0/227: creat d1/db/d30/d31/f4c x:0 0 0 2024-04-18T21:06:58.263 INFO:tasks.workunit.client.0.smithi096.stdout:6/241: write d1/d17/f2f [661813,22033] 0 2024-04-18T21:06:58.264 INFO:tasks.workunit.client.0.smithi096.stdout:7/213: fdatasync d0/d7/fb 0 2024-04-18T21:06:58.264 INFO:tasks.workunit.client.0.smithi096.stdout:9/229: dwrite d0/d8/d9/f23 [0,4194304] 0 2024-04-18T21:06:58.264 INFO:tasks.workunit.client.0.smithi096.stdout:0/228: dread - d1/db/d25/f3d zero size 2024-04-18T21:06:58.265 INFO:tasks.workunit.client.0.smithi096.stdout:2/376: dwrite d11/d13/f2f [0,4194304] 0 2024-04-18T21:06:58.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/207: rmdir d0/df/d16/d32 0 2024-04-18T21:06:58.266 INFO:tasks.workunit.client.0.smithi096.stdout:8/219: dwrite d0/d3/d1d/d2c/f44 [0,4194304] 0 2024-04-18T21:06:58.267 INFO:tasks.workunit.client.0.smithi096.stdout:2/377: read d11/d13/d1a/f1c [201622,44061] 0 2024-04-18T21:06:58.267 INFO:tasks.workunit.client.0.smithi096.stdout:8/220: fdatasync d0/d3/d14/f31 0 2024-04-18T21:06:58.267 INFO:tasks.workunit.client.0.smithi096.stdout:7/214: symlink d0/d11/d18/l35 0 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:58.269 INFO:tasks.workunit.client.0.smithi096.stdout:0/229: creat d1/db/d30/d4a/f4d x:0 0 0 2024-04-18T21:06:58.269 INFO:tasks.workunit.client.0.smithi096.stdout:2/378: mknod d11/c7c 0 2024-04-18T21:06:58.269 INFO:tasks.workunit.client.0.smithi096.stdout:1/208: creat d0/f44 x:0 0 0 2024-04-18T21:06:58.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/209: mknod d0/d27/d33/c45 0 2024-04-18T21:06:58.271 INFO:tasks.workunit.client.0.smithi096.stdout:0/230: truncate d1/db/d30/d31/d39/f42 891883 0 2024-04-18T21:06:58.271 INFO:tasks.workunit.client.0.smithi096.stdout:7/215: link d0/d7/d8/c9 d0/d11/d18/c36 0 2024-04-18T21:06:58.272 INFO:tasks.workunit.client.0.smithi096.stdout:6/242: dwrite d1/f1c [0,4194304] 0 2024-04-18T21:06:58.272 INFO:tasks.workunit.client.0.smithi096.stdout:2/379: link d11/d13/d1a/d1e/d28/l55 d11/l7d 0 2024-04-18T21:06:58.273 INFO:tasks.workunit.client.0.smithi096.stdout:1/210: symlink d0/df/d16/d24/l46 0 2024-04-18T21:06:58.274 INFO:tasks.workunit.client.0.smithi096.stdout:6/243: chown d1/d6/d26/fe 0 1 2024-04-18T21:06:58.274 INFO:tasks.workunit.client.0.smithi096.stdout:0/231: chown d1/d1c/l27 43 1 2024-04-18T21:06:58.274 INFO:tasks.workunit.client.0.smithi096.stdout:2/380: write f2 [550035,37373] 0 2024-04-18T21:06:58.274 INFO:tasks.workunit.client.0.smithi096.stdout:6/244: rmdir d1/d6 39 2024-04-18T21:06:58.274 INFO:tasks.workunit.client.0.smithi096.stdout:1/211: dread d0/f3e [0,4194304] 0 2024-04-18T21:06:58.275 INFO:tasks.workunit.client.0.smithi096.stdout:2/381: rmdir d11/d50 39 2024-04-18T21:06:58.275 INFO:tasks.workunit.client.0.smithi096.stdout:6/245: fdatasync d1/d3a/f3f 0 2024-04-18T21:06:58.275 INFO:tasks.workunit.client.0.smithi096.stdout:9/230: dwrite d0/dc/f32 [0,4194304] 0 2024-04-18T21:06:58.276 INFO:tasks.workunit.client.0.smithi096.stdout:1/212: symlink d0/d27/l47 0 2024-04-18T21:06:58.276 INFO:tasks.workunit.client.0.smithi096.stdout:6/246: rmdir d1/d3a/d36 39 2024-04-18T21:06:58.276 INFO:tasks.workunit.client.0.smithi096.stdout:0/232: truncate d1/d23/d32/d43/f46 996673 0 2024-04-18T21:06:58.276 INFO:tasks.workunit.client.0.smithi096.stdout:2/382: readlink d11/d13/d1a/d1e/d28/d4e/d40/d51/l73 0 2024-04-18T21:06:58.276 INFO:tasks.workunit.client.0.smithi096.stdout:6/247: stat d1/l2 0 2024-04-18T21:06:58.277 INFO:tasks.workunit.client.0.smithi096.stdout:9/231: write d0/dc/d18/f29 [1902355,75938] 0 2024-04-18T21:06:58.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/233: symlink d1/db/d30/l4e 0 2024-04-18T21:06:58.278 INFO:tasks.workunit.client.0.smithi096.stdout:2/383: creat d11/f7e x:0 0 0 2024-04-18T21:06:58.278 INFO:tasks.workunit.client.0.smithi096.stdout:9/232: mkdir d0/d8/d9/d40 0 2024-04-18T21:06:58.279 INFO:tasks.workunit.client.0.smithi096.stdout:9/233: readlink d0/d8/d11/l37 0 2024-04-18T21:06:58.279 INFO:tasks.workunit.client.0.smithi096.stdout:3/215: dread d4/d6/d1b/d1d/f2b [0,4194304] 0 2024-04-18T21:06:58.279 INFO:tasks.workunit.client.0.smithi096.stdout:0/234: creat d1/d23/d32/d43/f4f x:0 0 0 2024-04-18T21:06:58.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/216: write d4/d8/f1f [3612417,17935] 0 2024-04-18T21:06:58.280 INFO:tasks.workunit.client.0.smithi096.stdout:9/234: truncate d0/d8/f3b 895269 0 2024-04-18T21:06:58.280 INFO:tasks.workunit.client.0.smithi096.stdout:0/235: chown d1/d23/d32/l44 4561267 1 2024-04-18T21:06:58.280 INFO:tasks.workunit.client.0.smithi096.stdout:7/216: read d0/d11/f32 [19567,1605] 0 2024-04-18T21:06:58.281 INFO:tasks.workunit.client.0.smithi096.stdout:1/213: dread d0/f6 [0,4194304] 0 2024-04-18T21:06:58.282 INFO:tasks.workunit.client.0.smithi096.stdout:8/221: write d0/d3/db/f15 [730645,118836] 0 2024-04-18T21:06:58.282 INFO:tasks.workunit.client.0.smithi096.stdout:3/217: write d4/d6/d1b/f3a [690406,60235] 0 2024-04-18T21:06:58.282 INFO:tasks.workunit.client.0.smithi096.stdout:2/384: rename d11/d13/d1a/d1e/d28/d4e/f4b to d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f7f 0 2024-04-18T21:06:58.282 INFO:tasks.workunit.client.0.smithi096.stdout:1/214: chown d0/f17 3 1 2024-04-18T21:06:58.282 INFO:tasks.workunit.client.0.smithi096.stdout:9/235: symlink d0/d8/l41 0 2024-04-18T21:06:58.283 INFO:tasks.workunit.client.0.smithi096.stdout:7/217: symlink d0/d7/d8/l37 0 2024-04-18T21:06:58.283 INFO:tasks.workunit.client.0.smithi096.stdout:5/141: dread d2/f7 [0,4194304] 0 2024-04-18T21:06:58.283 INFO:tasks.workunit.client.0.smithi096.stdout:2/385: dread - d11/f39 zero size 2024-04-18T21:06:58.284 INFO:tasks.workunit.client.0.smithi096.stdout:7/218: symlink d0/d7/d2f/l38 0 2024-04-18T21:06:58.284 INFO:tasks.workunit.client.0.smithi096.stdout:3/218: mknod d4/d6/c42 0 2024-04-18T21:06:58.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/215: creat d0/df/f48 x:0 0 0 2024-04-18T21:06:58.284 INFO:tasks.workunit.client.0.smithi096.stdout:7/219: mkdir d0/d20/d39 0 2024-04-18T21:06:58.286 INFO:tasks.workunit.client.0.smithi096.stdout:1/216: write d0/df/d16/d24/f2b [3068103,115573] 0 2024-04-18T21:06:58.287 INFO:tasks.workunit.client.0.smithi096.stdout:7/220: symlink d0/d20/d39/l3a 0 2024-04-18T21:06:58.287 INFO:tasks.workunit.client.0.smithi096.stdout:8/222: link d0/d3/d14/d1b/d29/d2f/c34 d0/d3/d14/d1b/c4e 0 2024-04-18T21:06:58.287 INFO:tasks.workunit.client.0.smithi096.stdout:3/219: dread d4/d6/d1b/d2c/d31/f41 [8388608,4194304] 0 2024-04-18T21:06:58.288 INFO:tasks.workunit.client.0.smithi096.stdout:1/217: creat d0/f49 x:0 0 0 2024-04-18T21:06:58.288 INFO:tasks.workunit.client.0.smithi096.stdout:8/223: chown d0/d2e 164469 1 2024-04-18T21:06:58.288 INFO:tasks.workunit.client.0.smithi096.stdout:8/224: unlink d0/l9 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi096.stdout:8/225: write d0/d3/d3a/f47 [95758,118761] 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi096.stdout:2/386: dwrite d11/d13/d1a/f26 [0,4194304] 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi096.stdout:8/226: chown d0/d3/f23 207268 1 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/142: truncate d2/f7 461373 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi096.stdout:0/236: write d1/d1c/d21/f9 [743668,7975] 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi096.stdout:3/220: truncate d4/d6/d1b/d2c/d31/d11/f40 186382 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi096.stdout:9/236: truncate d0/dc/d18/f29 1284364 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi096.stdout:5/143: write d2/f10 [460758,85052] 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi096.stdout:8/227: write d0/d3/f23 [5230219,24052] 0 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi096.stdout:3/221: creat d4/d6/d1b/d2c/f43 x:0 0 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/237: rmdir d1/d1c/d35 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi096.stdout:7/221: dwrite d0/d7/d8/f26 [0,4194304] 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi096.stdout:1/218: dwrite d0/df/f1a [0,4194304] 0 2024-04-18T21:06:58.298 INFO:tasks.workunit.client.0.smithi096.stdout:5/144: rename d2/d11/d28/l34 to d2/d11/d28/l36 0 2024-04-18T21:06:58.298 INFO:tasks.workunit.client.0.smithi096.stdout:0/238: creat d1/d23/d32/d43/f50 x:0 0 0 2024-04-18T21:06:58.298 INFO:tasks.workunit.client.0.smithi096.stdout:7/222: rename d0/d7/c2b to d0/c3b 0 2024-04-18T21:06:58.299 INFO:tasks.workunit.client.0.smithi096.stdout:0/239: unlink d1/db/d30/d31/d39/f42 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi096.stdout:7/223: mknod d0/d20/d39/c3c 0 2024-04-18T21:06:58.301 INFO:tasks.workunit.client.0.smithi096.stdout:0/240: creat d1/db/d30/f51 x:0 0 0 2024-04-18T21:06:58.301 INFO:tasks.workunit.client.0.smithi096.stdout:7/224: rename d0/l12 to d0/d20/d39/l3d 0 2024-04-18T21:06:58.302 INFO:tasks.workunit.client.0.smithi096.stdout:0/241: truncate d1/d1c/d21/f3f 9089277 0 2024-04-18T21:06:58.302 INFO:tasks.workunit.client.0.smithi096.stdout:8/228: dwrite d0/d3/db/f36 [0,4194304] 0 2024-04-18T21:06:58.302 INFO:tasks.workunit.client.0.smithi096.stdout:7/225: chown d0/d11/d18/c1b 160 1 2024-04-18T21:06:58.303 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:06:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:58.304 INFO:tasks.workunit.client.0.smithi096.stdout:7/226: mknod d0/d7/d2f/c3e 0 2024-04-18T21:06:58.304 INFO:tasks.workunit.client.0.smithi096.stdout:5/145: truncate d2/f15 3919888 0 2024-04-18T21:06:58.304 INFO:tasks.workunit.client.0.smithi096.stdout:8/229: rename d0/d3/c21 to d0/d3/db/c4f 0 2024-04-18T21:06:58.305 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:58.303+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:58.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/146: chown d2/fd 7452 1 2024-04-18T21:06:58.306 INFO:tasks.workunit.client.0.smithi096.stdout:8/230: creat d0/d3/d14/d1b/d29/d4d/f50 x:0 0 0 2024-04-18T21:06:58.306 INFO:tasks.workunit.client.0.smithi096.stdout:5/147: stat d2/d11/l30 0 2024-04-18T21:06:58.307 INFO:tasks.workunit.client.0.smithi096.stdout:5/148: symlink d2/d11/d28/l37 0 2024-04-18T21:06:58.307 INFO:tasks.workunit.client.0.smithi096.stdout:1/219: truncate d0/f17 156043 0 2024-04-18T21:06:58.307 INFO:tasks.workunit.client.0.smithi096.stdout:8/231: rename d0/d3/db/l11 to d0/d2e/l51 0 2024-04-18T21:06:58.307 INFO:tasks.workunit.client.0.smithi096.stdout:1/220: readlink d0/df/l21 0 2024-04-18T21:06:58.308 INFO:tasks.workunit.client.0.smithi096.stdout:1/221: chown d0/f9 3 1 2024-04-18T21:06:58.308 INFO:tasks.workunit.client.0.smithi096.stdout:8/232: chown d0/d3/d14/d1b/f20 45548823 1 2024-04-18T21:06:58.308 INFO:tasks.workunit.client.0.smithi096.stdout:1/222: read d0/df/d16/f2d [1630400,37783] 0 2024-04-18T21:06:58.309 INFO:tasks.workunit.client.0.smithi096.stdout:3/222: dread d4/d6/d1b/d2c/d31/d11/f40 [0,4194304] 0 2024-04-18T21:06:58.309 INFO:tasks.workunit.client.0.smithi096.stdout:8/233: creat d0/d2e/f52 x:0 0 0 2024-04-18T21:06:58.309 INFO:tasks.workunit.client.0.smithi096.stdout:1/223: unlink d0/df/d16/d24/c26 0 2024-04-18T21:06:58.310 INFO:tasks.workunit.client.0.smithi096.stdout:8/234: truncate d0/d3/d14/d1b/f20 4693211 0 2024-04-18T21:06:58.310 INFO:tasks.workunit.client.0.smithi096.stdout:8/235: mknod d0/d2e/d43/c53 0 2024-04-18T21:06:58.310 INFO:tasks.workunit.client.0.smithi096.stdout:8/236: fdatasync d0/d2e/f52 0 2024-04-18T21:06:58.316 INFO:tasks.workunit.client.0.smithi096.stdout:8/237: dwrite d0/d3/d1d/d2c/f44 [0,4194304] 0 2024-04-18T21:06:58.318 INFO:tasks.workunit.client.0.smithi096.stdout:5/149: getdents d2/d11/d28 0 2024-04-18T21:06:58.319 INFO:tasks.workunit.client.0.smithi096.stdout:0/242: dwrite d1/db/d30/d31/f47 [0,4194304] 0 2024-04-18T21:06:58.319 INFO:tasks.workunit.client.0.smithi096.stdout:5/150: chown d2/d11/d28/l36 8867133 1 2024-04-18T21:06:58.320 INFO:tasks.workunit.client.0.smithi096.stdout:5/151: mkdir d2/d38 0 2024-04-18T21:06:58.320 INFO:tasks.workunit.client.0.smithi096.stdout:0/243: creat d1/db/d30/d31/d39/f52 x:0 0 0 2024-04-18T21:06:58.321 INFO:tasks.workunit.client.0.smithi096.stdout:0/244: symlink d1/db/d25/l53 0 2024-04-18T21:06:58.322 INFO:tasks.workunit.client.0.smithi096.stdout:0/245: mkdir d1/db/d25/d54 0 2024-04-18T21:06:58.323 INFO:tasks.workunit.client.0.smithi096.stdout:8/238: dwrite d0/f32 [0,4194304] 0 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/227: dread d0/d7/d8/f16 [0,4194304] 0 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi096.stdout:6/248: sync 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi096.stdout:3/223: sync 2024-04-18T21:06:58.329 INFO:tasks.workunit.client.0.smithi096.stdout:3/224: creat d4/d6/d22/d20/f44 x:0 0 0 2024-04-18T21:06:58.330 INFO:tasks.workunit.client.0.smithi096.stdout:6/249: symlink d1/d5/da/d44/l47 0 2024-04-18T21:06:58.330 INFO:tasks.workunit.client.0.smithi096.stdout:3/225: link d4/d6/f32 d4/d6/d1b/d2c/d31/d11/f45 0 2024-04-18T21:06:58.331 INFO:tasks.workunit.client.0.smithi096.stdout:6/250: symlink d1/d6/d26/l48 0 2024-04-18T21:06:58.331 INFO:tasks.workunit.client.0.smithi096.stdout:3/226: write d4/d6/d22/d20/f44 [311732,52454] 0 2024-04-18T21:06:58.332 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:06:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:58.332 INFO:tasks.workunit.client.0.smithi096.stdout:6/251: write d1/d6/d26/fb [1926796,14395] 0 2024-04-18T21:06:58.333 INFO:tasks.workunit.client.0.smithi096.stdout:3/227: write d4/d6/d1b/d1d/f28 [88330,38129] 0 2024-04-18T21:06:58.333 INFO:tasks.workunit.client.0.smithi096.stdout:7/228: dwrite d0/d7/d8/f26 [0,4194304] 0 2024-04-18T21:06:58.334 INFO:tasks.workunit.client.0.smithi096.stdout:7/229: fdatasync d0/d11/f17 0 2024-04-18T21:06:58.335 INFO:tasks.workunit.client.0.smithi096.stdout:7/230: chown d0/d20/f2d 11612 1 2024-04-18T21:06:58.336 INFO:tasks.workunit.client.0.smithi096.stdout:7/231: chown d0/d11/f17 136432042 1 2024-04-18T21:06:58.336 INFO:tasks.workunit.client.0.smithi096.stdout:3/228: mkdir d4/d6/d22/d20/d46 0 2024-04-18T21:06:58.337 INFO:tasks.workunit.client.0.smithi096.stdout:3/229: stat d4/d6/l17 0 2024-04-18T21:06:58.337 INFO:tasks.workunit.client.0.smithi096.stdout:3/230: rmdir d4/d6 39 2024-04-18T21:06:58.338 INFO:tasks.workunit.client.0.smithi096.stdout:3/231: write d4/d6/d1b/d1d/f28 [1036116,68717] 0 2024-04-18T21:06:58.339 INFO:tasks.workunit.client.0.smithi096.stdout:4/217: dread d2/f1f [0,4194304] 0 2024-04-18T21:06:58.340 INFO:tasks.workunit.client.0.smithi096.stdout:4/218: dread - d2/d1d/d3a/f45 zero size 2024-04-18T21:06:58.341 INFO:tasks.workunit.client.0.smithi096.stdout:6/252: dwrite d1/d5/da/fc [0,4194304] 0 2024-04-18T21:06:58.343 INFO:tasks.workunit.client.0.smithi096.stdout:6/253: rename d1/d3a/d36/l3b to d1/l49 0 2024-04-18T21:06:58.345 INFO:tasks.workunit.client.0.smithi096.stdout:5/152: dread d2/f20 [0,4194304] 0 2024-04-18T21:06:58.346 INFO:tasks.workunit.client.0.smithi096.stdout:4/219: dread d2/d1d/f17 [0,4194304] 0 2024-04-18T21:06:58.346 INFO:tasks.workunit.client.0.smithi096.stdout:3/232: dwrite d4/d6/d1b/d2c/f43 [0,4194304] 0 2024-04-18T21:06:58.346 INFO:tasks.workunit.client.0.smithi096.stdout:4/220: fdatasync d2/f1f 0 2024-04-18T21:06:58.349 INFO:tasks.workunit.client.0.smithi096.stdout:4/221: rename d2/l10 to d2/d1d/d3a/l46 0 2024-04-18T21:06:58.349 INFO:tasks.workunit.client.0.smithi096.stdout:5/153: link d2/c8 d2/d18/c39 0 2024-04-18T21:06:58.349 INFO:tasks.workunit.client.0.smithi096.stdout:5/154: dread - d2/f27 zero size 2024-04-18T21:06:58.350 INFO:tasks.workunit.client.0.smithi096.stdout:3/233: creat d4/d6/f47 x:0 0 0 2024-04-18T21:06:58.351 INFO:tasks.workunit.client.0.smithi096.stdout:4/222: rename d2/d2a/l44 to d2/d1d/l47 0 2024-04-18T21:06:58.351 INFO:tasks.workunit.client.0.smithi096.stdout:5/155: link d2/d11/f21 d2/f3a 0 2024-04-18T21:06:58.351 INFO:tasks.workunit.client.0.smithi096.stdout:5/156: readlink d2/d11/l24 0 2024-04-18T21:06:58.352 INFO:tasks.workunit.client.0.smithi096.stdout:4/223: creat d2/d2f/d39/d43/f48 x:0 0 0 2024-04-18T21:06:58.352 INFO:tasks.workunit.client.0.smithi096.stdout:5/157: creat d2/d11/f3b x:0 0 0 2024-04-18T21:06:58.353 INFO:tasks.workunit.client.0.smithi096.stdout:4/224: link d2/f38 d2/f49 0 2024-04-18T21:06:58.353 INFO:tasks.workunit.client.0.smithi096.stdout:5/158: rename d2/c8 to d2/d38/c3c 0 2024-04-18T21:06:58.354 INFO:tasks.workunit.client.0.smithi096.stdout:4/225: chown d2/f5 117358248 1 2024-04-18T21:06:58.354 INFO:tasks.workunit.client.0.smithi096.stdout:5/159: link d2/f2c d2/d11/f3d 0 2024-04-18T21:06:58.355 INFO:tasks.workunit.client.0.smithi096.stdout:5/160: readlink d2/l1e 0 2024-04-18T21:06:58.355 INFO:tasks.workunit.client.0.smithi096.stdout:4/226: write d2/d2f/d33/f35 [2992998,124828] 0 2024-04-18T21:06:58.356 INFO:tasks.workunit.client.0.smithi096.stdout:3/234: read d4/d6/d1b/f3a [472890,121658] 0 2024-04-18T21:06:58.356 INFO:tasks.workunit.client.0.smithi096.stdout:8/239: dread d0/d3/f6 [0,4194304] 0 2024-04-18T21:06:58.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/235: stat d4/d6/d1b/d2c/d31/c3b 0 2024-04-18T21:06:58.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/240: symlink d0/d2e/l54 0 2024-04-18T21:06:58.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/241: dread - d0/d3/f4c zero size 2024-04-18T21:06:58.359 INFO:tasks.workunit.client.0.smithi096.stdout:2/387: dread fb [0,4194304] 0 2024-04-18T21:06:58.363 INFO:tasks.workunit.client.0.smithi096.stdout:2/388: mkdir d11/d13/d1a/d1e/d28/d4e/d80 0 2024-04-18T21:06:58.363 INFO:tasks.workunit.client.0.smithi096.stdout:4/227: dwrite d2/f26 [0,4194304] 0 2024-04-18T21:06:58.363 INFO:tasks.workunit.client.0.smithi096.stdout:5/161: write d2/f15 [1961334,80105] 0 2024-04-18T21:06:58.363 INFO:tasks.workunit.client.0.smithi096.stdout:1/224: dread d0/d27/d33/f42 [0,4194304] 0 2024-04-18T21:06:58.363 INFO:tasks.workunit.client.0.smithi096.stdout:5/162: truncate d2/d18/f32 438507 0 2024-04-18T21:06:58.364 INFO:tasks.workunit.client.0.smithi096.stdout:5/163: dread - d2/d11/f2d zero size 2024-04-18T21:06:58.364 INFO:tasks.workunit.client.0.smithi096.stdout:8/242: write d0/d3/db/f2d [1218876,103683] 0 2024-04-18T21:06:58.365 INFO:tasks.workunit.client.0.smithi096.stdout:2/389: write d11/d13/d1a/f1c [1157224,110285] 0 2024-04-18T21:06:58.365 INFO:tasks.workunit.client.0.smithi096.stdout:4/228: write d2/f31 [4360336,124353] 0 2024-04-18T21:06:58.365 INFO:tasks.workunit.client.0.smithi096.stdout:5/164: write d2/f15 [64571,51551] 0 2024-04-18T21:06:58.365 INFO:tasks.workunit.client.0.smithi096.stdout:1/225: write d0/f39 [295516,42953] 0 2024-04-18T21:06:58.365 INFO:tasks.workunit.client.0.smithi096.stdout:8/243: rmdir d0/d3 39 2024-04-18T21:06:58.366 INFO:tasks.workunit.client.0.smithi096.stdout:5/165: mknod d2/d11/d28/c3e 0 2024-04-18T21:06:58.366 INFO:tasks.workunit.client.0.smithi096.stdout:8/244: fdatasync d0/f8 0 2024-04-18T21:06:58.367 INFO:tasks.workunit.client.0.smithi096.stdout:5/166: write d2/d11/f29 [1427023,15409] 0 2024-04-18T21:06:58.367 INFO:tasks.workunit.client.0.smithi096.stdout:2/390: getdents d11/d50/d5b 0 2024-04-18T21:06:58.367 INFO:tasks.workunit.client.0.smithi096.stdout:5/167: write d2/f10 [379763,111104] 0 2024-04-18T21:06:58.369 INFO:tasks.workunit.client.0.smithi096.stdout:1/226: creat d0/df/d16/d24/f4a x:0 0 0 2024-04-18T21:06:58.369 INFO:tasks.workunit.client.0.smithi096.stdout:5/168: symlink d2/d38/l3f 0 2024-04-18T21:06:58.369 INFO:tasks.workunit.client.0.smithi096.stdout:8/245: getdents d0/d3/d14/d1b/d29/d4d 0 2024-04-18T21:06:58.369 INFO:tasks.workunit.client.0.smithi096.stdout:2/391: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d79/c81 0 2024-04-18T21:06:58.369 INFO:tasks.workunit.client.0.smithi096.stdout:5/169: stat d2/d11/c31 0 2024-04-18T21:06:58.370 INFO:tasks.workunit.client.0.smithi096.stdout:1/227: symlink d0/df/d30/l4b 0 2024-04-18T21:06:58.371 INFO:tasks.workunit.client.0.smithi096.stdout:5/170: write d2/d11/f2d [316318,100976] 0 2024-04-18T21:06:58.371 INFO:tasks.workunit.client.0.smithi096.stdout:1/228: write d0/df/f48 [597220,84731] 0 2024-04-18T21:06:58.371 INFO:tasks.workunit.client.0.smithi096.stdout:5/171: chown d2/d11/f2d 155 1 2024-04-18T21:06:58.372 INFO:tasks.workunit.client.0.smithi096.stdout:1/229: mknod d0/df/d30/c4c 0 2024-04-18T21:06:58.373 INFO:tasks.workunit.client.0.smithi096.stdout:5/172: mknod d2/d11/d28/c40 0 2024-04-18T21:06:58.374 INFO:tasks.workunit.client.0.smithi096.stdout:1/230: stat d0/d27/d33/c45 0 2024-04-18T21:06:58.375 INFO:tasks.workunit.client.0.smithi096.stdout:5/173: mknod d2/d11/c41 0 2024-04-18T21:06:58.375 INFO:tasks.workunit.client.0.smithi096.stdout:4/229: dwrite d2/d2f/d33/f3b [0,4194304] 0 2024-04-18T21:06:58.376 INFO:tasks.workunit.client.0.smithi096.stdout:1/231: read d0/d27/d33/f42 [2526843,118842] 0 2024-04-18T21:06:58.376 INFO:tasks.workunit.client.0.smithi096.stdout:4/230: write d2/f2c [687092,129884] 0 2024-04-18T21:06:58.378 INFO:tasks.workunit.client.0.smithi096.stdout:1/232: chown d0/df/d30/c4c 6293639 1 2024-04-18T21:06:58.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/246: dwrite d0/d3/d1d/d2c/f44 [0,4194304] 0 2024-04-18T21:06:58.378 INFO:tasks.workunit.client.0.smithi096.stdout:2/392: dwrite d11/d13/d1d/f45 [0,4194304] 0 2024-04-18T21:06:58.378 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:58.378 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:58.379 INFO:tasks.workunit.client.0.smithi096.stdout:5/174: chown d2/l23 967794487 1 2024-04-18T21:06:58.379 INFO:tasks.workunit.client.0.smithi096.stdout:1/233: creat d0/df/d16/f4d x:0 0 0 2024-04-18T21:06:58.380 INFO:tasks.workunit.client.0.smithi096.stdout:8/247: chown d0/d3/d14/d1b/d29/d4d 90020 1 2024-04-18T21:06:58.380 INFO:tasks.workunit.client.0.smithi096.stdout:5/175: rmdir d2/d18 39 2024-04-18T21:06:58.380 INFO:tasks.workunit.client.0.smithi096.stdout:6/254: dread d1/d5/f15 [0,4194304] 0 2024-04-18T21:06:58.380 INFO:tasks.workunit.client.0.smithi096.stdout:8/248: fsync d0/d2e/d43/f4a 0 2024-04-18T21:06:58.381 INFO:tasks.workunit.client.0.smithi096.stdout:9/237: sync 2024-04-18T21:06:58.381 INFO:tasks.workunit.client.0.smithi096.stdout:0/246: sync 2024-04-18T21:06:58.382 INFO:tasks.workunit.client.0.smithi096.stdout:5/176: mknod d2/d18/c42 0 2024-04-18T21:06:58.382 INFO:tasks.workunit.client.0.smithi096.stdout:8/249: mkdir d0/d55 0 2024-04-18T21:06:58.382 INFO:tasks.workunit.client.0.smithi096.stdout:0/247: creat d1/db/d30/d31/d39/f55 x:0 0 0 2024-04-18T21:06:58.383 INFO:tasks.workunit.client.0.smithi096.stdout:5/177: chown d2/d11/f2d 3 1 2024-04-18T21:06:58.383 INFO:tasks.workunit.client.0.smithi096.stdout:0/248: rmdir d1/d23 39 2024-04-18T21:06:58.383 INFO:tasks.workunit.client.0.smithi096.stdout:8/250: unlink d0/d3/d14/d1b/d29/c3d 0 2024-04-18T21:06:58.384 INFO:tasks.workunit.client.0.smithi096.stdout:8/251: chown d0/d3/d14/d1b 52564 1 2024-04-18T21:06:58.384 INFO:tasks.workunit.client.0.smithi096.stdout:0/249: dread - d1/db/d30/d4a/f4d zero size 2024-04-18T21:06:58.385 INFO:tasks.workunit.client.0.smithi096.stdout:8/252: truncate d0/d3/f49 885892 0 2024-04-18T21:06:58.385 INFO:tasks.workunit.client.0.smithi096.stdout:0/250: rmdir d1/db/d30/d31/d39 39 2024-04-18T21:06:58.386 INFO:tasks.workunit.client.0.smithi096.stdout:2/393: truncate d11/d13/d1a/f1c 973394 0 2024-04-18T21:06:58.386 INFO:tasks.workunit.client.0.smithi096.stdout:0/251: readlink d1/d23/l2b 0 2024-04-18T21:06:58.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/255: dwrite d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:58.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/256: rmdir d1 39 2024-04-18T21:06:58.387 INFO:tasks.workunit.client.0.smithi096.stdout:0/252: write d1/db/d25/f37 [94060,38334] 0 2024-04-18T21:06:58.388 INFO:tasks.workunit.client.0.smithi096.stdout:1/234: truncate d0/df/d16/d24/f2b 3132196 0 2024-04-18T21:06:58.389 INFO:tasks.workunit.client.0.smithi096.stdout:2/394: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82 0 2024-04-18T21:06:58.389 INFO:tasks.workunit.client.0.smithi096.stdout:1/235: dread - d0/df/d16/d24/f4a zero size 2024-04-18T21:06:58.389 INFO:tasks.workunit.client.0.smithi096.stdout:0/253: dread - d1/db/d30/d31/d39/f40 zero size 2024-04-18T21:06:58.390 INFO:tasks.workunit.client.0.smithi096.stdout:2/395: chown d11/d13/d1a/f26 1 1 2024-04-18T21:06:58.390 INFO:tasks.workunit.client.0.smithi096.stdout:4/231: dread d2/f5 [0,4194304] 0 2024-04-18T21:06:58.390 INFO:tasks.workunit.client.0.smithi096.stdout:2/396: chown d11/d13/d1a/d1e 670 1 2024-04-18T21:06:58.390 INFO:tasks.workunit.client.0.smithi096.stdout:1/236: creat d0/df/d30/f4e x:0 0 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi096.stdout:4/232: write d2/f19 [4065267,94428] 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi096.stdout:1/237: write d0/f4 [2095429,35969] 0 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi096.stdout:4/233: truncate d2/f28 983959 0 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi096.stdout:1/238: mkdir d0/d27/d4f 0 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi096.stdout:9/238: dwrite d0/dc/f25 [0,4194304] 0 2024-04-18T21:06:58.393 INFO:tasks.workunit.client.0.smithi096.stdout:5/178: read f0 [751415,86340] 0 2024-04-18T21:06:58.394 INFO:tasks.workunit.client.0.smithi096.stdout:5/179: dread - d2/d11/f21 zero size 2024-04-18T21:06:58.395 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:58.396 INFO:tasks.workunit.client.0.smithi096.stdout:1/239: creat d0/df/d16/f50 x:0 0 0 2024-04-18T21:06:58.396 INFO:tasks.workunit.client.0.smithi096.stdout:5/180: mknod d2/d11/d28/c43 0 2024-04-18T21:06:58.396 INFO:tasks.workunit.client.0.smithi096.stdout:6/257: dwrite d1/d6/d26/f29 [0,4194304] 0 2024-04-18T21:06:58.396 INFO:tasks.workunit.client.0.smithi096.stdout:9/239: write d0/d8/d11/f19 [2338952,6092] 0 2024-04-18T21:06:58.396 INFO:tasks.workunit.client.0.smithi096.stdout:6/258: read d1/d6/d26/fb [3783444,58130] 0 2024-04-18T21:06:58.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/234: getdents d2/d1d 0 2024-04-18T21:06:58.397 INFO:tasks.workunit.client.0.smithi096.stdout:9/240: creat d0/d28/d2f/f42 x:0 0 0 2024-04-18T21:06:58.397 INFO:tasks.workunit.client.0.smithi096.stdout:6/259: truncate d1/d5/da/f21 935290 0 2024-04-18T21:06:58.399 INFO:tasks.workunit.client.0.smithi096.stdout:4/235: chown d2/d1d/f17 303029559 1 2024-04-18T21:06:58.399 INFO:tasks.workunit.client.0.smithi096.stdout:9/241: dread - d0/d8/d11/f38 zero size 2024-04-18T21:06:58.400 INFO:tasks.workunit.client.0.smithi096.stdout:1/240: creat d0/d27/d4f/f51 x:0 0 0 2024-04-18T21:06:58.400 INFO:tasks.workunit.client.0.smithi096.stdout:9/242: mkdir d0/d8/d9/d40/d43 0 2024-04-18T21:06:58.400 INFO:tasks.workunit.client.0.smithi096.stdout:1/241: fsync d0/df/f2e 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi096.stdout:2/397: rename d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f7f to d11/d50/f83 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi096.stdout:9/243: mkdir d0/d44 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi096.stdout:1/242: stat d0/df/d30/c4c 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi096.stdout:8/253: truncate d0/d3/d1d/d2c/f44 5379841 0 2024-04-18T21:06:58.402 INFO:tasks.workunit.client.0.smithi096.stdout:2/398: readlink d11/l27 0 2024-04-18T21:06:58.402 INFO:tasks.workunit.client.0.smithi096.stdout:4/236: rename d2/f8 to d2/d2a/f4a 0 2024-04-18T21:06:58.402 INFO:tasks.workunit.client.0.smithi096.stdout:8/254: readlink d0/d3/d14/d33/l40 0 2024-04-18T21:06:58.402 INFO:tasks.workunit.client.0.smithi096.stdout:9/244: rmdir d0/d8 39 2024-04-18T21:06:58.403 INFO:tasks.workunit.client.0.smithi096.stdout:1/243: creat d0/d27/f52 x:0 0 0 2024-04-18T21:06:58.404 INFO:tasks.workunit.client.0.smithi096.stdout:5/181: dwrite d2/f20 [0,4194304] 0 2024-04-18T21:06:58.404 INFO:tasks.workunit.client.0.smithi096.stdout:1/244: fdatasync d0/d27/d33/f3d 0 2024-04-18T21:06:58.406 INFO:tasks.workunit.client.0.smithi096.stdout:5/182: chown d2/d11/f3b 849744 1 2024-04-18T21:06:58.406 INFO:tasks.workunit.client.0.smithi096.stdout:1/245: write d0/d27/d33/f3d [781152,103419] 0 2024-04-18T21:06:58.406 INFO:tasks.workunit.client.0.smithi096.stdout:1/246: chown d0/l22 166158110 1 2024-04-18T21:06:58.408 INFO:tasks.workunit.client.0.smithi096.stdout:1/247: write d0/d27/f38 [954861,123912] 0 2024-04-18T21:06:58.410 INFO:tasks.workunit.client.0.smithi096.stdout:2/399: dread d11/d13/d1a/d1e/d28/d4e/d40/f60 [0,4194304] 0 2024-04-18T21:06:58.410 INFO:tasks.workunit.client.0.smithi096.stdout:9/245: dread d0/d8/d11/f19 [0,4194304] 0 2024-04-18T21:06:58.410 INFO:tasks.workunit.client.0.smithi096.stdout:3/236: sync 2024-04-18T21:06:58.410 INFO:tasks.workunit.client.0.smithi096.stdout:7/232: sync 2024-04-18T21:06:58.411 INFO:tasks.workunit.client.0.smithi096.stdout:8/255: dwrite d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:06:58.411 INFO:tasks.workunit.client.0.smithi096.stdout:9/246: write d0/f4 [4837463,104741] 0 2024-04-18T21:06:58.412 INFO:tasks.workunit.client.0.smithi096.stdout:3/237: write d4/d8/f1f [1556266,2891] 0 2024-04-18T21:06:58.412 INFO:tasks.workunit.client.0.smithi096.stdout:8/256: stat d0/d2e/f52 0 2024-04-18T21:06:58.412 INFO:tasks.workunit.client.0.smithi096.stdout:2/400: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f78 [821811,85117] 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi096.stdout:7/233: rename d0/d11/d18/c36 to d0/d7/d2f/c3f 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi096.stdout:9/247: rename d0/d8/d9/c13 to d0/d8/d9/c45 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi096.stdout:3/238: truncate d4/d6/d1b/d2c/d31/d11/f45 63631 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi096.stdout:9/248: chown d0/dc/f32 126344765 1 2024-04-18T21:06:58.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/257: rename d0/d3/d14/d1b/d29 to d0/d3/d14/d56 0 2024-04-18T21:06:58.415 INFO:tasks.workunit.client.0.smithi096.stdout:3/239: write d4/d6/d1b/f38 [113352,66343] 0 2024-04-18T21:06:58.417 INFO:tasks.workunit.client.0.smithi096.stdout:4/237: write d2/f49 [421749,121667] 0 2024-04-18T21:06:58.418 INFO:tasks.workunit.client.0.smithi096.stdout:4/238: link d2/d1d/f15 d2/d2f/d39/f4b 0 2024-04-18T21:06:58.420 INFO:tasks.workunit.client.0.smithi096.stdout:4/239: rename d2/f49 to d2/f4c 0 2024-04-18T21:06:58.421 INFO:tasks.workunit.client.0.smithi096.stdout:4/240: fdatasync d2/d1d/fb 0 2024-04-18T21:06:58.421 INFO:tasks.workunit.client.0.smithi096.stdout:8/258: dwrite d0/d3/d1d/d2c/f44 [0,4194304] 0 2024-04-18T21:06:58.422 INFO:tasks.workunit.client.0.smithi096.stdout:4/241: symlink d2/d1d/l4d 0 2024-04-18T21:06:58.422 INFO:tasks.workunit.client.0.smithi096.stdout:8/259: chown d0/d2e/d43 20312 1 2024-04-18T21:06:58.422 INFO:tasks.workunit.client.0.smithi096.stdout:3/240: dwrite d4/d6/d1b/d2c/d31/d11/f40 [0,4194304] 0 2024-04-18T21:06:58.423 INFO:tasks.workunit.client.0.smithi096.stdout:8/260: chown d0/d3/d14/d33/f48 139457 1 2024-04-18T21:06:58.424 INFO:tasks.workunit.client.0.smithi096.stdout:3/241: creat d4/d8/f48 x:0 0 0 2024-04-18T21:06:58.426 INFO:tasks.workunit.client.0.smithi096.stdout:4/242: link d2/d1d/c3d d2/d2a/c4e 0 2024-04-18T21:06:58.426 INFO:tasks.workunit.client.0.smithi096.stdout:3/242: rmdir d4/d6/d7 39 2024-04-18T21:06:58.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/243: mkdir d4/d8/d49 0 2024-04-18T21:06:58.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/244: fdatasync d4/d6/d7/f10 0 2024-04-18T21:06:58.430 INFO:tasks.workunit.client.0.smithi096.stdout:4/243: dread d2/d1d/f17 [0,4194304] 0 2024-04-18T21:06:58.431 INFO:tasks.workunit.client.0.smithi096.stdout:5/183: dwrite d2/d11/f21 [0,4194304] 0 2024-04-18T21:06:58.433 INFO:tasks.workunit.client.0.smithi096.stdout:7/234: getdents d0/d11/d18 0 2024-04-18T21:06:58.433 INFO:tasks.workunit.client.0.smithi096.stdout:5/184: creat d2/f44 x:0 0 0 2024-04-18T21:06:58.434 INFO:tasks.workunit.client.0.smithi096.stdout:2/401: truncate d11/d13/f15 1648816 0 2024-04-18T21:06:58.434 INFO:tasks.workunit.client.0.smithi096.stdout:4/244: dread d2/f26 [0,4194304] 0 2024-04-18T21:06:58.434 INFO:tasks.workunit.client.0.smithi096.stdout:2/402: stat d11/d13/d1d/c72 0 2024-04-18T21:06:58.434 INFO:tasks.workunit.client.0.smithi096.stdout:7/235: dread - d0/d20/f34 zero size 2024-04-18T21:06:58.435 INFO:tasks.workunit.client.0.smithi096.stdout:5/185: rename d2/d18/l17 to d2/d18/l45 0 2024-04-18T21:06:58.435 INFO:tasks.workunit.client.0.smithi096.stdout:4/245: creat d2/d1d/f4f x:0 0 0 2024-04-18T21:06:58.435 INFO:tasks.workunit.client.0.smithi096.stdout:7/236: rename d0/d20/d39/c3c to d0/c40 0 2024-04-18T21:06:58.436 INFO:tasks.workunit.client.0.smithi096.stdout:7/237: rmdir d0/d11 39 2024-04-18T21:06:58.437 INFO:tasks.workunit.client.0.smithi096.stdout:7/238: fsync d0/fc 0 2024-04-18T21:06:58.437 INFO:tasks.workunit.client.0.smithi096.stdout:2/403: link d11/d13/d1a/d1e/d28/d4e/d40/d51/d79/c81 d11/c84 0 2024-04-18T21:06:58.437 INFO:tasks.workunit.client.0.smithi096.stdout:5/186: rename d2/d11/f33 to d2/f46 0 2024-04-18T21:06:58.438 INFO:tasks.workunit.client.0.smithi096.stdout:7/239: mknod d0/d11/d18/d2e/c41 0 2024-04-18T21:06:58.438 INFO:tasks.workunit.client.0.smithi096.stdout:7/240: mkdir d0/d7/d42 0 2024-04-18T21:06:58.439 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:58.439+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:58.439 INFO:tasks.workunit.client.0.smithi096.stdout:7/241: link d0/d11/f17 d0/d11/f43 0 2024-04-18T21:06:58.440 INFO:tasks.workunit.client.0.smithi096.stdout:7/242: mkdir d0/d11/d44 0 2024-04-18T21:06:58.444 INFO:tasks.workunit.client.0.smithi096.stdout:3/245: truncate d4/d6/d1b/d2c/d31/d11/f40 2008116 0 2024-04-18T21:06:58.445 INFO:tasks.workunit.client.0.smithi096.stdout:5/187: dread d2/f46 [0,4194304] 0 2024-04-18T21:06:58.446 INFO:tasks.workunit.client.0.smithi096.stdout:3/246: rmdir d4/d6/d1b/d29 0 2024-04-18T21:06:58.446 INFO:tasks.workunit.client.0.smithi096.stdout:3/247: unlink d4/d6/f47 0 2024-04-18T21:06:58.447 INFO:tasks.workunit.client.0.smithi096.stdout:0/254: dread d1/f15 [0,4194304] 0 2024-04-18T21:06:58.447 INFO:tasks.workunit.client.0.smithi096.stdout:5/188: link d2/d11/l24 d2/d38/l47 0 2024-04-18T21:06:58.448 INFO:tasks.workunit.client.0.smithi096.stdout:7/243: truncate d0/d7/fe 585714 0 2024-04-18T21:06:58.448 INFO:tasks.workunit.client.0.smithi096.stdout:0/255: symlink d1/db/d30/d31/d39/l56 0 2024-04-18T21:06:58.449 INFO:tasks.workunit.client.0.smithi096.stdout:3/248: rename d4/d6/c16 to d4/d6/c4a 0 2024-04-18T21:06:58.449 INFO:tasks.workunit.client.0.smithi096.stdout:5/189: write d2/f10 [3052928,44958] 0 2024-04-18T21:06:58.451 INFO:tasks.workunit.client.0.smithi096.stdout:0/256: symlink d1/db/d30/d31/d39/l57 0 2024-04-18T21:06:58.451 INFO:tasks.workunit.client.0.smithi096.stdout:5/190: symlink d2/l48 0 2024-04-18T21:06:58.451 INFO:tasks.workunit.client.0.smithi096.stdout:3/249: symlink d4/d6/l4b 0 2024-04-18T21:06:58.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/191: stat d2/d11/d28 0 2024-04-18T21:06:58.452 INFO:tasks.workunit.client.0.smithi096.stdout:0/257: dread - d1/db/d30/d31/d39/f55 zero size 2024-04-18T21:06:58.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/192: fdatasync d2/f15 0 2024-04-18T21:06:58.453 INFO:tasks.workunit.client.0.smithi096.stdout:2/404: dwrite d11/d50/f83 [0,4194304] 0 2024-04-18T21:06:58.453 INFO:tasks.workunit.client.0.smithi096.stdout:3/250: truncate d4/d6/d1b/d1d/f2e 8968 0 2024-04-18T21:06:58.453 INFO:tasks.workunit.client.0.smithi096.stdout:0/258: mkdir d1/d1c/d21/d58 0 2024-04-18T21:06:58.453 INFO:tasks.workunit.client.0.smithi096.stdout:5/193: fsync d2/d11/f29 0 2024-04-18T21:06:58.455 INFO:tasks.workunit.client.0.smithi096.stdout:3/251: mknod d4/d6/d22/c4c 0 2024-04-18T21:06:58.455 INFO:tasks.workunit.client.0.smithi096.stdout:0/259: fsync d1/db/d30/d31/d39/f52 0 2024-04-18T21:06:58.455 INFO:tasks.workunit.client.0.smithi096.stdout:2/405: chown d11/d13/d1a/d1e/d28/l52 25 1 2024-04-18T21:06:58.455 INFO:tasks.workunit.client.0.smithi096.stdout:5/194: truncate d2/d11/f1f 1942333 0 2024-04-18T21:06:58.456 INFO:tasks.workunit.client.0.smithi096.stdout:7/244: dwrite d0/d20/f34 [0,4194304] 0 2024-04-18T21:06:58.456 INFO:tasks.workunit.client.0.smithi096.stdout:0/260: write d1/d1c/d21/f9 [805256,125708] 0 2024-04-18T21:06:58.457 INFO:tasks.workunit.client.0.smithi096.stdout:5/195: rmdir d2/d11 39 2024-04-18T21:06:58.458 INFO:tasks.workunit.client.0.smithi096.stdout:2/406: symlink d11/d13/d1a/l85 0 2024-04-18T21:06:58.458 INFO:tasks.workunit.client.0.smithi096.stdout:1/248: dread d0/df/d16/f19 [0,4194304] 0 2024-04-18T21:06:58.459 INFO:tasks.workunit.client.0.smithi096.stdout:3/252: rmdir d4/d6/d1b 39 2024-04-18T21:06:58.459 INFO:tasks.workunit.client.0.smithi096.stdout:1/249: mkdir d0/df/d30/d53 0 2024-04-18T21:06:58.459 INFO:tasks.workunit.client.0.smithi096.stdout:1/250: stat d0/c1 0 2024-04-18T21:06:58.460 INFO:tasks.workunit.client.0.smithi096.stdout:2/407: chown d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/c76 211 1 2024-04-18T21:06:58.460 INFO:tasks.workunit.client.0.smithi096.stdout:1/251: write d0/df/d30/f4e [269278,68220] 0 2024-04-18T21:06:58.461 INFO:tasks.workunit.client.0.smithi096.stdout:2/408: truncate d11/f7e 511094 0 2024-04-18T21:06:58.462 INFO:tasks.workunit.client.0.smithi096.stdout:6/260: dread d1/d5/f1b [0,4194304] 0 2024-04-18T21:06:58.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/409: fdatasync d11/d13/d1a/d1e/d28/d4e/f3d 0 2024-04-18T21:06:58.463 INFO:tasks.workunit.client.0.smithi096.stdout:2/410: creat d11/d13/d1a/d1e/d28/f86 x:0 0 0 2024-04-18T21:06:58.464 INFO:tasks.workunit.client.0.smithi096.stdout:0/261: dwrite d1/db/d30/d31/d39/f52 [0,4194304] 0 2024-04-18T21:06:58.466 INFO:tasks.workunit.client.0.smithi096.stdout:3/253: read d4/d6/d7/f10 [570798,119606] 0 2024-04-18T21:06:58.466 INFO:tasks.workunit.client.0.smithi096.stdout:0/262: rename d1 to d1/d59 22 2024-04-18T21:06:58.467 INFO:tasks.workunit.client.0.smithi096.stdout:2/411: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 x:0 0 0 2024-04-18T21:06:58.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/252: dread d0/f7 [4194304,4194304] 0 2024-04-18T21:06:58.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/263: truncate d1/d1c/d21/f1d 462027 0 2024-04-18T21:06:58.468 INFO:tasks.workunit.client.0.smithi096.stdout:9/249: dread d0/d28/d2f/f17 [8388608,4194304] 0 2024-04-18T21:06:58.469 INFO:tasks.workunit.client.0.smithi096.stdout:0/264: mknod d1/d23/c5a 0 2024-04-18T21:06:58.469 INFO:tasks.workunit.client.0.smithi096.stdout:0/265: creat d1/db/d30/f5b x:0 0 0 2024-04-18T21:06:58.471 INFO:tasks.workunit.client.0.smithi096.stdout:3/254: link d4/d6/d1b/d1d/l2f d4/d8/d49/l4d 0 2024-04-18T21:06:58.471 INFO:tasks.workunit.client.0.smithi096.stdout:9/250: link d0/d8/d9/c45 d0/d8/d11/d39/c46 0 2024-04-18T21:06:58.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/253: dread d0/df/f1a [0,4194304] 0 2024-04-18T21:06:58.471 INFO:tasks.workunit.client.0.smithi096.stdout:3/255: fsync d4/d8/fa 0 2024-04-18T21:06:58.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/251: write d0/dc/f26 [579637,36446] 0 2024-04-18T21:06:58.473 INFO:tasks.workunit.client.0.smithi096.stdout:1/254: creat d0/df/d16/f54 x:0 0 0 2024-04-18T21:06:58.473 INFO:tasks.workunit.client.0.smithi096.stdout:9/252: unlink d0/d8/l41 0 2024-04-18T21:06:58.473 INFO:tasks.workunit.client.0.smithi096.stdout:3/256: chown d4/d6/d1b/d2c/d31/d11/f40 1114 1 2024-04-18T21:06:58.473 INFO:tasks.workunit.client.0.smithi096.stdout:1/255: chown d0/d27/f3c 28099821 1 2024-04-18T21:06:58.474 INFO:tasks.workunit.client.0.smithi096.stdout:2/412: dwrite d11/d13/d1a/d1e/d28/f3e [0,4194304] 0 2024-04-18T21:06:58.474 INFO:tasks.workunit.client.0.smithi096.stdout:6/261: write d1/f13 [302504,72243] 0 2024-04-18T21:06:58.475 INFO:tasks.workunit.client.0.smithi096.stdout:0/266: dread d1/db/d30/d31/f47 [0,4194304] 0 2024-04-18T21:06:58.476 INFO:tasks.workunit.client.0.smithi096.stdout:9/253: mknod d0/d8/d11/c47 0 2024-04-18T21:06:58.476 INFO:tasks.workunit.client.0.smithi096.stdout:5/196: dread d2/fd [0,4194304] 0 2024-04-18T21:06:58.476 INFO:tasks.workunit.client.0.smithi096.stdout:9/254: read - d0/d8/d11/f38 zero size 2024-04-18T21:06:58.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/257: mkdir d4/d6/d1b/d2c/d31/d4e 0 2024-04-18T21:06:58.477 INFO:tasks.workunit.client.0.smithi096.stdout:9/255: chown d0/dc/d18/c1b 20512 1 2024-04-18T21:06:58.478 INFO:tasks.workunit.client.0.smithi096.stdout:0/267: write d1/d23/d32/d43/f46 [4029596,93412] 0 2024-04-18T21:06:58.478 INFO:tasks.workunit.client.0.smithi096.stdout:6/262: creat d1/f4a x:0 0 0 2024-04-18T21:06:58.478 INFO:tasks.workunit.client.0.smithi096.stdout:2/413: mknod d11/d13/d1a/d1e/d28/d4e/d40/c88 0 2024-04-18T21:06:58.478 INFO:tasks.workunit.client.0.smithi096.stdout:5/197: symlink d2/d11/l49 0 2024-04-18T21:06:58.479 INFO:tasks.workunit.client.0.smithi096.stdout:9/256: mkdir d0/d8/d11/d48 0 2024-04-18T21:06:58.479 INFO:tasks.workunit.client.0.smithi096.stdout:5/198: dread - d2/d11/f3b zero size 2024-04-18T21:06:58.480 INFO:tasks.workunit.client.0.smithi096.stdout:2/414: mkdir d11/d13/d1a/d1e/d28/d4e/d89 0 2024-04-18T21:06:58.480 INFO:tasks.workunit.client.0.smithi096.stdout:0/268: rename d1/d1c/d21/f9 to d1/db/d30/f5c 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi096.stdout:5/199: mkdir d2/d11/d28/d4a 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi096.stdout:1/256: dwrite d0/df/d16/f37 [0,4194304] 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi096.stdout:1/257: dread d0/f3e [0,4194304] 0 2024-04-18T21:06:58.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/258: write d0/df/d16/d24/f4a [998023,107510] 0 2024-04-18T21:06:58.483 INFO:tasks.workunit.client.0.smithi096.stdout:5/200: creat d2/d38/f4b x:0 0 0 2024-04-18T21:06:58.484 INFO:tasks.workunit.client.0.smithi096.stdout:2/415: mkdir d11/d50/d5b/d8a 0 2024-04-18T21:06:58.484 INFO:tasks.workunit.client.0.smithi096.stdout:1/259: readlink d0/df/d16/l3f 0 2024-04-18T21:06:58.484 INFO:tasks.workunit.client.0.smithi096.stdout:5/201: mkdir d2/d38/d4c 0 2024-04-18T21:06:58.485 INFO:tasks.workunit.client.0.smithi096.stdout:1/260: chown d0/f13 497 1 2024-04-18T21:06:58.485 INFO:tasks.workunit.client.0.smithi096.stdout:0/269: dread d1/d23/d32/d43/f46 [0,4194304] 0 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi096.stdout:5/202: rename l1 to d2/l4d 0 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi096.stdout:9/257: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi096.stdout:5/203: fdatasync d2/d38/f4b 0 2024-04-18T21:06:58.487 INFO:tasks.workunit.client.0.smithi096.stdout:0/270: write d1/db/d30/d31/f4c [841385,16452] 0 2024-04-18T21:06:58.487 INFO:tasks.workunit.client.0.smithi096.stdout:2/416: truncate d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f6b 825336 0 2024-04-18T21:06:58.488 INFO:tasks.workunit.client.0.smithi096.stdout:0/271: write d1/db/d30/d31/d39/f52 [713705,110460] 0 2024-04-18T21:06:58.488 INFO:tasks.workunit.client.0.smithi096.stdout:1/261: rename d0/df/d16/f4d to d0/df/d16/f55 0 2024-04-18T21:06:58.488 INFO:tasks.workunit.client.0.smithi096.stdout:2/417: chown d11/d13/d1a/d1e/d28/d4e 111622948 1 2024-04-18T21:06:58.489 INFO:tasks.workunit.client.0.smithi096.stdout:9/258: mknod d0/d8/d11/d1f/c49 0 2024-04-18T21:06:58.489 INFO:tasks.workunit.client.0.smithi096.stdout:5/204: unlink d2/l13 0 2024-04-18T21:06:58.489 INFO:tasks.workunit.client.0.smithi096.stdout:9/259: fsync d0/f5 0 2024-04-18T21:06:58.489 INFO:tasks.workunit.client.0.smithi096.stdout:1/262: rename d0/l22 to d0/d27/d4f/l56 0 2024-04-18T21:06:58.490 INFO:tasks.workunit.client.0.smithi096.stdout:0/272: mkdir d1/db/d30/d31/d39/d5d 0 2024-04-18T21:06:58.490 INFO:tasks.workunit.client.0.smithi096.stdout:2/418: mkdir d11/d13/d1a/d1e/d28/d4e/d89/d8b 0 2024-04-18T21:06:58.490 INFO:tasks.workunit.client.0.smithi096.stdout:1/263: fdatasync d0/df/f1a 0 2024-04-18T21:06:58.490 INFO:tasks.workunit.client.0.smithi096.stdout:0/273: fdatasync d1/f15 0 2024-04-18T21:06:58.491 INFO:tasks.workunit.client.0.smithi096.stdout:5/205: dread d2/f7 [0,4194304] 0 2024-04-18T21:06:58.491 INFO:tasks.workunit.client.0.smithi096.stdout:9/260: creat d0/d8/d11/d48/f4a x:0 0 0 2024-04-18T21:06:58.491 INFO:tasks.workunit.client.0.smithi096.stdout:1/264: unlink d0/df/d16/f2d 0 2024-04-18T21:06:58.491 INFO:tasks.workunit.client.0.smithi096.stdout:6/263: fdatasync d1/f13 0 2024-04-18T21:06:58.491 INFO:tasks.workunit.client.0.smithi096.stdout:5/206: creat d2/d38/d4c/f4e x:0 0 0 2024-04-18T21:06:58.492 INFO:tasks.workunit.client.0.smithi096.stdout:2/419: truncate d11/d13/d1a/d1e/d28/f59 902536 0 2024-04-18T21:06:58.492 INFO:tasks.workunit.client.0.smithi096.stdout:9/261: mkdir d0/d8/d9/d40/d43/d4b 0 2024-04-18T21:06:58.492 INFO:tasks.workunit.client.0.smithi096.stdout:6/264: fsync d1/f3 0 2024-04-18T21:06:58.492 INFO:tasks.workunit.client.0.smithi096.stdout:2/420: fdatasync d11/f16 0 2024-04-18T21:06:58.493 INFO:tasks.workunit.client.0.smithi096.stdout:2/421: unlink d11/d13/d1a/d1e/c3b 0 2024-04-18T21:06:58.494 INFO:tasks.workunit.client.0.smithi096.stdout:2/422: creat d11/d50/d5b/f8c x:0 0 0 2024-04-18T21:06:58.495 INFO:tasks.workunit.client.0.smithi096.stdout:2/423: chown d11/d13/d1a/d1e/d28/f86 3290 1 2024-04-18T21:06:58.497 INFO:tasks.workunit.client.0.smithi096.stdout:2/424: fdatasync d11/d13/d1a/f35 0 2024-04-18T21:06:58.498 INFO:tasks.workunit.client.0.smithi096.stdout:9/262: truncate d0/dc/f25 590624 0 2024-04-18T21:06:58.499 INFO:tasks.workunit.client.0.smithi096.stdout:3/258: dread d4/d8/fa [0,4194304] 0 2024-04-18T21:06:58.500 INFO:tasks.workunit.client.0.smithi096.stdout:5/207: dwrite d2/d11/f21 [0,4194304] 0 2024-04-18T21:06:58.501 INFO:tasks.workunit.client.0.smithi096.stdout:6/265: dwrite d1/f1c [4194304,4194304] 0 2024-04-18T21:06:58.501 INFO:tasks.workunit.client.0.smithi096.stdout:1/265: dwrite d0/d27/d4f/f51 [0,4194304] 0 2024-04-18T21:06:58.502 INFO:tasks.workunit.client.0.smithi096.stdout:3/259: truncate d4/d6/d1b/f38 842879 0 2024-04-18T21:06:58.503 INFO:tasks.workunit.client.0.smithi096.stdout:9/263: dread d0/dc/f32 [0,4194304] 0 2024-04-18T21:06:58.504 INFO:tasks.workunit.client.0.smithi096.stdout:5/208: fsync d2/d11/f3d 0 2024-04-18T21:06:58.504 INFO:tasks.workunit.client.0.smithi096.stdout:6/266: fsync d1/f30 0 2024-04-18T21:06:58.504 INFO:tasks.workunit.client.0.smithi096.stdout:3/260: symlink d4/d6/d1b/d2c/l4f 0 2024-04-18T21:06:58.505 INFO:tasks.workunit.client.0.smithi096.stdout:1/266: truncate d0/df/f2e 269196 0 2024-04-18T21:06:58.505 INFO:tasks.workunit.client.0.smithi096.stdout:2/425: getdents d11/d13/d1a/d1e/d28/d4e/d63 0 2024-04-18T21:06:58.505 INFO:tasks.workunit.client.0.smithi096.stdout:6/267: write d1/f13 [673356,97997] 0 2024-04-18T21:06:58.506 INFO:tasks.workunit.client.0.smithi096.stdout:3/261: chown d4/d8/c37 935400916 1 2024-04-18T21:06:58.506 INFO:tasks.workunit.client.0.smithi096.stdout:1/267: write d0/f6 [739842,31554] 0 2024-04-18T21:06:58.506 INFO:tasks.workunit.client.0.smithi096.stdout:9/264: dread - d0/d8/d11/d48/f4a zero size 2024-04-18T21:06:58.506 INFO:tasks.workunit.client.0.smithi096.stdout:3/262: mkdir d4/d6/d22/d20/d46/d50 0 2024-04-18T21:06:58.506 INFO:tasks.workunit.client.0.smithi096.stdout:6/268: link d1/l12 d1/d5/d45/l4b 0 2024-04-18T21:06:58.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:58.506+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:58.507 INFO:tasks.workunit.client.0.smithi096.stdout:1/268: stat d0/df 0 2024-04-18T21:06:58.508 INFO:tasks.workunit.client.0.smithi096.stdout:3/263: read - d4/d6/d22/f3e zero size 2024-04-18T21:06:58.508 INFO:tasks.workunit.client.0.smithi096.stdout:9/265: symlink d0/d8/d9/d40/l4c 0 2024-04-18T21:06:58.508 INFO:tasks.workunit.client.0.smithi096.stdout:1/269: symlink d0/d27/d33/l57 0 2024-04-18T21:06:58.508 INFO:tasks.workunit.client.0.smithi096.stdout:3/264: chown d4/d6/d1b/f3a 333 1 2024-04-18T21:06:58.508 INFO:tasks.workunit.client.0.smithi096.stdout:9/266: write d0/d28/d2f/f3c [106579,78818] 0 2024-04-18T21:06:58.509 INFO:tasks.workunit.client.0.smithi096.stdout:1/270: rmdir d0/d27/d33 39 2024-04-18T21:06:58.509 INFO:tasks.workunit.client.0.smithi096.stdout:3/265: readlink d4/d6/l17 0 2024-04-18T21:06:58.509 INFO:tasks.workunit.client.0.smithi096.stdout:6/269: getdents d1/d6/d26 0 2024-04-18T21:06:58.509 INFO:tasks.workunit.client.0.smithi096.stdout:9/267: write d0/d28/d2f/f42 [601338,9158] 0 2024-04-18T21:06:58.510 INFO:tasks.workunit.client.0.smithi096.stdout:8/261: sync 2024-04-18T21:06:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:4/246: sync 2024-04-18T21:06:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:7/245: sync 2024-04-18T21:06:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:9/268: stat d0/dc/f26 0 2024-04-18T21:06:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:1/271: creat d0/d27/d33/f58 x:0 0 0 2024-04-18T21:06:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:8/262: read d0/d3/f23 [3254807,105901] 0 2024-04-18T21:06:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:6/270: rename d1/d5/c27 to d1/d5/d45/c4c 0 2024-04-18T21:06:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:1/272: sync 2024-04-18T21:06:58.513 INFO:tasks.workunit.client.0.smithi096.stdout:9/269: mknod d0/dc/c4d 0 2024-04-18T21:06:58.513 INFO:tasks.workunit.client.0.smithi096.stdout:5/209: dwrite d2/d11/f2d [0,4194304] 0 2024-04-18T21:06:58.513 INFO:tasks.workunit.client.0.smithi096.stdout:7/246: rename d0/d7/d8/cd to d0/d11/d18/c45 0 2024-04-18T21:06:58.513 INFO:tasks.workunit.client.0.smithi096.stdout:1/273: mkdir d0/d27/d33/d59 0 2024-04-18T21:06:58.513 INFO:tasks.workunit.client.0.smithi096.stdout:1/274: write d0/f9 [541661,46704] 0 2024-04-18T21:06:58.514 INFO:tasks.workunit.client.0.smithi096.stdout:9/270: rmdir d0/d8/d9 39 2024-04-18T21:06:58.514 INFO:tasks.workunit.client.0.smithi096.stdout:7/247: creat d0/d20/f46 x:0 0 0 2024-04-18T21:06:58.515 INFO:tasks.workunit.client.0.smithi096.stdout:7/248: write d0/f1d [1686894,94979] 0 2024-04-18T21:06:58.515 INFO:tasks.workunit.client.0.smithi096.stdout:1/275: link d0/df/d16/d24/c2c d0/d27/d33/c5a 0 2024-04-18T21:06:58.515 INFO:tasks.workunit.client.0.smithi096.stdout:2/426: truncate d11/d13/d1a/d1e/d28/f2e 268677 0 2024-04-18T21:06:58.516 INFO:tasks.workunit.client.0.smithi096.stdout:5/210: write d2/f15 [2016524,91144] 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi096.stdout:2/427: stat d11/d50/f77 0 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi096.stdout:9/271: link d0/d8/d11/f38 d0/d8/d9/d40/f4e 0 2024-04-18T21:06:58.520 INFO:tasks.workunit.client.0.smithi096.stdout:5/211: mknod d2/d38/d4c/c4f 0 2024-04-18T21:06:58.520 INFO:tasks.workunit.client.0.smithi096.stdout:4/247: write d2/f18 [4123518,108993] 0 2024-04-18T21:06:58.520 INFO:tasks.workunit.client.0.smithi096.stdout:6/271: dwrite d1/d6/d26/fe [4194304,4194304] 0 2024-04-18T21:06:58.521 INFO:tasks.workunit.client.0.smithi096.stdout:2/428: rmdir d11/d50/d5b 39 2024-04-18T21:06:58.523 INFO:tasks.workunit.client.0.smithi096.stdout:4/248: chown d2/f1f 6107799 1 2024-04-18T21:06:58.523 INFO:tasks.workunit.client.0.smithi096.stdout:7/249: dread d0/d7/fe [0,4194304] 0 2024-04-18T21:06:58.523 INFO:tasks.workunit.client.0.smithi096.stdout:3/266: dwrite d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:58.523 INFO:tasks.workunit.client.0.smithi096.stdout:9/272: unlink d0/d8/d11/d1f/c49 0 2024-04-18T21:06:58.524 INFO:tasks.workunit.client.0.smithi096.stdout:5/212: rename d2/l2e to d2/d18/l50 0 2024-04-18T21:06:58.524 INFO:tasks.workunit.client.0.smithi096.stdout:0/274: dread d1/f2d [0,4194304] 0 2024-04-18T21:06:58.524 INFO:tasks.workunit.client.0.smithi096.stdout:8/263: dwrite d0/d3/d14/d1b/f1f [0,4194304] 0 2024-04-18T21:06:58.524 INFO:tasks.workunit.client.0.smithi096.stdout:6/272: symlink d1/d3a/d36/l4d 0 2024-04-18T21:06:58.525 INFO:tasks.workunit.client.0.smithi096.stdout:9/273: fsync d0/dc/f26 0 2024-04-18T21:06:58.525 INFO:tasks.workunit.client.0.smithi096.stdout:7/250: creat d0/d20/f47 x:0 0 0 2024-04-18T21:06:58.525 INFO:tasks.workunit.client.0.smithi096.stdout:2/429: rmdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d79 39 2024-04-18T21:06:58.525 INFO:tasks.workunit.client.0.smithi096.stdout:5/213: mknod d2/d38/d4c/c51 0 2024-04-18T21:06:58.526 INFO:tasks.workunit.client.0.smithi096.stdout:3/267: symlink d4/d6/l51 0 2024-04-18T21:06:58.526 INFO:tasks.workunit.client.0.smithi096.stdout:1/276: dwrite d0/f3e [0,4194304] 0 2024-04-18T21:06:58.526 INFO:tasks.workunit.client.0.smithi096.stdout:5/214: fdatasync f0 0 2024-04-18T21:06:58.526 INFO:tasks.workunit.client.0.smithi096.stdout:0/275: mknod d1/db/d30/d31/d39/d5d/c5e 0 2024-04-18T21:06:58.527 INFO:tasks.workunit.client.0.smithi096.stdout:1/277: stat d0/df/d16 0 2024-04-18T21:06:58.527 INFO:tasks.workunit.client.0.smithi096.stdout:2/430: rmdir d11/d13/d1a/d1e/d28 39 2024-04-18T21:06:58.527 INFO:tasks.workunit.client.0.smithi096.stdout:6/273: getdents d1/d6/d26 0 2024-04-18T21:06:58.527 INFO:tasks.workunit.client.0.smithi096.stdout:5/215: creat d2/d11/f52 x:0 0 0 2024-04-18T21:06:58.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/251: truncate d0/d11/f43 741448 0 2024-04-18T21:06:58.528 INFO:tasks.workunit.client.0.smithi096.stdout:5/216: mknod d2/c53 0 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi096.stdout:7/252: creat d0/d7/f48 x:0 0 0 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi096.stdout:1/278: creat d0/df/f5b x:0 0 0 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi096.stdout:7/253: sync 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi096.stdout:3/268: getdents d4/d6/d1b/d2c/d31/d11 0 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi096.stdout:2/431: dread - d11/d13/d1a/d1e/d28/d4e/d40/d51/f66 zero size 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi096.stdout:1/279: chown d0/f3e 1111 1 2024-04-18T21:06:58.530 INFO:tasks.workunit.client.0.smithi096.stdout:3/269: readlink d4/d6/l23 0 2024-04-18T21:06:58.530 INFO:tasks.workunit.client.0.smithi096.stdout:1/280: chown d0/d27/d33/f58 102122603 1 2024-04-18T21:06:58.530 INFO:tasks.workunit.client.0.smithi096.stdout:5/217: symlink d2/d11/d28/d4a/l54 0 2024-04-18T21:06:58.531 INFO:tasks.workunit.client.0.smithi096.stdout:8/264: dread d0/d3/db/f2d [0,4194304] 0 2024-04-18T21:06:58.531 INFO:tasks.workunit.client.0.smithi096.stdout:3/270: write d4/d6/d7/f10 [1796447,18938] 0 2024-04-18T21:06:58.532 INFO:tasks.workunit.client.0.smithi096.stdout:5/218: write d2/f15 [2726001,106320] 0 2024-04-18T21:06:58.532 INFO:tasks.workunit.client.0.smithi096.stdout:8/265: chown d0/d3/d14/d1b/f1f 608 1 2024-04-18T21:06:58.533 INFO:tasks.workunit.client.0.smithi096.stdout:8/266: fsync d0/d3/db/f36 0 2024-04-18T21:06:58.535 INFO:tasks.workunit.client.0.smithi096.stdout:8/267: stat d0/f12 0 2024-04-18T21:06:58.535 INFO:tasks.workunit.client.0.smithi096.stdout:8/268: sync 2024-04-18T21:06:58.535 INFO:tasks.workunit.client.0.smithi096.stdout:6/274: dwrite d1/f1c [4194304,4194304] 0 2024-04-18T21:06:58.535 INFO:tasks.workunit.client.0.smithi096.stdout:0/276: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:58.535 INFO:tasks.workunit.client.0.smithi096.stdout:6/275: chown d1/d17 2711 1 2024-04-18T21:06:58.536 INFO:tasks.workunit.client.0.smithi096.stdout:7/254: getdents d0/d20 0 2024-04-18T21:06:58.536 INFO:tasks.workunit.client.0.smithi096.stdout:1/281: dread d0/f3e [0,4194304] 0 2024-04-18T21:06:58.536 INFO:tasks.workunit.client.0.smithi096.stdout:7/255: sync 2024-04-18T21:06:58.537 INFO:tasks.workunit.client.0.smithi096.stdout:9/274: truncate d0/d28/d2f/f17 3641078 0 2024-04-18T21:06:58.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/256: mkdir d0/d7/d49 0 2024-04-18T21:06:58.538 INFO:tasks.workunit.client.0.smithi096.stdout:8/269: link d0/f32 d0/d3/f57 0 2024-04-18T21:06:58.538 INFO:tasks.workunit.client.0.smithi096.stdout:9/275: symlink d0/dc/d18/l4f 0 2024-04-18T21:06:58.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/257: symlink d0/d20/d39/l4a 0 2024-04-18T21:06:58.539 INFO:tasks.workunit.client.0.smithi096.stdout:8/270: mknod d0/d3/d14/d56/d4d/c58 0 2024-04-18T21:06:58.540 INFO:tasks.workunit.client.0.smithi096.stdout:7/258: unlink d0/d7/fe 0 2024-04-18T21:06:58.540 INFO:tasks.workunit.client.0.smithi096.stdout:8/271: creat d0/d3/d14/d33/f59 x:0 0 0 2024-04-18T21:06:58.540 INFO:tasks.workunit.client.0.smithi096.stdout:6/276: dread d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:58.540 INFO:tasks.workunit.client.0.smithi096.stdout:9/276: symlink d0/d8/l50 0 2024-04-18T21:06:58.541 INFO:tasks.workunit.client.0.smithi096.stdout:9/277: chown d0/dc/c2c 0 1 2024-04-18T21:06:58.541 INFO:tasks.workunit.client.0.smithi096.stdout:8/272: chown d0/c2 36569208 1 2024-04-18T21:06:58.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/259: rmdir d0/d11/d44 0 2024-04-18T21:06:58.541 INFO:tasks.workunit.client.0.smithi096.stdout:6/277: read d1/d5/da/fc [862723,57582] 0 2024-04-18T21:06:58.541 INFO:tasks.workunit.client.0.smithi096.stdout:6/278: sync 2024-04-18T21:06:58.542 INFO:tasks.workunit.client.0.smithi096.stdout:7/260: mkdir d0/d20/d4b 0 2024-04-18T21:06:58.542 INFO:tasks.workunit.client.0.smithi096.stdout:8/273: mkdir d0/d3/d14/d56/d4d/d5a 0 2024-04-18T21:06:58.542 INFO:tasks.workunit.client.0.smithi096.stdout:6/279: write d1/d6/f9 [641236,39770] 0 2024-04-18T21:06:58.542 INFO:tasks.workunit.client.0.smithi096.stdout:8/274: write d0/d3/f49 [1120528,63177] 0 2024-04-18T21:06:58.542 INFO:tasks.workunit.client.0.smithi096.stdout:7/261: truncate d0/fc 729580 0 2024-04-18T21:06:58.543 INFO:tasks.workunit.client.0.smithi096.stdout:5/219: truncate d2/d18/f32 240347 0 2024-04-18T21:06:58.543 INFO:tasks.workunit.client.0.smithi096.stdout:6/280: unlink d1/d3a/f3d 0 2024-04-18T21:06:58.543 INFO:tasks.workunit.client.0.smithi096.stdout:5/220: chown d2/f27 23 1 2024-04-18T21:06:58.544 INFO:tasks.workunit.client.0.smithi096.stdout:5/221: mkdir d2/d11/d28/d4a/d55 0 2024-04-18T21:06:58.544 INFO:tasks.workunit.client.0.smithi096.stdout:6/281: getdents d1/d5 0 2024-04-18T21:06:58.545 INFO:tasks.workunit.client.0.smithi096.stdout:6/282: chown d1/d3a/d36/l4d 2545029 1 2024-04-18T21:06:58.545 INFO:tasks.workunit.client.0.smithi096.stdout:6/283: stat d1/d3a/d36/l4d 0 2024-04-18T21:06:58.545 INFO:tasks.workunit.client.0.smithi096.stdout:8/275: dread d0/f8 [8388608,4194304] 0 2024-04-18T21:06:58.546 INFO:tasks.workunit.client.0.smithi096.stdout:8/276: creat d0/d3/d14/d33/f5b x:0 0 0 2024-04-18T21:06:58.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/277: fdatasync d0/f32 0 2024-04-18T21:06:58.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/278: fdatasync d0/d3/f4c 0 2024-04-18T21:06:58.548 INFO:tasks.workunit.client.0.smithi096.stdout:8/279: sync 2024-04-18T21:06:58.554 INFO:tasks.workunit.client.0.smithi096.stdout:8/280: dwrite d0/d3/db/f45 [0,4194304] 0 2024-04-18T21:06:58.555 INFO:tasks.workunit.client.0.smithi096.stdout:5/222: write d2/d11/f3d [729612,68717] 0 2024-04-18T21:06:58.555 INFO:tasks.workunit.client.0.smithi096.stdout:6/284: dwrite d1/d5/da/fc [4194304,4194304] 0 2024-04-18T21:06:58.555 INFO:tasks.workunit.client.0.smithi096.stdout:8/281: write d0/d3/d14/d1b/f1f [237012,52793] 0 2024-04-18T21:06:58.557 INFO:tasks.workunit.client.0.smithi096.stdout:6/285: rename d1/d5/d45 to d1/d5/da/d44/d4e 0 2024-04-18T21:06:58.557 INFO:tasks.workunit.client.0.smithi096.stdout:8/282: chown d0/d3/c28 118 1 2024-04-18T21:06:58.558 INFO:tasks.workunit.client.0.smithi096.stdout:6/286: readlink d1/d5/da/d44/l47 0 2024-04-18T21:06:58.558 INFO:tasks.workunit.client.0.smithi096.stdout:8/283: dread - d0/d2e/f52 zero size 2024-04-18T21:06:58.559 INFO:tasks.workunit.client.0.smithi096.stdout:8/284: write d0/d3/d14/d33/f48 [845035,130114] 0 2024-04-18T21:06:58.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/287: chown d1/d5/da/d44 15 1 2024-04-18T21:06:58.559 INFO:tasks.workunit.client.0.smithi096.stdout:8/285: creat d0/d2e/d43/f5c x:0 0 0 2024-04-18T21:06:58.560 INFO:tasks.workunit.client.0.smithi096.stdout:6/288: unlink d1/d6/l28 0 2024-04-18T21:06:58.560 INFO:tasks.workunit.client.0.smithi096.stdout:8/286: mkdir d0/d5d 0 2024-04-18T21:06:58.561 INFO:tasks.workunit.client.0.smithi096.stdout:6/289: truncate d1/f30 874501 0 2024-04-18T21:06:58.561 INFO:tasks.workunit.client.0.smithi096.stdout:8/287: creat d0/d3/d14/d56/f5e x:0 0 0 2024-04-18T21:06:58.561 INFO:tasks.workunit.client.0.smithi096.stdout:6/290: write d1/d3a/f3f [462276,103009] 0 2024-04-18T21:06:58.561 INFO:tasks.workunit.client.0.smithi096.stdout:8/288: creat d0/d3/d14/d56/d4d/f5f x:0 0 0 2024-04-18T21:06:58.562 INFO:tasks.workunit.client.0.smithi096.stdout:8/289: mknod d0/d3/d3a/c60 0 2024-04-18T21:06:58.562 INFO:tasks.workunit.client.0.smithi096.stdout:6/291: rename d1/d5/c25 to d1/d5/da/d44/c4f 0 2024-04-18T21:06:58.563 INFO:tasks.workunit.client.0.smithi096.stdout:8/290: write d0/d3/f23 [2511611,111796] 0 2024-04-18T21:06:58.564 INFO:tasks.workunit.client.0.smithi096.stdout:8/291: mkdir d0/d3/d1d/d2c/d61 0 2024-04-18T21:06:58.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/292: mknod d0/d3/d14/d56/d4d/d5a/c62 0 2024-04-18T21:06:58.565 INFO:tasks.workunit.client.0.smithi096.stdout:7/262: truncate d0/fc 309962 0 2024-04-18T21:06:58.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/293: write d0/d3/db/f2d [710561,26115] 0 2024-04-18T21:06:58.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/263: creat d0/d20/d39/f4c x:0 0 0 2024-04-18T21:06:58.566 INFO:tasks.workunit.client.0.smithi096.stdout:8/294: mkdir d0/d3/d14/d56/d4d/d63 0 2024-04-18T21:06:58.574 INFO:tasks.workunit.client.0.smithi096.stdout:9/278: dread d0/f5 [8388608,4194304] 0 2024-04-18T21:06:58.574 INFO:tasks.workunit.client.0.smithi096.stdout:2/432: dread d11/d13/f2d [0,4194304] 0 2024-04-18T21:06:58.575 INFO:tasks.workunit.client.0.smithi096.stdout:9/279: symlink d0/d28/d3d/l51 0 2024-04-18T21:06:58.575 INFO:tasks.workunit.client.0.smithi096.stdout:2/433: write d11/d50/f83 [3175018,28065] 0 2024-04-18T21:06:58.575 INFO:tasks.workunit.client.0.smithi096.stdout:3/271: dread d4/d6/d22/d20/f44 [0,4194304] 0 2024-04-18T21:06:58.576 INFO:tasks.workunit.client.0.smithi096.stdout:2/434: chown d11/d13/d1a/c22 915 1 2024-04-18T21:06:58.577 INFO:tasks.workunit.client.0.smithi096.stdout:9/280: link d0/d28/d2f/f42 d0/d8/d11/d1f/f52 0 2024-04-18T21:06:58.577 INFO:tasks.workunit.client.0.smithi096.stdout:2/435: unlink d11/d13/d1d/f2a 0 2024-04-18T21:06:58.577 INFO:tasks.workunit.client.0.smithi096.stdout:9/281: stat d0/f34 0 2024-04-18T21:06:58.577 INFO:tasks.workunit.client.0.smithi096.stdout:1/282: dread d0/f9 [0,4194304] 0 2024-04-18T21:06:58.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/282: mknod d0/d8/d11/d1f/c53 0 2024-04-18T21:06:58.578 INFO:tasks.workunit.client.0.smithi096.stdout:2/436: link d11/f16 d11/d13/d1d/d5d/f8d 0 2024-04-18T21:06:58.579 INFO:tasks.workunit.client.0.smithi096.stdout:1/283: mkdir d0/d27/d33/d5c 0 2024-04-18T21:06:58.579 INFO:tasks.workunit.client.0.smithi096.stdout:2/437: chown d11/d13/d1a/d1e 9388565 1 2024-04-18T21:06:58.579 INFO:tasks.workunit.client.0.smithi096.stdout:9/283: creat d0/d28/d3d/f54 x:0 0 0 2024-04-18T21:06:58.579 INFO:tasks.workunit.client.0.smithi096.stdout:1/284: chown d0/df/d16/d24/f31 4191286 1 2024-04-18T21:06:58.580 INFO:tasks.workunit.client.0.smithi096.stdout:2/438: mkdir d11/d50/d8e 0 2024-04-18T21:06:58.580 INFO:tasks.workunit.client.0.smithi096.stdout:9/284: creat d0/d8/d9/d40/f55 x:0 0 0 2024-04-18T21:06:58.580 INFO:tasks.workunit.client.0.smithi096.stdout:2/439: chown d11/d50/f77 161838267 1 2024-04-18T21:06:58.581 INFO:tasks.workunit.client.0.smithi096.stdout:8/295: rename d0/d2e to d0/d64 0 2024-04-18T21:06:58.581 INFO:tasks.workunit.client.0.smithi096.stdout:5/223: read d2/f2c [651970,128914] 0 2024-04-18T21:06:58.582 INFO:tasks.workunit.client.0.smithi096.stdout:2/440: dread d11/d13/f2d [0,4194304] 0 2024-04-18T21:06:58.583 INFO:tasks.workunit.client.0.smithi096.stdout:3/272: dread d4/d6/d1b/f38 [0,4194304] 0 2024-04-18T21:06:58.584 INFO:tasks.workunit.client.0.smithi096.stdout:9/285: getdents d0/d8/d9 0 2024-04-18T21:06:58.585 INFO:tasks.workunit.client.0.smithi096.stdout:3/273: write d4/d6/d1b/d2c/f43 [778651,17348] 0 2024-04-18T21:06:58.585 INFO:tasks.workunit.client.0.smithi096.stdout:2/441: symlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/l8f 0 2024-04-18T21:06:58.585 INFO:tasks.workunit.client.0.smithi096.stdout:8/296: rmdir d0/d3/d14/d56/d4d/d63 0 2024-04-18T21:06:58.586 INFO:tasks.workunit.client.0.smithi096.stdout:1/285: dread d0/d27/d4f/f51 [0,4194304] 0 2024-04-18T21:06:58.586 INFO:tasks.workunit.client.0.smithi096.stdout:2/442: chown d11/d13/d1d 2 1 2024-04-18T21:06:58.586 INFO:tasks.workunit.client.0.smithi096.stdout:3/274: read - d4/d6/d22/f3e zero size 2024-04-18T21:06:58.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/286: dread - d0/df/d16/d24/f3a zero size 2024-04-18T21:06:58.588 INFO:tasks.workunit.client.0.smithi096.stdout:3/275: creat d4/d6/d1b/d2c/d31/f52 x:0 0 0 2024-04-18T21:06:58.589 INFO:tasks.workunit.client.0.smithi096.stdout:0/277: dread d1/f12 [0,4194304] 0 2024-04-18T21:06:58.590 INFO:tasks.workunit.client.0.smithi096.stdout:5/224: dwrite d2/f16 [0,4194304] 0 2024-04-18T21:06:58.590 INFO:tasks.workunit.client.0.smithi096.stdout:7/264: dread d0/fc [0,4194304] 0 2024-04-18T21:06:58.590 INFO:tasks.workunit.client.0.smithi096.stdout:3/276: chown d4/d6/c4a 94756 1 2024-04-18T21:06:58.591 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:58.591 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:58.591 INFO:tasks.workunit.client.0.smithi096.stdout:6/292: dread d1/f1c [0,4194304] 0 2024-04-18T21:06:58.591 INFO:tasks.workunit.client.0.smithi096.stdout:1/287: getdents d0 0 2024-04-18T21:06:58.591 INFO:tasks.workunit.client.0.smithi096.stdout:7/265: readlink d0/d7/d8/l37 0 2024-04-18T21:06:58.591 INFO:tasks.workunit.client.0.smithi096.stdout:4/249: dread d2/d2f/d33/f35 [0,4194304] 0 2024-04-18T21:06:58.592 INFO:tasks.workunit.client.0.smithi096.stdout:9/286: write d0/d8/d11/f38 [119291,95695] 0 2024-04-18T21:06:58.592 INFO:tasks.workunit.client.0.smithi096.stdout:5/225: mknod d2/d11/c56 0 2024-04-18T21:06:58.592 INFO:tasks.workunit.client.0.smithi096.stdout:1/288: rmdir d0/df 39 2024-04-18T21:06:58.592 INFO:tasks.workunit.client.0.smithi096.stdout:7/266: chown d0/d7/d8/f16 300473868 1 2024-04-18T21:06:58.592 INFO:tasks.workunit.client.0.smithi096.stdout:0/278: getdents d1/d1c/d21 0 2024-04-18T21:06:58.593 INFO:tasks.workunit.client.0.smithi096.stdout:7/267: creat d0/d7/f4d x:0 0 0 2024-04-18T21:06:58.594 INFO:tasks.workunit.client.0.smithi096.stdout:5/226: dread d2/f46 [0,4194304] 0 2024-04-18T21:06:58.594 INFO:tasks.workunit.client.0.smithi096.stdout:4/250: creat d2/f50 x:0 0 0 2024-04-18T21:06:58.596 INFO:tasks.workunit.client.0.smithi096.stdout:4/251: creat d2/d1d/d3a/f51 x:0 0 0 2024-04-18T21:06:58.596 INFO:tasks.workunit.client.0.smithi096.stdout:2/443: rename d11/d13/d1a/d1e/d28/l55 to d11/d13/d1a/d1e/d28/d4e/d40/l90 0 2024-04-18T21:06:58.596 INFO:tasks.workunit.client.0.smithi096.stdout:1/289: mknod d0/d27/c5d 0 2024-04-18T21:06:58.597 INFO:tasks.workunit.client.0.smithi096.stdout:7/268: creat d0/d7/d49/f4e x:0 0 0 2024-04-18T21:06:58.597 INFO:tasks.workunit.client.0.smithi096.stdout:5/227: truncate d2/f10 1082828 0 2024-04-18T21:06:58.597 INFO:tasks.workunit.client.0.smithi096.stdout:4/252: rmdir d2/d2a 39 2024-04-18T21:06:58.598 INFO:tasks.workunit.client.0.smithi096.stdout:7/269: write d0/d20/f46 [608425,286] 0 2024-04-18T21:06:58.598 INFO:tasks.workunit.client.0.smithi096.stdout:4/253: rmdir d2/d1d 39 2024-04-18T21:06:58.598 INFO:tasks.workunit.client.0.smithi096.stdout:5/228: chown d2/l1e 2 1 2024-04-18T21:06:58.598 INFO:tasks.workunit.client.0.smithi096.stdout:2/444: symlink d11/d13/d1d/d5d/l91 0 2024-04-18T21:06:58.598 INFO:tasks.workunit.client.0.smithi096.stdout:3/277: dwrite d4/d6/d1b/d1d/f2e [0,4194304] 0 2024-04-18T21:06:58.598 INFO:tasks.workunit.client.0.smithi096.stdout:2/445: write f2 [1444019,39294] 0 2024-04-18T21:06:58.599 INFO:tasks.workunit.client.0.smithi096.stdout:5/229: chown d2/d11/f1f 683 1 2024-04-18T21:06:58.600 INFO:tasks.workunit.client.0.smithi096.stdout:5/230: truncate d2/d38/f4b 905156 0 2024-04-18T21:06:58.601 INFO:tasks.workunit.client.0.smithi096.stdout:2/446: truncate d11/d13/d1a/d1e/d28/d4e/f62 393911 0 2024-04-18T21:06:58.601 INFO:tasks.workunit.client.0.smithi096.stdout:3/278: creat d4/d6/d1b/d2c/f53 x:0 0 0 2024-04-18T21:06:58.601 INFO:tasks.workunit.client.0.smithi096.stdout:7/270: creat d0/d7/d42/f4f x:0 0 0 2024-04-18T21:06:58.601 INFO:tasks.workunit.client.0.smithi096.stdout:4/254: rename d2/f25 to d2/d1d/d3a/f52 0 2024-04-18T21:06:58.603 INFO:tasks.workunit.client.0.smithi096.stdout:3/279: mknod d4/d6/c54 0 2024-04-18T21:06:58.603 INFO:tasks.workunit.client.0.smithi096.stdout:7/271: mknod d0/d7/d8/c50 0 2024-04-18T21:06:58.603 INFO:tasks.workunit.client.0.smithi096.stdout:0/279: dwrite d1/d1c/d21/f1d [0,4194304] 0 2024-04-18T21:06:58.604 INFO:tasks.workunit.client.0.smithi096.stdout:4/255: symlink d2/d2f/d33/l53 0 2024-04-18T21:06:58.604 INFO:tasks.workunit.client.0.smithi096.stdout:5/231: rename d2/d11/l49 to d2/d11/d28/d4a/l57 0 2024-04-18T21:06:58.604 INFO:tasks.workunit.client.0.smithi096.stdout:5/232: chown f0 2 1 2024-04-18T21:06:58.605 INFO:tasks.workunit.client.0.smithi096.stdout:0/280: fdatasync d1/d1c/d21/fe 0 2024-04-18T21:06:58.605 INFO:tasks.workunit.client.0.smithi096.stdout:3/280: creat d4/d6/d1b/d2c/d31/d11/f55 x:0 0 0 2024-04-18T21:06:58.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/256: read d2/d1d/f17 [1433578,35620] 0 2024-04-18T21:06:58.605 INFO:tasks.workunit.client.0.smithi096.stdout:2/447: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f92 x:0 0 0 2024-04-18T21:06:58.605 INFO:tasks.workunit.client.0.smithi096.stdout:1/290: dwrite d0/df/d16/f50 [0,4194304] 0 2024-04-18T21:06:58.607 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:58.605+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:58.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/233: mknod d2/d11/d28/d4a/c58 0 2024-04-18T21:06:58.608 INFO:tasks.workunit.client.0.smithi096.stdout:5/234: fdatasync d2/f27 0 2024-04-18T21:06:58.608 INFO:tasks.workunit.client.0.smithi096.stdout:1/291: rmdir d0/df/d16/d24 39 2024-04-18T21:06:58.608 INFO:tasks.workunit.client.0.smithi096.stdout:0/281: mknod d1/d1c/d21/d58/c5f 0 2024-04-18T21:06:58.609 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:58.610 INFO:tasks.workunit.client.0.smithi096.stdout:2/448: creat d11/d13/d1a/d1e/d28/d4e/f93 x:0 0 0 2024-04-18T21:06:58.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/235: write d2/d38/f4b [1718838,43469] 0 2024-04-18T21:06:58.612 INFO:tasks.workunit.client.0.smithi096.stdout:1/292: stat d0/df/d16/d24/f2b 0 2024-04-18T21:06:58.612 INFO:tasks.workunit.client.0.smithi096.stdout:7/272: dwrite d0/d20/f47 [0,4194304] 0 2024-04-18T21:06:58.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/257: dread d2/d2f/d33/f3b [0,4194304] 0 2024-04-18T21:06:58.613 INFO:tasks.workunit.client.0.smithi096.stdout:1/293: symlink d0/d27/d33/l5e 0 2024-04-18T21:06:58.613 INFO:tasks.workunit.client.0.smithi096.stdout:2/449: fsync d11/d13/d1a/d1e/d28/d4e/d40/f60 0 2024-04-18T21:06:58.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/294: chown d0/l2 18 1 2024-04-18T21:06:58.616 INFO:tasks.workunit.client.0.smithi096.stdout:9/287: dwrite d0/d28/d2f/f42 [0,4194304] 0 2024-04-18T21:06:58.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/236: dwrite d2/d11/f2d [0,4194304] 0 2024-04-18T21:06:58.618 INFO:tasks.workunit.client.0.smithi096.stdout:2/450: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d94 0 2024-04-18T21:06:58.619 INFO:tasks.workunit.client.0.smithi096.stdout:2/451: write d11/d13/f2f [2459124,113642] 0 2024-04-18T21:06:58.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/295: rename d0/d27/d4f to d0/d27/d5f 0 2024-04-18T21:06:58.619 INFO:tasks.workunit.client.0.smithi096.stdout:4/258: dwrite d2/f2c [0,4194304] 0 2024-04-18T21:06:58.619 INFO:tasks.workunit.client.0.smithi096.stdout:5/237: creat d2/d11/d28/d4a/f59 x:0 0 0 2024-04-18T21:06:58.620 INFO:tasks.workunit.client.0.smithi096.stdout:9/288: creat d0/d8/d9/d40/d43/d4b/f56 x:0 0 0 2024-04-18T21:06:58.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/296: mkdir d0/d27/d5f/d60 0 2024-04-18T21:06:58.622 INFO:tasks.workunit.client.0.smithi096.stdout:4/259: unlink d2/d2a/c32 0 2024-04-18T21:06:58.622 INFO:tasks.workunit.client.0.smithi096.stdout:4/260: unlink d2/d1d/f4f 0 2024-04-18T21:06:58.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/297: link d0/d27/d33/f3d d0/df/f61 0 2024-04-18T21:06:58.623 INFO:tasks.workunit.client.0.smithi096.stdout:4/261: mkdir d2/d2a/d54 0 2024-04-18T21:06:58.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/293: dread d1/d6/f9 [4194304,4194304] 0 2024-04-18T21:06:58.624 INFO:tasks.workunit.client.0.smithi096.stdout:4/262: truncate d2/d2f/f36 1329164 0 2024-04-18T21:06:58.626 INFO:tasks.workunit.client.0.smithi096.stdout:4/263: mkdir d2/d2f/d33/d55 0 2024-04-18T21:06:58.627 INFO:tasks.workunit.client.0.smithi096.stdout:2/452: dwrite d11/d13/f2d [0,4194304] 0 2024-04-18T21:06:58.627 INFO:tasks.workunit.client.0.smithi096.stdout:4/264: mknod d2/c56 0 2024-04-18T21:06:58.627 INFO:tasks.workunit.client.0.smithi096.stdout:8/297: dread d0/f32 [0,4194304] 0 2024-04-18T21:06:58.628 INFO:tasks.workunit.client.0.smithi096.stdout:0/282: rename d1/d1c to d1/db/d30/d31/d39/d5d/d60 0 2024-04-18T21:06:58.630 INFO:tasks.workunit.client.0.smithi096.stdout:7/273: rename d0/d7/d8/c50 to d0/d20/d4b/c51 0 2024-04-18T21:06:58.630 INFO:tasks.workunit.client.0.smithi096.stdout:4/265: mkdir d2/d2f/d33/d55/d57 0 2024-04-18T21:06:58.630 INFO:tasks.workunit.client.0.smithi096.stdout:6/294: dread d1/d5/f15 [0,4194304] 0 2024-04-18T21:06:58.630 INFO:tasks.workunit.client.0.smithi096.stdout:2/453: creat d11/d13/d1a/d1e/d28/d4e/d80/f95 x:0 0 0 2024-04-18T21:06:58.631 INFO:tasks.workunit.client.0.smithi096.stdout:4/266: readlink d2/l2d 0 2024-04-18T21:06:58.631 INFO:tasks.workunit.client.0.smithi096.stdout:1/298: dwrite d0/d27/f38 [0,4194304] 0 2024-04-18T21:06:58.632 INFO:tasks.workunit.client.0.smithi096.stdout:0/283: mknod d1/db/d30/d31/d39/d5d/d60/d21/c61 0 2024-04-18T21:06:58.632 INFO:tasks.workunit.client.0.smithi096.stdout:8/298: rename d0/d3/d14 to d0/d3/d14/d65 22 2024-04-18T21:06:58.632 INFO:tasks.workunit.client.0.smithi096.stdout:7/274: unlink d0/d20/d39/l3a 0 2024-04-18T21:06:58.632 INFO:tasks.workunit.client.0.smithi096.stdout:6/295: rmdir d1/d6/d26 39 2024-04-18T21:06:58.633 INFO:tasks.workunit.client.0.smithi096.stdout:2/454: write d11/d13/d1a/d1e/d28/d4e/d40/f60 [4465064,62012] 0 2024-04-18T21:06:58.633 INFO:tasks.workunit.client.0.smithi096.stdout:7/275: rmdir d0/d7/d2f 39 2024-04-18T21:06:58.633 INFO:tasks.workunit.client.0.smithi096.stdout:8/299: write d0/d3/d14/d33/f48 [712831,102357] 0 2024-04-18T21:06:58.634 INFO:tasks.workunit.client.0.smithi096.stdout:1/299: mkdir d0/df/d62 0 2024-04-18T21:06:58.634 INFO:tasks.workunit.client.0.smithi096.stdout:8/300: unlink d0/d3/d1d/d2c/c37 0 2024-04-18T21:06:58.635 INFO:tasks.workunit.client.0.smithi096.stdout:5/238: dread f0 [0,4194304] 0 2024-04-18T21:06:58.636 INFO:tasks.workunit.client.0.smithi096.stdout:6/296: mknod d1/d5/c50 0 2024-04-18T21:06:58.637 INFO:tasks.workunit.client.0.smithi096.stdout:8/301: mkdir d0/d3/d1d/d66 0 2024-04-18T21:06:58.637 INFO:tasks.workunit.client.0.smithi096.stdout:7/276: creat d0/f52 x:0 0 0 2024-04-18T21:06:58.637 INFO:tasks.workunit.client.0.smithi096.stdout:2/455: creat d11/d13/d1a/d1e/f96 x:0 0 0 2024-04-18T21:06:58.637 INFO:tasks.workunit.client.0.smithi096.stdout:1/300: symlink d0/df/d62/l63 0 2024-04-18T21:06:58.637 INFO:tasks.workunit.client.0.smithi096.stdout:0/284: getdents d1/db/d30/d31 0 2024-04-18T21:06:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:5/239: mknod d2/d38/c5a 0 2024-04-18T21:06:58.639 INFO:tasks.workunit.client.0.smithi096.stdout:6/297: dread d1/d5/f1a [4194304,4194304] 0 2024-04-18T21:06:58.639 INFO:tasks.workunit.client.0.smithi096.stdout:2/456: unlink d11/d13/d1d/d5d/l91 0 2024-04-18T21:06:58.640 INFO:tasks.workunit.client.0.smithi096.stdout:6/298: chown d1/f3 8057506 1 2024-04-18T21:06:58.640 INFO:tasks.workunit.client.0.smithi096.stdout:2/457: chown d11/d13/d1a/d1e/l23 15754 1 2024-04-18T21:06:58.642 INFO:tasks.workunit.client.0.smithi096.stdout:4/267: dwrite d2/f4c [0,4194304] 0 2024-04-18T21:06:58.642 INFO:tasks.workunit.client.0.smithi096.stdout:2/458: mkdir d11/d13/d1d/d5d/d97 0 2024-04-18T21:06:58.642 INFO:tasks.workunit.client.0.smithi096.stdout:6/299: creat d1/d3a/d36/f51 x:0 0 0 2024-04-18T21:06:58.642 INFO:tasks.workunit.client.0.smithi096.stdout:4/268: stat d2/f18 0 2024-04-18T21:06:58.644 INFO:tasks.workunit.client.0.smithi096.stdout:2/459: write d11/d50/f71 [675842,102129] 0 2024-04-18T21:06:58.644 INFO:tasks.workunit.client.0.smithi096.stdout:4/269: rmdir d2/d2f/d39/d43 39 2024-04-18T21:06:58.645 INFO:tasks.workunit.client.0.smithi096.stdout:1/301: dwrite d0/df/f1a [0,4194304] 0 2024-04-18T21:06:58.646 INFO:tasks.workunit.client.0.smithi096.stdout:2/460: mknod d11/d13/d1a/d1e/d28/d4e/d80/c98 0 2024-04-18T21:06:58.646 INFO:tasks.workunit.client.0.smithi096.stdout:8/302: dwrite d0/d3/d14/d1b/f20 [0,4194304] 0 2024-04-18T21:06:58.648 INFO:tasks.workunit.client.0.smithi096.stdout:1/302: write d0/df/d16/d24/f35 [1028255,75998] 0 2024-04-18T21:06:58.648 INFO:tasks.workunit.client.0.smithi096.stdout:6/300: dread d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:58.648 INFO:tasks.workunit.client.0.smithi096.stdout:2/461: truncate d11/d13/d1a/d1e/d28/f59 933058 0 2024-04-18T21:06:58.649 INFO:tasks.workunit.client.0.smithi096.stdout:2/462: chown d11/d13/d1d/d5d 520 1 2024-04-18T21:06:58.649 INFO:tasks.workunit.client.0.smithi096.stdout:6/301: chown d1/d6/d26 3286240 1 2024-04-18T21:06:58.650 INFO:tasks.workunit.client.0.smithi096.stdout:1/303: creat d0/df/f64 x:0 0 0 2024-04-18T21:06:58.650 INFO:tasks.workunit.client.0.smithi096.stdout:4/270: dread d2/d2f/d33/f35 [0,4194304] 0 2024-04-18T21:06:58.651 INFO:tasks.workunit.client.0.smithi096.stdout:4/271: unlink d2/d1d/f17 0 2024-04-18T21:06:58.651 INFO:tasks.workunit.client.0.smithi096.stdout:2/463: creat d11/d50/d8e/f99 x:0 0 0 2024-04-18T21:06:58.652 INFO:tasks.workunit.client.0.smithi096.stdout:4/272: read d2/f2c [3781660,58412] 0 2024-04-18T21:06:58.653 INFO:tasks.workunit.client.0.smithi096.stdout:7/277: read d0/d7/d8/f26 [2807958,44549] 0 2024-04-18T21:06:58.653 INFO:tasks.workunit.client.0.smithi096.stdout:8/303: dwrite d0/d3/f18 [0,4194304] 0 2024-04-18T21:06:58.654 INFO:tasks.workunit.client.0.smithi096.stdout:4/273: creat d2/f58 x:0 0 0 2024-04-18T21:06:58.654 INFO:tasks.workunit.client.0.smithi096.stdout:7/278: fdatasync d0/d20/f34 0 2024-04-18T21:06:58.654 INFO:tasks.workunit.client.0.smithi096.stdout:8/304: read - d0/d3/d14/f31 zero size 2024-04-18T21:06:58.655 INFO:tasks.workunit.client.0.smithi096.stdout:2/464: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/d9a 0 2024-04-18T21:06:58.655 INFO:tasks.workunit.client.0.smithi096.stdout:4/274: mkdir d2/d2f/d33/d55/d59 0 2024-04-18T21:06:58.655 INFO:tasks.workunit.client.0.smithi096.stdout:4/275: creat d2/d2f/f5a x:0 0 0 2024-04-18T21:06:58.656 INFO:tasks.workunit.client.0.smithi096.stdout:2/465: creat d11/d13/d1a/d1e/d28/d4e/d63/f9b x:0 0 0 2024-04-18T21:06:58.657 INFO:tasks.workunit.client.0.smithi096.stdout:3/281: dread d4/d8/f3d [0,4194304] 0 2024-04-18T21:06:58.658 INFO:tasks.workunit.client.0.smithi096.stdout:2/466: link d11/d13/d1a/d1e/d28/d4e/d80/f95 d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/f9c 0 2024-04-18T21:06:58.658 INFO:tasks.workunit.client.0.smithi096.stdout:2/467: rename c9 to d11/d13/d1a/d1e/d28/c9d 0 2024-04-18T21:06:58.659 INFO:tasks.workunit.client.0.smithi096.stdout:2/468: write d11/d13/d1a/d1e/d28/d4e/d40/f60 [2448996,56162] 0 2024-04-18T21:06:58.661 INFO:tasks.workunit.client.0.smithi096.stdout:2/469: rename d11/d13/d1a/d1e/d28/f2e to d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f9e 0 2024-04-18T21:06:58.663 INFO:tasks.workunit.client.0.smithi096.stdout:2/470: rename d11/d13/d1a/d1e/d28/d4e/d40/d51/d79 to d11/d13/d1a/d1e/d9f 0 2024-04-18T21:06:58.663 INFO:tasks.workunit.client.0.smithi096.stdout:4/276: read d2/f31 [1358027,27586] 0 2024-04-18T21:06:58.664 INFO:tasks.workunit.client.0.smithi096.stdout:4/277: mkdir d2/d2a/d54/d5b 0 2024-04-18T21:06:58.665 INFO:tasks.workunit.client.0.smithi096.stdout:0/285: fsync d1/db/d30/d31/d39/d5d/d60/d21/f3f 0 2024-04-18T21:06:58.665 INFO:tasks.workunit.client.0.smithi096.stdout:6/302: write d1/d6/d26/fb [1965708,104836] 0 2024-04-18T21:06:58.666 INFO:tasks.workunit.client.0.smithi096.stdout:0/286: stat d1/db/d30/d31/d39/f55 0 2024-04-18T21:06:58.667 INFO:tasks.workunit.client.0.smithi096.stdout:6/303: mkdir d1/d5/da/d44/d4e/d52 0 2024-04-18T21:06:58.667 INFO:tasks.workunit.client.0.smithi096.stdout:0/287: rename d1/f12 to d1/f62 0 2024-04-18T21:06:58.667 INFO:tasks.workunit.client.0.smithi096.stdout:6/304: unlink d1/d5/c40 0 2024-04-18T21:06:58.668 INFO:tasks.workunit.client.0.smithi096.stdout:0/288: symlink d1/db/d30/d4a/l63 0 2024-04-18T21:06:58.668 INFO:tasks.workunit.client.0.smithi096.stdout:5/240: dread d2/d38/f4b [0,4194304] 0 2024-04-18T21:06:58.669 INFO:tasks.workunit.client.0.smithi096.stdout:6/305: creat d1/d3a/f53 x:0 0 0 2024-04-18T21:06:58.669 INFO:tasks.workunit.client.0.smithi096.stdout:0/289: chown d1/db/d30/d4a 690428386 1 2024-04-18T21:06:58.670 INFO:tasks.workunit.client.0.smithi096.stdout:5/241: creat d2/d11/f5b x:0 0 0 2024-04-18T21:06:58.670 INFO:tasks.workunit.client.0.smithi096.stdout:0/290: dread - d1/db/d30/d31/d39/d5d/d60/f1f zero size 2024-04-18T21:06:58.671 INFO:tasks.workunit.client.0.smithi096.stdout:5/242: unlink d2/d11/c41 0 2024-04-18T21:06:58.671 INFO:tasks.workunit.client.0.smithi096.stdout:4/278: dwrite d2/d2f/d33/f35 [4194304,4194304] 0 2024-04-18T21:06:58.675 INFO:tasks.workunit.client.0.smithi096.stdout:6/306: dwrite d1/d5/f1a [0,4194304] 0 2024-04-18T21:06:58.676 INFO:tasks.workunit.client.0.smithi096.stdout:5/243: creat d2/d18/f5c x:0 0 0 2024-04-18T21:06:58.677 INFO:tasks.workunit.client.0.smithi096.stdout:4/279: creat d2/d2f/d33/d55/d57/f5c x:0 0 0 2024-04-18T21:06:58.677 INFO:tasks.workunit.client.0.smithi096.stdout:6/307: creat d1/d5/da/d44/d4e/d52/f54 x:0 0 0 2024-04-18T21:06:58.687 INFO:tasks.workunit.client.0.smithi096.stdout:5/244: dread d2/f2c [0,4194304] 0 2024-04-18T21:06:58.688 INFO:tasks.workunit.client.0.smithi096.stdout:5/245: write d2/d38/d4c/f4e [621317,14319] 0 2024-04-18T21:06:58.688 INFO:tasks.workunit.client.0.smithi096.stdout:5/246: stat d2/d11/l30 0 2024-04-18T21:06:58.689 INFO:tasks.workunit.client.0.smithi096.stdout:5/247: rmdir d2/d18 39 2024-04-18T21:06:58.690 INFO:tasks.workunit.client.0.smithi096.stdout:9/289: dread d0/d8/d9/f23 [0,4194304] 0 2024-04-18T21:06:58.691 INFO:tasks.workunit.client.0.smithi096.stdout:9/290: write d0/d8/d9/d40/f55 [1016412,42708] 0 2024-04-18T21:06:58.691 INFO:tasks.workunit.client.0.smithi096.stdout:0/291: dread d1/db/d30/d31/d39/d5d/d60/d21/fe [0,4194304] 0 2024-04-18T21:06:58.692 INFO:tasks.workunit.client.0.smithi096.stdout:9/291: creat d0/d8/d11/d48/f57 x:0 0 0 2024-04-18T21:06:58.692 INFO:tasks.workunit.client.0.smithi096.stdout:5/248: truncate d2/d18/f32 554158 0 2024-04-18T21:06:58.692 INFO:tasks.workunit.client.0.smithi096.stdout:3/282: sync 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi096.stdout:8/305: dread d0/d3/d1d/f24 [0,4194304] 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi096.stdout:3/283: chown d4/d6/c54 0 1 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi096.stdout:9/292: chown d0/d8/d9/d40/f4e 57 1 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi096.stdout:0/292: getdents d1/db/d30/d31/d39/d5d/d60 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi096.stdout:8/306: mknod d0/d3/d14/d56/d4d/c67 0 2024-04-18T21:06:58.694 INFO:tasks.workunit.client.0.smithi096.stdout:0/293: chown d1/db/d30/d31/d39/d5d/d60/d21/c45 1 1 2024-04-18T21:06:58.694 INFO:tasks.workunit.client.0.smithi096.stdout:8/307: dread - d0/d64/f42 zero size 2024-04-18T21:06:58.695 INFO:tasks.workunit.client.0.smithi096.stdout:0/294: fdatasync d1/db/d30/d31/f3b 0 2024-04-18T21:06:58.695 INFO:tasks.workunit.client.0.smithi096.stdout:8/308: unlink d0/d64/d43/f5c 0 2024-04-18T21:06:58.696 INFO:tasks.workunit.client.0.smithi096.stdout:0/295: mknod d1/db/d25/d54/c64 0 2024-04-18T21:06:58.696 INFO:tasks.workunit.client.0.smithi096.stdout:8/309: mkdir d0/d3/d1d/d66/d68 0 2024-04-18T21:06:58.697 INFO:tasks.workunit.client.0.smithi096.stdout:0/296: read - d1/d23/d32/d43/f4f zero size 2024-04-18T21:06:58.697 INFO:tasks.workunit.client.0.smithi096.stdout:3/284: dread d4/d6/d1b/f3a [0,4194304] 0 2024-04-18T21:06:58.697 INFO:tasks.workunit.client.0.smithi096.stdout:8/310: creat d0/d3/d14/d33/f69 x:0 0 0 2024-04-18T21:06:58.699 INFO:tasks.workunit.client.0.smithi096.stdout:5/249: dwrite d2/f2b [0,4194304] 0 2024-04-18T21:06:58.699 INFO:tasks.workunit.client.0.smithi096.stdout:8/311: creat d0/d3/db/f6a x:0 0 0 2024-04-18T21:06:58.700 INFO:tasks.workunit.client.0.smithi096.stdout:8/312: chown d0/d3/d14/d56/l2b 1516570149 1 2024-04-18T21:06:58.700 INFO:tasks.workunit.client.0.smithi096.stdout:4/280: dread d2/d2f/d39/f4b [0,4194304] 0 2024-04-18T21:06:58.700 INFO:tasks.workunit.client.0.smithi096.stdout:1/304: dread d0/df/d16/d24/f2b [0,4194304] 0 2024-04-18T21:06:58.700 INFO:tasks.workunit.client.0.smithi096.stdout:3/285: dread d4/f35 [0,4194304] 0 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi096.stdout:8/313: rename d0/d3/d14/d33/f48 to d0/d3/d14/d33/f6b 0 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi096.stdout:1/305: mkdir d0/d27/d33/d5c/d65 0 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi096.stdout:4/281: symlink d2/l5d 0 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi096.stdout:8/314: chown d0/d3/d14/d33 8885250 1 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi096.stdout:4/282: dread - d2/f50 zero size 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi096.stdout:1/306: mknod d0/d27/d5f/d60/c66 0 2024-04-18T21:06:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:8/315: symlink d0/d3/d14/d33/l6c 0 2024-04-18T21:06:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:4/283: creat d2/d1d/f5e x:0 0 0 2024-04-18T21:06:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:8/316: write d0/d3/db/f15 [1115366,59762] 0 2024-04-18T21:06:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:4/284: mkdir d2/d2f/d33/d55/d59/d5f 0 2024-04-18T21:06:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:8/317: dread - d0/d3/d14/f31 zero size 2024-04-18T21:06:58.704 INFO:tasks.workunit.client.0.smithi096.stdout:1/307: link d0/df/d30/l4b d0/df/d16/d24/l67 0 2024-04-18T21:06:58.704 INFO:tasks.workunit.client.0.smithi096.stdout:8/318: readlink d0/d64/l51 0 2024-04-18T21:06:58.705 INFO:tasks.workunit.client.0.smithi096.stdout:4/285: getdents d2/d2a/d54/d5b 0 2024-04-18T21:06:58.705 INFO:tasks.workunit.client.0.smithi096.stdout:1/308: creat d0/df/d16/f68 x:0 0 0 2024-04-18T21:06:58.706 INFO:tasks.workunit.client.0.smithi096.stdout:4/286: creat d2/f60 x:0 0 0 2024-04-18T21:06:58.706 INFO:tasks.workunit.client.0.smithi096.stdout:4/287: readlink d2/d1d/l47 0 2024-04-18T21:06:58.707 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:58.707+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:58.707 INFO:tasks.workunit.client.0.smithi096.stdout:3/286: dwrite d4/f35 [0,4194304] 0 2024-04-18T21:06:58.709 INFO:tasks.workunit.client.0.smithi096.stdout:3/287: fsync d4/d6/d1b/d2c/d31/d11/f40 0 2024-04-18T21:06:58.712 INFO:tasks.workunit.client.0.smithi096.stdout:4/288: dwrite d2/f9 [0,4194304] 0 2024-04-18T21:06:58.715 INFO:tasks.workunit.client.0.smithi096.stdout:4/289: dread d2/f4c [0,4194304] 0 2024-04-18T21:06:58.730 INFO:tasks.workunit.client.0.smithi096.stdout:0/297: dread d1/db/d30/d31/d39/d5d/d60/d21/f3f [4194304,4194304] 0 2024-04-18T21:06:58.731 INFO:tasks.workunit.client.0.smithi096.stdout:0/298: rmdir d1/db 39 2024-04-18T21:06:58.732 INFO:tasks.workunit.client.0.smithi096.stdout:0/299: mkdir d1/db/d30/d31/d65 0 2024-04-18T21:06:58.736 INFO:tasks.workunit.client.0.smithi096.stdout:7/279: truncate d0/d20/f46 476335 0 2024-04-18T21:06:58.736 INFO:tasks.workunit.client.0.smithi096.stdout:7/280: fsync d0/d7/fb 0 2024-04-18T21:06:58.736 INFO:tasks.workunit.client.0.smithi096.stdout:7/281: chown d0/d7/ca 90801628 1 2024-04-18T21:06:58.737 INFO:tasks.workunit.client.0.smithi096.stdout:3/288: dread d4/d8/f1f [0,4194304] 0 2024-04-18T21:06:58.737 INFO:tasks.workunit.client.0.smithi096.stdout:3/289: creat d4/d6/d22/d20/d46/f56 x:0 0 0 2024-04-18T21:06:58.738 INFO:tasks.workunit.client.0.smithi096.stdout:3/290: write d4/d6/d1b/d2c/f53 [314527,31922] 0 2024-04-18T21:06:58.738 INFO:tasks.workunit.client.0.smithi096.stdout:3/291: dread - d4/d6/d1b/d2c/d31/d11/f55 zero size 2024-04-18T21:06:58.739 INFO:tasks.workunit.client.0.smithi096.stdout:3/292: readlink d4/d6/l17 0 2024-04-18T21:06:58.739 INFO:tasks.workunit.client.0.smithi096.stdout:2/471: link d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f9e d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/fa0 0 2024-04-18T21:06:58.740 INFO:tasks.workunit.client.0.smithi096.stdout:3/293: stat d4/d8/d49 0 2024-04-18T21:06:58.740 INFO:tasks.workunit.client.0.smithi096.stdout:3/294: creat d4/d6/d1b/d2c/f57 x:0 0 0 2024-04-18T21:06:58.740 INFO:tasks.workunit.client.0.smithi096.stdout:2/472: write d11/d13/d1a/d1e/d28/d4e/d40/f60 [5344639,89842] 0 2024-04-18T21:06:58.741 INFO:tasks.workunit.client.0.smithi096.stdout:3/295: mknod d4/c58 0 2024-04-18T21:06:58.742 INFO:tasks.workunit.client.0.smithi096.stdout:7/282: dwrite d0/d7/d42/f4f [0,4194304] 0 2024-04-18T21:06:58.744 INFO:tasks.workunit.client.0.smithi096.stdout:7/283: readlink d0/d20/d39/l3d 0 2024-04-18T21:06:58.745 INFO:tasks.workunit.client.0.smithi096.stdout:4/290: dread - d2/d1d/d3a/f51 zero size 2024-04-18T21:06:58.745 INFO:tasks.workunit.client.0.smithi096.stdout:4/291: fsync d2/fc 0 2024-04-18T21:06:58.746 INFO:tasks.workunit.client.0.smithi096.stdout:4/292: write d2/f38 [4187175,2684] 0 2024-04-18T21:06:58.746 INFO:tasks.workunit.client.0.smithi096.stdout:2/473: dread d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/fa0 [0,4194304] 0 2024-04-18T21:06:58.747 INFO:tasks.workunit.client.0.smithi096.stdout:4/293: write d2/f1f [2937092,72460] 0 2024-04-18T21:06:58.748 INFO:tasks.workunit.client.0.smithi096.stdout:4/294: write d2/f4c [2262242,12553] 0 2024-04-18T21:06:58.748 INFO:tasks.workunit.client.0.smithi096.stdout:2/474: truncate d11/d50/d5b/f8c 792926 0 2024-04-18T21:06:58.748 INFO:tasks.workunit.client.0.smithi096.stdout:4/295: chown d2 13116 1 2024-04-18T21:06:58.748 INFO:tasks.workunit.client.0.smithi096.stdout:2/475: fdatasync d11/d50/d8e/f99 0 2024-04-18T21:06:58.748 INFO:tasks.workunit.client.0.smithi096.stdout:4/296: read d2/f2c [1400170,40797] 0 2024-04-18T21:06:58.749 INFO:tasks.workunit.client.0.smithi096.stdout:4/297: chown d2/d1d/l47 0 1 2024-04-18T21:06:58.750 INFO:tasks.workunit.client.0.smithi096.stdout:8/319: sync 2024-04-18T21:06:58.750 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:58.750 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:58.750 INFO:tasks.workunit.client.0.smithi096.stdout:8/320: stat d0/d3/d14/d1b/f1f 0 2024-04-18T21:06:58.751 INFO:tasks.workunit.client.0.smithi096.stdout:6/308: dwrite d1/d5/ff [0,4194304] 0 2024-04-18T21:06:58.752 INFO:tasks.workunit.client.0.smithi096.stdout:8/321: getdents d0/d3/d14/d56/d2f 0 2024-04-18T21:06:58.754 INFO:tasks.workunit.client.0.smithi096.stdout:2/476: read fb [4872684,97009] 0 2024-04-18T21:06:58.756 INFO:tasks.workunit.client.0.smithi096.stdout:9/293: dwrite d0/d28/d2f/f17 [0,4194304] 0 2024-04-18T21:06:58.757 INFO:tasks.workunit.client.0.smithi096.stdout:5/250: write d2/fd [426077,93642] 0 2024-04-18T21:06:58.758 INFO:tasks.workunit.client.0.smithi096.stdout:5/251: dread - d2/d11/f3b zero size 2024-04-18T21:06:58.759 INFO:tasks.workunit.client.0.smithi096.stdout:5/252: write d2/d11/f21 [2128085,130587] 0 2024-04-18T21:06:58.759 INFO:tasks.workunit.client.0.smithi096.stdout:5/253: creat d2/d18/f5d x:0 0 0 2024-04-18T21:06:58.760 INFO:tasks.workunit.client.0.smithi096.stdout:5/254: chown d2/d11/f1f 13123399 1 2024-04-18T21:06:58.761 INFO:tasks.workunit.client.0.smithi096.stdout:5/255: creat d2/d38/d4c/f5e x:0 0 0 2024-04-18T21:06:58.761 INFO:tasks.workunit.client.0.smithi096.stdout:1/309: truncate d0/df/f1a 63882 0 2024-04-18T21:06:58.761 INFO:tasks.workunit.client.0.smithi096.stdout:9/294: dwrite d0/dc/f36 [0,4194304] 0 2024-04-18T21:06:58.762 INFO:tasks.workunit.client.0.smithi096.stdout:5/256: truncate d2/d18/fe 872535 0 2024-04-18T21:06:58.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/295: write d0/d8/d11/f38 [232059,37412] 0 2024-04-18T21:06:58.763 INFO:tasks.workunit.client.0.smithi096.stdout:5/257: symlink d2/d11/d28/d4a/d55/l5f 0 2024-04-18T21:06:58.763 INFO:tasks.workunit.client.0.smithi096.stdout:9/296: write d0/f5 [12710095,19696] 0 2024-04-18T21:06:58.765 INFO:tasks.workunit.client.0.smithi096.stdout:9/297: creat d0/f58 x:0 0 0 2024-04-18T21:06:58.765 INFO:tasks.workunit.client.0.smithi096.stdout:5/258: link d2/f16 d2/d11/d28/d4a/d55/f60 0 2024-04-18T21:06:58.767 INFO:tasks.workunit.client.0.smithi096.stdout:1/310: dwrite d0/df/d16/d24/f4a [0,4194304] 0 2024-04-18T21:06:58.770 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:58.771 INFO:tasks.workunit.client.0.smithi096.stdout:3/296: getdents d4 0 2024-04-18T21:06:58.771 INFO:tasks.workunit.client.0.smithi096.stdout:3/297: symlink d4/d8/l59 0 2024-04-18T21:06:58.772 INFO:tasks.workunit.client.0.smithi096.stdout:3/298: unlink d4/d8/l26 0 2024-04-18T21:06:58.772 INFO:tasks.workunit.client.0.smithi096.stdout:3/299: fsync d4/f35 0 2024-04-18T21:06:58.773 INFO:tasks.workunit.client.0.smithi096.stdout:3/300: creat d4/d6/d1b/d2c/f5a x:0 0 0 2024-04-18T21:06:58.773 INFO:tasks.workunit.client.0.smithi096.stdout:5/259: truncate d2/f2b 3723858 0 2024-04-18T21:06:58.774 INFO:tasks.workunit.client.0.smithi096.stdout:9/298: truncate d0/d8/d11/d1f/f52 2614514 0 2024-04-18T21:06:58.775 INFO:tasks.workunit.client.0.smithi096.stdout:7/284: dwrite d0/d7/ff [0,4194304] 0 2024-04-18T21:06:58.775 INFO:tasks.workunit.client.0.smithi096.stdout:3/301: write d4/d6/d1b/d2c/f57 [538065,97700] 0 2024-04-18T21:06:58.775 INFO:tasks.workunit.client.0.smithi096.stdout:5/260: truncate d2/f15 4061322 0 2024-04-18T21:06:58.775 INFO:tasks.workunit.client.0.smithi096.stdout:5/261: fsync d2/f27 0 2024-04-18T21:06:58.776 INFO:tasks.workunit.client.0.smithi096.stdout:5/262: readlink d2/d18/l50 0 2024-04-18T21:06:58.776 INFO:tasks.workunit.client.0.smithi096.stdout:7/285: write d0/d11/f32 [1053753,76940] 0 2024-04-18T21:06:58.776 INFO:tasks.workunit.client.0.smithi096.stdout:3/302: creat d4/d6/d1b/d2c/d31/d11/f5b x:0 0 0 2024-04-18T21:06:58.776 INFO:tasks.workunit.client.0.smithi096.stdout:1/311: dread d0/df/f61 [0,4194304] 0 2024-04-18T21:06:58.776 INFO:tasks.workunit.client.0.smithi096.stdout:5/263: mkdir d2/d18/d61 0 2024-04-18T21:06:58.776 INFO:tasks.workunit.client.0.smithi096.stdout:1/312: chown d0/df/d16 2204446 1 2024-04-18T21:06:58.777 INFO:tasks.workunit.client.0.smithi096.stdout:3/303: mkdir d4/d6/d1b/d2c/d5c 0 2024-04-18T21:06:58.777 INFO:tasks.workunit.client.0.smithi096.stdout:1/313: dread - d0/df/d16/f55 zero size 2024-04-18T21:06:58.777 INFO:tasks.workunit.client.0.smithi096.stdout:7/286: mkdir d0/d7/d2f/d53 0 2024-04-18T21:06:58.777 INFO:tasks.workunit.client.0.smithi096.stdout:5/264: link d2/d18/l50 d2/d18/l62 0 2024-04-18T21:06:58.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/304: read d4/d6/d1b/d2c/f57 [544353,105315] 0 2024-04-18T21:06:58.778 INFO:tasks.workunit.client.0.smithi096.stdout:1/314: chown d0/d27/l20 3 1 2024-04-18T21:06:58.778 INFO:tasks.workunit.client.0.smithi096.stdout:1/315: stat d0/c1d 0 2024-04-18T21:06:58.778 INFO:tasks.workunit.client.0.smithi096.stdout:5/265: getdents d2 0 2024-04-18T21:06:58.779 INFO:tasks.workunit.client.0.smithi096.stdout:3/305: link d4/d6/d1b/d2c/d31/d11/f5b d4/d6/d1b/d2c/d31/f5d 0 2024-04-18T21:06:58.779 INFO:tasks.workunit.client.0.smithi096.stdout:5/266: chown d2/d11/d28/d4a/l54 143 1 2024-04-18T21:06:58.779 INFO:tasks.workunit.client.0.smithi096.stdout:1/316: rename d0/d27/d33/d5c to d0/df/d62/d69 0 2024-04-18T21:06:58.780 INFO:tasks.workunit.client.0.smithi096.stdout:1/317: mkdir d0/df/d62/d69/d6a 0 2024-04-18T21:06:58.780 INFO:tasks.workunit.client.0.smithi096.stdout:5/267: rename d2/d18/f32 to d2/d38/f63 0 2024-04-18T21:06:58.780 INFO:tasks.workunit.client.0.smithi096.stdout:0/300: truncate d1/db/d30/d31/f4c 767090 0 2024-04-18T21:06:58.781 INFO:tasks.workunit.client.0.smithi096.stdout:1/318: write d0/df/d16/d24/f35 [2422269,40553] 0 2024-04-18T21:06:58.781 INFO:tasks.workunit.client.0.smithi096.stdout:5/268: mkdir d2/d11/d28/d64 0 2024-04-18T21:06:58.782 INFO:tasks.workunit.client.0.smithi096.stdout:5/269: symlink d2/d11/d28/d64/l65 0 2024-04-18T21:06:58.782 INFO:tasks.workunit.client.0.smithi096.stdout:0/301: link d1/d23/d32/d43/f46 d1/db/d30/d31/d39/f66 0 2024-04-18T21:06:58.783 INFO:tasks.workunit.client.0.smithi096.stdout:0/302: mkdir d1/db/d30/d4a/d67 0 2024-04-18T21:06:58.783 INFO:tasks.workunit.client.0.smithi096.stdout:4/298: sync 2024-04-18T21:06:58.783 INFO:tasks.workunit.client.0.smithi096.stdout:2/477: sync 2024-04-18T21:06:58.784 INFO:tasks.workunit.client.0.smithi096.stdout:5/270: read d2/d18/fe [414109,118634] 0 2024-04-18T21:06:58.784 INFO:tasks.workunit.client.0.smithi096.stdout:4/299: write d2/f9 [806964,22430] 0 2024-04-18T21:06:58.784 INFO:tasks.workunit.client.0.smithi096.stdout:5/271: write d2/d11/f2d [3558881,95372] 0 2024-04-18T21:06:58.785 INFO:tasks.workunit.client.0.smithi096.stdout:4/300: mkdir d2/d2f/d39/d61 0 2024-04-18T21:06:58.785 INFO:tasks.workunit.client.0.smithi096.stdout:5/272: write d2/f27 [509923,63262] 0 2024-04-18T21:06:58.786 INFO:tasks.workunit.client.0.smithi096.stdout:5/273: read f0 [284304,62652] 0 2024-04-18T21:06:58.787 INFO:tasks.workunit.client.0.smithi096.stdout:5/274: write d2/d11/f52 [423308,25147] 0 2024-04-18T21:06:58.788 INFO:tasks.workunit.client.0.smithi096.stdout:5/275: mknod d2/d38/d4c/c66 0 2024-04-18T21:06:58.789 INFO:tasks.workunit.client.0.smithi096.stdout:5/276: symlink d2/d11/l67 0 2024-04-18T21:06:58.789 INFO:tasks.workunit.client.0.smithi096.stdout:0/303: dwrite d1/db/d30/f51 [0,4194304] 0 2024-04-18T21:06:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:7/287: sync 2024-04-18T21:06:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:1/319: sync 2024-04-18T21:06:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:4/301: dwrite d2/f28 [0,4194304] 0 2024-04-18T21:06:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:8/322: sync 2024-04-18T21:06:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:6/309: sync 2024-04-18T21:06:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:2/478: sync 2024-04-18T21:06:58.793 INFO:tasks.workunit.client.0.smithi096.stdout:1/320: sync 2024-04-18T21:06:58.795 INFO:tasks.workunit.client.0.smithi096.stdout:6/310: write d1/d17/f18 [2230173,74862] 0 2024-04-18T21:06:58.795 INFO:tasks.workunit.client.0.smithi096.stdout:8/323: write d0/d3/db/f6a [1041607,96579] 0 2024-04-18T21:06:58.797 INFO:tasks.workunit.client.0.smithi096.stdout:1/321: symlink d0/df/d62/d69/d65/l6b 0 2024-04-18T21:06:58.797 INFO:tasks.workunit.client.0.smithi096.stdout:8/324: creat d0/d64/f6d x:0 0 0 2024-04-18T21:06:58.798 INFO:tasks.workunit.client.0.smithi096.stdout:2/479: link d11/d13/d1a/f1c d11/d13/d1a/d1e/d28/d4e/d5c/fa1 0 2024-04-18T21:06:58.799 INFO:tasks.workunit.client.0.smithi096.stdout:7/288: write d0/d11/f17 [186400,127465] 0 2024-04-18T21:06:58.800 INFO:tasks.workunit.client.0.smithi096.stdout:9/299: dwrite d0/d8/d11/d1f/f52 [0,4194304] 0 2024-04-18T21:06:58.800 INFO:tasks.workunit.client.0.smithi096.stdout:8/325: mknod d0/d3/d3a/c6e 0 2024-04-18T21:06:58.800 INFO:tasks.workunit.client.0.smithi096.stdout:5/277: dwrite d2/d11/d28/d4a/f59 [0,4194304] 0 2024-04-18T21:06:58.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/289: stat d0/d20/c31 0 2024-04-18T21:06:58.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/302: dread d2/d1d/d3a/f52 [0,4194304] 0 2024-04-18T21:06:58.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/303: sync 2024-04-18T21:06:58.803 INFO:tasks.workunit.client.0.smithi096.stdout:6/311: truncate d1/d3a/f3f 522051 0 2024-04-18T21:06:58.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/300: write d0/d8/d9/d40/d43/d4b/f56 [69720,2882] 0 2024-04-18T21:06:58.803 INFO:tasks.workunit.client.0.smithi096.stdout:6/312: stat d1/d6/d26/f29 0 2024-04-18T21:06:58.803 INFO:tasks.workunit.client.0.smithi096.stdout:4/304: symlink d2/d2a/d54/d5b/l62 0 2024-04-18T21:06:58.804 INFO:tasks.workunit.client.0.smithi096.stdout:6/313: mkdir d1/d5/da/d55 0 2024-04-18T21:06:58.805 INFO:tasks.workunit.client.0.smithi096.stdout:4/305: truncate d2/d2f/f5a 179674 0 2024-04-18T21:06:58.806 INFO:tasks.workunit.client.0.smithi096.stdout:9/301: link d0/d28/d3d/l51 d0/d8/d9/d40/d43/l59 0 2024-04-18T21:06:58.806 INFO:tasks.workunit.client.0.smithi096.stdout:2/480: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 [308834,27500] 0 2024-04-18T21:06:58.807 INFO:tasks.workunit.client.0.smithi096.stdout:0/304: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:58.809 INFO:tasks.workunit.client.0.smithi096.stdout:3/306: dread d4/d6/d1b/d2c/d31/f41 [4194304,4194304] 0 2024-04-18T21:06:58.813 INFO:tasks.workunit.client.0.smithi096.stdout:1/322: dwrite d0/d27/d33/f3d [0,4194304] 0 2024-04-18T21:06:58.813 INFO:tasks.workunit.client.0.smithi096.stdout:3/307: rmdir d4/d6 39 2024-04-18T21:06:58.813 INFO:tasks.workunit.client.0.smithi096.stdout:9/302: truncate d0/dc/f25 1370637 0 2024-04-18T21:06:58.814 INFO:tasks.workunit.client.0.smithi096.stdout:7/290: dwrite d0/d7/d8/f16 [0,4194304] 0 2024-04-18T21:06:58.815 INFO:tasks.workunit.client.0.smithi096.stdout:8/326: dwrite d0/d3/d14/d56/f5e [0,4194304] 0 2024-04-18T21:06:58.815 INFO:tasks.workunit.client.0.smithi096.stdout:5/278: dwrite d2/d11/f5b [0,4194304] 0 2024-04-18T21:06:58.815 INFO:tasks.workunit.client.0.smithi096.stdout:0/305: getdents d1/db/d30/d31/d39 0 2024-04-18T21:06:58.816 INFO:tasks.workunit.client.0.smithi096.stdout:1/323: mkdir d0/df/d16/d6c 0 2024-04-18T21:06:58.816 INFO:tasks.workunit.client.0.smithi096.stdout:7/291: write d0/fc [591045,82229] 0 2024-04-18T21:06:58.817 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:58.817+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:58.818 INFO:tasks.workunit.client.0.smithi096.stdout:8/327: mkdir d0/d3/db/d6f 0 2024-04-18T21:06:58.818 INFO:tasks.workunit.client.0.smithi096.stdout:1/324: dread - d0/df/f5b zero size 2024-04-18T21:06:58.818 INFO:tasks.workunit.client.0.smithi096.stdout:9/303: link d0/d8/d11/d39/c46 d0/c5a 0 2024-04-18T21:06:58.818 INFO:tasks.workunit.client.0.smithi096.stdout:6/314: dwrite d1/d5/f1b [4194304,4194304] 0 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi096.stdout:7/292: write d0/d20/f47 [1622560,82337] 0 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi096.stdout:5/279: getdents d2/d11/d28/d4a 0 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi096.stdout:6/315: fdatasync d1/f3 0 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi096.stdout:4/306: truncate d2/f28 4167447 0 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi096.stdout:9/304: fsync d0/dc/f36 0 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi096.stdout:6/316: creat d1/d5/f56 x:0 0 0 2024-04-18T21:06:58.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/328: rename d0/d3/db/f15 to d0/d3/d1d/d2c/d61/f70 0 2024-04-18T21:06:58.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/325: link d0/ce d0/df/d62/d69/d6a/c6d 0 2024-04-18T21:06:58.821 INFO:tasks.workunit.client.0.smithi096.stdout:7/293: fdatasync d0/d20/d39/f4c 0 2024-04-18T21:06:58.821 INFO:tasks.workunit.client.0.smithi096.stdout:5/280: write d2/d11/d28/d4a/f59 [2498125,93318] 0 2024-04-18T21:06:58.821 INFO:tasks.workunit.client.0.smithi096.stdout:9/305: write d0/d8/d9/d40/f4e [434592,108465] 0 2024-04-18T21:06:58.822 INFO:tasks.workunit.client.0.smithi096.stdout:1/326: write d0/d27/d33/f58 [508046,64982] 0 2024-04-18T21:06:58.822 INFO:tasks.workunit.client.0.smithi096.stdout:5/281: creat d2/d11/f68 x:0 0 0 2024-04-18T21:06:58.823 INFO:tasks.workunit.client.0.smithi096.stdout:9/306: stat d0/d8/d9/d40/f4e 0 2024-04-18T21:06:58.823 INFO:tasks.workunit.client.0.smithi096.stdout:2/481: truncate ff 1516023 0 2024-04-18T21:06:58.824 INFO:tasks.workunit.client.0.smithi096.stdout:5/282: mkdir d2/d11/d28/d4a/d69 0 2024-04-18T21:06:58.825 INFO:tasks.workunit.client.0.smithi096.stdout:3/308: dwrite d4/d6/d1b/d1d/f28 [0,4194304] 0 2024-04-18T21:06:58.825 INFO:tasks.workunit.client.0.smithi096.stdout:5/283: mkdir d2/d6a 0 2024-04-18T21:06:58.825 INFO:tasks.workunit.client.0.smithi096.stdout:9/307: link d0/d8/l50 d0/d28/l5b 0 2024-04-18T21:06:58.825 INFO:tasks.workunit.client.0.smithi096.stdout:3/309: mknod d4/d8/d49/c5e 0 2024-04-18T21:06:58.828 INFO:tasks.workunit.client.0.smithi096.stdout:6/317: dwrite d1/f34 [0,4194304] 0 2024-04-18T21:06:58.829 INFO:tasks.workunit.client.0.smithi096.stdout:6/318: chown d1/l43 1753 1 2024-04-18T21:06:58.830 INFO:tasks.workunit.client.0.smithi096.stdout:1/327: dwrite d0/df/d16/d24/f40 [0,4194304] 0 2024-04-18T21:06:58.830 INFO:tasks.workunit.client.0.smithi096.stdout:1/328: mknod d0/d27/c6e 0 2024-04-18T21:06:58.835 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:58.835 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:58.835 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-18T21:06:58.835 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-04-18T21:06:58.835 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-18T21:06:58.837 INFO:tasks.workunit.client.0.smithi096.stdout:1/329: dwrite d0/d27/f52 [0,4194304] 0 2024-04-18T21:06:58.839 INFO:tasks.workunit.client.0.smithi096.stdout:1/330: write d0/f6 [1844434,64107] 0 2024-04-18T21:06:58.840 INFO:tasks.workunit.client.0.smithi096.stdout:1/331: chown d0/d27/d33/l57 43854 1 2024-04-18T21:06:58.840 INFO:tasks.workunit.client.0.smithi096.stdout:1/332: write d0/d27/f52 [2255179,48681] 0 2024-04-18T21:06:58.843 INFO:tasks.workunit.client.0.smithi096.stdout:8/329: truncate d0/d3/d14/f2a 2062183 0 2024-04-18T21:06:58.843 INFO:tasks.workunit.client.0.smithi096.stdout:4/307: write d2/d2f/d39/f4b [687520,8368] 0 2024-04-18T21:06:58.844 INFO:tasks.workunit.client.0.smithi096.stdout:3/310: truncate d4/d6/d1b/f3a 328462 0 2024-04-18T21:06:58.844 INFO:tasks.workunit.client.0.smithi096.stdout:8/330: write d0/d3/f49 [1729555,10993] 0 2024-04-18T21:06:58.845 INFO:tasks.workunit.client.0.smithi096.stdout:1/333: creat d0/d27/d5f/f6f x:0 0 0 2024-04-18T21:06:58.845 INFO:tasks.workunit.client.0.smithi096.stdout:3/311: symlink d4/d6/d22/l5f 0 2024-04-18T21:06:58.846 INFO:tasks.workunit.client.0.smithi096.stdout:4/308: unlink d2/f28 0 2024-04-18T21:06:58.846 INFO:tasks.workunit.client.0.smithi096.stdout:8/331: symlink d0/d3/d14/d33/l71 0 2024-04-18T21:06:58.846 INFO:tasks.workunit.client.0.smithi096.stdout:5/284: write d2/d38/d4c/f5e [513828,110711] 0 2024-04-18T21:06:58.847 INFO:tasks.workunit.client.0.smithi096.stdout:4/309: rmdir d2/d1d/d3a 39 2024-04-18T21:06:58.847 INFO:tasks.workunit.client.0.smithi096.stdout:8/332: symlink d0/d3/d1d/d2c/d61/l72 0 2024-04-18T21:06:58.847 INFO:tasks.workunit.client.0.smithi096.stdout:5/285: unlink d2/d11/d28/l36 0 2024-04-18T21:06:58.847 INFO:tasks.workunit.client.0.smithi096.stdout:4/310: chown d2/d2f/d33/f3b 205 1 2024-04-18T21:06:58.848 INFO:tasks.workunit.client.0.smithi096.stdout:8/333: readlink d0/d3/d14/d33/l6c 0 2024-04-18T21:06:58.850 INFO:tasks.workunit.client.0.smithi096.stdout:5/286: write d2/d38/f4b [2157307,103245] 0 2024-04-18T21:06:58.851 INFO:tasks.workunit.client.0.smithi096.stdout:1/334: dread d0/df/d16/f50 [0,4194304] 0 2024-04-18T21:06:58.852 INFO:tasks.workunit.client.0.smithi096.stdout:5/287: getdents d2/d11 0 2024-04-18T21:06:58.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/308: dread d0/d8/d9/d40/f4e [0,4194304] 0 2024-04-18T21:06:58.854 INFO:tasks.workunit.client.0.smithi096.stdout:3/312: dwrite d4/d6/d1b/d1d/f2b [4194304,4194304] 0 2024-04-18T21:06:58.854 INFO:tasks.workunit.client.0.smithi096.stdout:8/334: dread d0/d3/f57 [0,4194304] 0 2024-04-18T21:06:58.856 INFO:tasks.workunit.client.0.smithi096.stdout:5/288: creat d2/d38/d4c/f6b x:0 0 0 2024-04-18T21:06:58.857 INFO:tasks.workunit.client.0.smithi096.stdout:8/335: symlink d0/d3/d1d/l73 0 2024-04-18T21:06:58.857 INFO:tasks.workunit.client.0.smithi096.stdout:9/309: chown d0/d28/c35 14 1 2024-04-18T21:06:58.857 INFO:tasks.workunit.client.0.smithi096.stdout:3/313: truncate d4/d6/d1b/d2c/d31/d11/f5b 648438 0 2024-04-18T21:06:58.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/311: dwrite d2/d2f/d39/d43/f48 [0,4194304] 0 2024-04-18T21:06:58.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/310: symlink d0/l5c 0 2024-04-18T21:06:58.859 INFO:tasks.workunit.client.0.smithi096.stdout:4/312: rename d2/c42 to d2/d2f/d39/d43/c63 0 2024-04-18T21:06:58.859 INFO:tasks.workunit.client.0.smithi096.stdout:8/336: link d0/d3/d1d/d2c/d61/l72 d0/d3/d14/d56/d4d/d5a/l74 0 2024-04-18T21:06:58.860 INFO:tasks.workunit.client.0.smithi096.stdout:5/289: rename d2/d18/f5d to d2/d11/d28/d64/f6c 0 2024-04-18T21:06:58.860 INFO:tasks.workunit.client.0.smithi096.stdout:4/313: symlink d2/d2a/d54/l64 0 2024-04-18T21:06:58.860 INFO:tasks.workunit.client.0.smithi096.stdout:4/314: symlink d2/d2a/d54/l65 0 2024-04-18T21:06:58.861 INFO:tasks.workunit.client.0.smithi096.stdout:5/290: write d2/f3a [3943424,22668] 0 2024-04-18T21:06:58.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/337: truncate d0/d3/d14/d56/d4d/f5f 167130 0 2024-04-18T21:06:58.862 INFO:tasks.workunit.client.0.smithi096.stdout:4/315: mknod d2/d2f/d33/d55/d57/c66 0 2024-04-18T21:06:58.862 INFO:tasks.workunit.client.0.smithi096.stdout:5/291: mkdir d2/d18/d61/d6d 0 2024-04-18T21:06:58.862 INFO:tasks.workunit.client.0.smithi096.stdout:5/292: mknod d2/d18/c6e 0 2024-04-18T21:06:58.863 INFO:tasks.workunit.client.0.smithi096.stdout:4/316: getdents d2/d2f 0 2024-04-18T21:06:58.867 INFO:tasks.workunit.client.0.smithi096.stdout:8/338: dwrite d0/d64/d43/f4a [0,4194304] 0 2024-04-18T21:06:58.867 INFO:tasks.workunit.client.0.smithi096.stdout:8/339: chown d0 831108 1 2024-04-18T21:06:58.868 INFO:tasks.workunit.client.0.smithi096.stdout:2/482: read d11/d13/f15 [1209268,5912] 0 2024-04-18T21:06:58.869 INFO:tasks.workunit.client.0.smithi096.stdout:4/317: dwrite d2/d2f/d33/f3b [0,4194304] 0 2024-04-18T21:06:58.871 INFO:tasks.workunit.client.0.smithi096.stdout:8/340: getdents d0/d3/d14/d1b 0 2024-04-18T21:06:58.871 INFO:tasks.workunit.client.0.smithi096.stdout:2/483: creat d11/d13/d1a/d1e/d28/d4e/d5c/fa2 x:0 0 0 2024-04-18T21:06:58.871 INFO:tasks.workunit.client.0.smithi096.stdout:4/318: mknod d2/c67 0 2024-04-18T21:06:58.873 INFO:tasks.workunit.client.0.smithi096.stdout:1/335: dwrite d0/f17 [0,4194304] 0 2024-04-18T21:06:58.874 INFO:tasks.workunit.client.0.smithi096.stdout:1/336: dread - d0/df/f64 zero size 2024-04-18T21:06:58.874 INFO:tasks.workunit.client.0.smithi096.stdout:2/484: link d11/l67 d11/d13/d1a/d1e/d28/d4e/d5c/la3 0 2024-04-18T21:06:58.877 INFO:tasks.workunit.client.0.smithi096.stdout:5/293: write d2/f10 [1303296,117292] 0 2024-04-18T21:06:58.878 INFO:tasks.workunit.client.0.smithi096.stdout:8/341: dwrite d0/d3/d14/d33/f3b [0,4194304] 0 2024-04-18T21:06:58.878 INFO:tasks.workunit.client.0.smithi096.stdout:5/294: chown d2/d18/d61/d6d 161 1 2024-04-18T21:06:58.880 INFO:tasks.workunit.client.0.smithi096.stdout:8/342: dread - d0/d3/d14/f31 zero size 2024-04-18T21:06:58.880 INFO:tasks.workunit.client.0.smithi096.stdout:5/295: rmdir d2/d11 39 2024-04-18T21:06:58.882 INFO:tasks.workunit.client.0.smithi096.stdout:8/343: stat d0/d3/d1d/d2c 0 2024-04-18T21:06:58.882 INFO:tasks.workunit.client.0.smithi096.stdout:5/296: mkdir d2/d18/d61/d6f 0 2024-04-18T21:06:58.882 INFO:tasks.workunit.client.0.smithi096.stdout:9/311: dwrite d0/dc/f25 [0,4194304] 0 2024-04-18T21:06:58.883 INFO:tasks.workunit.client.0.smithi096.stdout:7/294: sync 2024-04-18T21:06:58.883 INFO:tasks.workunit.client.0.smithi096.stdout:5/297: creat d2/d6a/f70 x:0 0 0 2024-04-18T21:06:58.884 INFO:tasks.workunit.client.0.smithi096.stdout:7/295: mknod d0/c54 0 2024-04-18T21:06:58.885 INFO:tasks.workunit.client.0.smithi096.stdout:5/298: rmdir d2/d11/d28/d4a 39 2024-04-18T21:06:58.886 INFO:tasks.workunit.client.0.smithi096.stdout:5/299: creat d2/d11/f71 x:0 0 0 2024-04-18T21:06:58.887 INFO:tasks.workunit.client.0.smithi096.stdout:7/296: getdents d0/d7/d8 0 2024-04-18T21:06:58.888 INFO:tasks.workunit.client.0.smithi096.stdout:8/344: dwrite d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:06:58.888 INFO:tasks.workunit.client.0.smithi096.stdout:8/345: write d0/d3/d14/d56/f5e [440407,93466] 0 2024-04-18T21:06:58.889 INFO:tasks.workunit.client.0.smithi096.stdout:8/346: readlink d0/d3/l1e 0 2024-04-18T21:06:58.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/347: creat d0/d3/d3a/f75 x:0 0 0 2024-04-18T21:06:58.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/348: symlink d0/d64/l76 0 2024-04-18T21:06:58.891 INFO:tasks.workunit.client.0.smithi096.stdout:8/349: chown d0/f8 134038574 1 2024-04-18T21:06:58.892 INFO:tasks.workunit.client.0.smithi096.stdout:8/350: truncate d0/f12 224388 0 2024-04-18T21:06:58.894 INFO:tasks.workunit.client.0.smithi096.stdout:6/319: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:58.894 INFO:tasks.workunit.client.0.smithi096.stdout:6/320: write d1/d5/f56 [301791,111291] 0 2024-04-18T21:06:58.896 INFO:tasks.workunit.client.0.smithi096.stdout:7/297: truncate d0/d7/d8/f26 1037411 0 2024-04-18T21:06:58.896 INFO:tasks.workunit.client.0.smithi096.stdout:6/321: rename d1/d6 to d1/d3a/d57 0 2024-04-18T21:06:58.897 INFO:tasks.workunit.client.0.smithi096.stdout:6/322: rename d1 to d1/d5/da/d44/d58 22 2024-04-18T21:06:58.897 INFO:tasks.workunit.client.0.smithi096.stdout:9/312: dwrite d0/dc/d18/f29 [0,4194304] 0 2024-04-18T21:06:58.897 INFO:tasks.workunit.client.0.smithi096.stdout:7/298: write d0/d20/f2d [1393978,91020] 0 2024-04-18T21:06:58.899 INFO:tasks.workunit.client.0.smithi096.stdout:7/299: chown d0/d20/d39/l3d 0 1 2024-04-18T21:06:58.899 INFO:tasks.workunit.client.0.smithi096.stdout:6/323: write d1/d3a/d57/d26/fb [2525691,31273] 0 2024-04-18T21:06:58.899 INFO:tasks.workunit.client.0.smithi096.stdout:9/313: mknod d0/d28/c5d 0 2024-04-18T21:06:58.899 INFO:tasks.workunit.client.0.smithi096.stdout:7/300: chown d0/d20/f2d 5338 1 2024-04-18T21:06:58.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/324: chown d1/d3a/d36/c39 1020 1 2024-04-18T21:06:58.900 INFO:tasks.workunit.client.0.smithi096.stdout:9/314: write d0/d8/d11/d48/f57 [55642,118257] 0 2024-04-18T21:06:58.900 INFO:tasks.workunit.client.0.smithi096.stdout:8/351: truncate d0/d3/d14/d56/f5e 2737745 0 2024-04-18T21:06:58.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/352: write d0/d3/f23 [2624600,54425] 0 2024-04-18T21:06:58.907 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:58.905+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:58.909 INFO:tasks.workunit.client.0.smithi096.stdout:6/325: creat d1/d5/da/d44/d4e/f59 x:0 0 0 2024-04-18T21:06:58.909 INFO:tasks.workunit.client.0.smithi096.stdout:8/353: creat d0/d5d/f77 x:0 0 0 2024-04-18T21:06:58.910 INFO:tasks.workunit.client.0.smithi096.stdout:6/326: truncate d1/d5/f15 4350963 0 2024-04-18T21:06:58.910 INFO:tasks.workunit.client.0.smithi096.stdout:9/315: getdents d0/dc 0 2024-04-18T21:06:58.911 INFO:tasks.workunit.client.0.smithi096.stdout:1/337: dread d0/f39 [0,4194304] 0 2024-04-18T21:06:58.911 INFO:tasks.workunit.client.0.smithi096.stdout:8/354: mkdir d0/d3/d1d/d2c/d46/d78 0 2024-04-18T21:06:58.911 INFO:tasks.workunit.client.0.smithi096.stdout:9/316: fsync d0/d28/d2f/f42 0 2024-04-18T21:06:58.913 INFO:tasks.workunit.client.0.smithi096.stdout:6/327: rename d1/d5/da/d44/l47 to d1/d5/da/d46/l5a 0 2024-04-18T21:06:58.913 INFO:tasks.workunit.client.0.smithi096.stdout:9/317: mknod d0/dc/d18/c5e 0 2024-04-18T21:06:58.913 INFO:tasks.workunit.client.0.smithi096.stdout:1/338: creat d0/f70 x:0 0 0 2024-04-18T21:06:58.913 INFO:tasks.workunit.client.0.smithi096.stdout:6/328: symlink d1/d5/da/d55/l5b 0 2024-04-18T21:06:58.914 INFO:tasks.workunit.client.0.smithi096.stdout:1/339: chown d0/df/f48 6438 1 2024-04-18T21:06:58.914 INFO:tasks.workunit.client.0.smithi096.stdout:4/319: dread d2/f1f [0,4194304] 0 2024-04-18T21:06:58.915 INFO:tasks.workunit.client.0.smithi096.stdout:9/318: getdents d0/d8/d11 0 2024-04-18T21:06:58.915 INFO:tasks.workunit.client.0.smithi096.stdout:1/340: dread - d0/f49 zero size 2024-04-18T21:06:58.916 INFO:tasks.workunit.client.0.smithi096.stdout:9/319: mkdir d0/dc/d5f 0 2024-04-18T21:06:58.916 INFO:tasks.workunit.client.0.smithi096.stdout:4/320: mknod d2/d2f/d33/d55/d59/c68 0 2024-04-18T21:06:58.916 INFO:tasks.workunit.client.0.smithi096.stdout:1/341: truncate d0/f49 596287 0 2024-04-18T21:06:58.917 INFO:tasks.workunit.client.0.smithi096.stdout:4/321: write f0 [983968,45366] 0 2024-04-18T21:06:58.917 INFO:tasks.workunit.client.0.smithi096.stdout:9/320: write d0/d8/d11/f38 [1326165,125291] 0 2024-04-18T21:06:58.918 INFO:tasks.workunit.client.0.smithi096.stdout:1/342: rename d0/d27/d5f/d60/c66 to d0/d27/d5f/c71 0 2024-04-18T21:06:58.919 INFO:tasks.workunit.client.0.smithi096.stdout:8/355: dread d0/d64/d43/f4a [0,4194304] 0 2024-04-18T21:06:58.919 INFO:tasks.workunit.client.0.smithi096.stdout:4/322: symlink d2/d1d/l69 0 2024-04-18T21:06:58.919 INFO:tasks.workunit.client.0.smithi096.stdout:9/321: creat d0/d44/f60 x:0 0 0 2024-04-18T21:06:58.921 INFO:tasks.workunit.client.0.smithi096.stdout:6/329: dwrite d1/d5/da/fc [0,4194304] 0 2024-04-18T21:06:58.923 INFO:tasks.workunit.client.0.smithi096.stdout:0/306: dread d1/db/d25/f28 [0,4194304] 0 2024-04-18T21:06:58.923 INFO:tasks.workunit.client.0.smithi096.stdout:9/322: write d0/dc/d18/f27 [4995010,56389] 0 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:58.926 INFO:tasks.workunit.client.0.smithi096.stdout:0/307: truncate d1/d23/d32/d43/f46 4714826 0 2024-04-18T21:06:58.926 INFO:tasks.workunit.client.0.smithi096.stdout:1/343: dread d0/df/d16/d24/f4a [0,4194304] 0 2024-04-18T21:06:58.929 INFO:tasks.workunit.client.0.smithi096.stdout:8/356: dwrite d0/d3/d14/d56/d4d/f50 [0,4194304] 0 2024-04-18T21:06:58.930 INFO:tasks.workunit.client.0.smithi096.stdout:1/344: truncate d0/df/f64 704139 0 2024-04-18T21:06:58.930 INFO:tasks.workunit.client.0.smithi096.stdout:6/330: dwrite d1/d5/f1b [4194304,4194304] 0 2024-04-18T21:06:58.930 INFO:tasks.workunit.client.0.smithi096.stdout:8/357: readlink d0/d64/l76 0 2024-04-18T21:06:58.936 INFO:tasks.workunit.client.0.smithi096.stdout:0/308: symlink d1/db/d30/d31/d39/d5d/l68 0 2024-04-18T21:06:58.936 INFO:tasks.workunit.client.0.smithi096.stdout:6/331: rmdir d1/d3a/d57/d26 39 2024-04-18T21:06:58.936 INFO:tasks.workunit.client.0.smithi096.stdout:1/345: mknod d0/df/d16/d6c/c72 0 2024-04-18T21:06:58.937 INFO:tasks.workunit.client.0.smithi096.stdout:1/346: stat d0/c1d 0 2024-04-18T21:06:58.938 INFO:tasks.workunit.client.0.smithi096.stdout:7/301: dread d0/d20/f34 [0,4194304] 0 2024-04-18T21:06:58.938 INFO:tasks.workunit.client.0.smithi096.stdout:1/347: truncate d0/df/d16/f68 998118 0 2024-04-18T21:06:58.939 INFO:tasks.workunit.client.0.smithi096.stdout:6/332: rmdir d1/d5/da/d44/d4e/d52 39 2024-04-18T21:06:58.939 INFO:tasks.workunit.client.0.smithi096.stdout:7/302: write d0/fc [851052,82662] 0 2024-04-18T21:06:58.939 INFO:tasks.workunit.client.0.smithi096.stdout:6/333: creat d1/d17/f5c x:0 0 0 2024-04-18T21:06:58.940 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:58.941 INFO:tasks.workunit.client.0.smithi096.stdout:6/334: creat d1/d5/f5d x:0 0 0 2024-04-18T21:06:58.941 INFO:tasks.workunit.client.0.smithi096.stdout:5/300: dread d2/f3a [0,4194304] 0 2024-04-18T21:06:58.943 INFO:tasks.workunit.client.0.smithi096.stdout:5/301: creat d2/d11/d28/f72 x:0 0 0 2024-04-18T21:06:58.943 INFO:tasks.workunit.client.0.smithi096.stdout:9/323: truncate d0/d8/d9/f20 3634796 0 2024-04-18T21:06:58.943 INFO:tasks.workunit.client.0.smithi096.stdout:0/309: dwrite d1/f2d [4194304,4194304] 0 2024-04-18T21:06:58.944 INFO:tasks.workunit.client.0.smithi096.stdout:8/358: truncate d0/d3/d14/d56/d4d/f50 3186654 0 2024-04-18T21:06:58.945 INFO:tasks.workunit.client.0.smithi096.stdout:1/348: truncate d0/f4 1155438 0 2024-04-18T21:06:58.946 INFO:tasks.workunit.client.0.smithi096.stdout:5/302: write d2/d11/f21 [5019004,69299] 0 2024-04-18T21:06:58.946 INFO:tasks.workunit.client.0.smithi096.stdout:9/324: creat d0/dc/d5f/f61 x:0 0 0 2024-04-18T21:06:58.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/310: dread - d1/d23/d32/d43/f4f zero size 2024-04-18T21:06:58.947 INFO:tasks.workunit.client.0.smithi096.stdout:8/359: symlink d0/d55/l79 0 2024-04-18T21:06:58.947 INFO:tasks.workunit.client.0.smithi096.stdout:6/335: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:58.947 INFO:tasks.workunit.client.0.smithi096.stdout:7/303: dwrite d0/d7/d42/f4f [0,4194304] 0 2024-04-18T21:06:58.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/325: write d0/d8/d11/f12 [11130979,56399] 0 2024-04-18T21:06:58.948 INFO:tasks.workunit.client.0.smithi096.stdout:7/304: fsync d0/d7/d49/f4e 0 2024-04-18T21:06:58.948 INFO:tasks.workunit.client.0.smithi096.stdout:0/311: truncate d1/db/d25/f3d 157990 0 2024-04-18T21:06:58.948 INFO:tasks.workunit.client.0.smithi096.stdout:7/305: write d0/d7/f4d [274589,43014] 0 2024-04-18T21:06:58.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/306: chown d0/d7/d49/f4e 0 1 2024-04-18T21:06:58.951 INFO:tasks.workunit.client.0.smithi096.stdout:9/326: creat d0/d28/d3d/f62 x:0 0 0 2024-04-18T21:06:58.951 INFO:tasks.workunit.client.0.smithi096.stdout:1/349: rename d0/f6 to d0/d27/f73 0 2024-04-18T21:06:58.952 INFO:tasks.workunit.client.0.smithi096.stdout:7/307: link d0/d7/d8/f16 d0/d7/d8/f55 0 2024-04-18T21:06:58.952 INFO:tasks.workunit.client.0.smithi096.stdout:0/312: stat d1/db/d30/d31/f47 0 2024-04-18T21:06:58.952 INFO:tasks.workunit.client.0.smithi096.stdout:6/336: creat d1/d5/da/d44/d4e/f5e x:0 0 0 2024-04-18T21:06:58.952 INFO:tasks.workunit.client.0.smithi096.stdout:9/327: chown d0/d28/d3d/f54 144466 1 2024-04-18T21:06:58.953 INFO:tasks.workunit.client.0.smithi096.stdout:9/328: write d0/dc/f32 [2766420,50090] 0 2024-04-18T21:06:58.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/329: write d0/d28/d2f/f42 [3960043,63005] 0 2024-04-18T21:06:58.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/330: mkdir d0/d8/d11/d39/d63 0 2024-04-18T21:06:58.955 INFO:tasks.workunit.client.0.smithi096.stdout:9/331: link d0/f58 d0/d28/d2f/f64 0 2024-04-18T21:06:58.956 INFO:tasks.workunit.client.0.smithi096.stdout:9/332: rename d0/d8/d9/d40/d43/d4b/f56 to d0/d28/f65 0 2024-04-18T21:06:58.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/333: mkdir d0/d28/d66 0 2024-04-18T21:06:58.959 INFO:tasks.workunit.client.0.smithi096.stdout:7/308: dread d0/fc [0,4194304] 0 2024-04-18T21:06:58.960 INFO:tasks.workunit.client.0.smithi096.stdout:7/309: rename d0/d20/f47 to d0/d7/d8/f56 0 2024-04-18T21:06:58.962 INFO:tasks.workunit.client.0.smithi096.stdout:7/310: link d0/d11/f17 d0/d7/d49/f57 0 2024-04-18T21:06:58.963 INFO:tasks.workunit.client.0.smithi096.stdout:9/334: dwrite d0/f5 [4194304,4194304] 0 2024-04-18T21:06:58.964 INFO:tasks.workunit.client.0.smithi096.stdout:9/335: fdatasync d0/d28/d2f/f64 0 2024-04-18T21:06:58.965 INFO:tasks.workunit.client.0.smithi096.stdout:9/336: creat d0/d8/d11/d48/f67 x:0 0 0 2024-04-18T21:06:58.965 INFO:tasks.workunit.client.0.smithi096.stdout:9/337: fsync d0/d8/d9/f3a 0 2024-04-18T21:06:58.966 INFO:tasks.workunit.client.0.smithi096.stdout:9/338: fdatasync d0/d28/d2f/f17 0 2024-04-18T21:06:58.967 INFO:tasks.workunit.client.0.smithi096.stdout:9/339: creat d0/dc/d5f/f68 x:0 0 0 2024-04-18T21:06:58.967 INFO:tasks.workunit.client.0.smithi096.stdout:8/360: write d0/f12 [869768,45933] 0 2024-04-18T21:06:58.968 INFO:tasks.workunit.client.0.smithi096.stdout:8/361: readlink d0/d3/d1d/d2c/l38 0 2024-04-18T21:06:58.969 INFO:tasks.workunit.client.0.smithi096.stdout:9/340: getdents d0/d8/d9/d40 0 2024-04-18T21:06:58.969 INFO:tasks.workunit.client.0.smithi096.stdout:7/311: dwrite d0/d7/d8/f55 [0,4194304] 0 2024-04-18T21:06:58.970 INFO:tasks.workunit.client.0.smithi096.stdout:8/362: write d0/d64/f6d [268655,26116] 0 2024-04-18T21:06:58.970 INFO:tasks.workunit.client.0.smithi096.stdout:1/350: dread d0/f39 [0,4194304] 0 2024-04-18T21:06:58.971 INFO:tasks.workunit.client.0.smithi096.stdout:8/363: chown d0/d3/d14/d33/f5b 26 1 2024-04-18T21:06:58.972 INFO:tasks.workunit.client.0.smithi096.stdout:0/313: dwrite d1/d23/d32/d43/f46 [0,4194304] 0 2024-04-18T21:06:58.972 INFO:tasks.workunit.client.0.smithi096.stdout:1/351: unlink d0/df/f48 0 2024-04-18T21:06:58.973 INFO:tasks.workunit.client.0.smithi096.stdout:1/352: fsync d0/df/f64 0 2024-04-18T21:06:58.973 INFO:tasks.workunit.client.0.smithi096.stdout:7/312: mknod d0/d11/c58 0 2024-04-18T21:06:58.974 INFO:tasks.workunit.client.0.smithi096.stdout:0/314: getdents d1/db/d25/d54 0 2024-04-18T21:06:58.974 INFO:tasks.workunit.client.0.smithi096.stdout:7/313: mkdir d0/d20/d39/d59 0 2024-04-18T21:06:58.974 INFO:tasks.workunit.client.0.smithi096.stdout:7/314: mknod d0/d11/c5a 0 2024-04-18T21:06:58.975 INFO:tasks.workunit.client.0.smithi096.stdout:7/315: symlink d0/l5b 0 2024-04-18T21:06:58.977 INFO:tasks.workunit.client.0.smithi096.stdout:7/316: creat d0/d7/f5c x:0 0 0 2024-04-18T21:06:58.977 INFO:tasks.workunit.client.0.smithi096.stdout:7/317: readlink d0/d7/d8/l37 0 2024-04-18T21:06:58.979 INFO:tasks.workunit.client.0.smithi096.stdout:7/318: link d0/d7/d49/f57 d0/d20/f5d 0 2024-04-18T21:06:58.979 INFO:tasks.workunit.client.0.smithi096.stdout:1/353: dwrite d0/df/d16/f19 [0,4194304] 0 2024-04-18T21:06:58.981 INFO:tasks.workunit.client.0.smithi096.stdout:1/354: write d0/df/f64 [330936,56764] 0 2024-04-18T21:06:58.981 INFO:tasks.workunit.client.0.smithi096.stdout:5/303: dread d2/f20 [0,4194304] 0 2024-04-18T21:06:58.981 INFO:tasks.workunit.client.0.smithi096.stdout:7/319: symlink d0/d20/l5e 0 2024-04-18T21:06:58.982 INFO:tasks.workunit.client.0.smithi096.stdout:5/304: fsync d2/d11/d28/d4a/f59 0 2024-04-18T21:06:58.983 INFO:tasks.workunit.client.0.smithi096.stdout:7/320: truncate d0/d20/f34 115764 0 2024-04-18T21:06:58.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/305: read - d2/d38/d4c/f6b zero size 2024-04-18T21:06:58.984 INFO:tasks.workunit.client.0.smithi096.stdout:7/321: unlink d0/d7/d8/l25 0 2024-04-18T21:06:58.985 INFO:tasks.workunit.client.0.smithi096.stdout:5/306: rename d2/d38/d4c/c51 to d2/d18/d61/d6f/c73 0 2024-04-18T21:06:58.985 INFO:tasks.workunit.client.0.smithi096.stdout:5/307: write d2/d11/f5b [2663561,75848] 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi096.stdout:5/308: stat d2/d18/d61 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi096.stdout:9/341: dread d0/dc/f26 [0,4194304] 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi096.stdout:1/355: dwrite d0/f3e [4194304,4194304] 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi096.stdout:9/342: link d0/dc/f26 d0/d8/d9/d40/d43/d4b/f69 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi096.stdout:1/356: unlink d0/f13 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi096.stdout:9/343: write d0/d8/d11/d48/f4a [901528,12326] 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi096.stdout:9/344: rmdir d0/d28/d3d 39 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi096.stdout:1/357: dread d0/f39 [0,4194304] 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi096.stdout:9/345: creat d0/dc/d5f/f6a x:0 0 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi096.stdout:1/358: fdatasync d0/f44 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi096.stdout:9/346: creat d0/d28/d3d/f6b x:0 0 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi096.stdout:9/347: chown d0/d8/d11/d48/f4a 10 1 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi096.stdout:5/309: truncate d2/d11/d28/d4a/f59 3358535 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi096.stdout:5/310: fsync d2/d11/f71 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi096.stdout:9/348: rename d0/d8/d9/c1e to d0/d8/d11/d39/c6c 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi096.stdout:5/311: rmdir d2 39 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi096.stdout:9/349: dread - d0/dc/d5f/f61 zero size 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi096.stdout:9/350: write d0/dc/d5f/f68 [789163,96861] 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi096.stdout:9/351: write d0/f58 [136792,98129] 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi096.stdout:9/352: chown d0/d8/d11/l37 19 1 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi096.stdout:5/312: dread d2/f3a [0,4194304] 0 2024-04-18T21:06:58.999 INFO:tasks.workunit.client.0.smithi096.stdout:1/359: truncate d0/d27/d33/f3d 764309 0 2024-04-18T21:06:58.999 INFO:tasks.workunit.client.0.smithi096.stdout:1/360: mknod d0/df/d16/d24/c74 0 2024-04-18T21:06:59.000 INFO:tasks.workunit.client.0.smithi096.stdout:1/361: symlink d0/l75 0 2024-04-18T21:06:59.000 INFO:tasks.workunit.client.0.smithi096.stdout:7/322: dread d0/d7/d8/f26 [0,4194304] 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi096.stdout:1/362: symlink d0/df/d30/l76 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi096.stdout:7/323: fsync d0/d7/d49/f57 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi096.stdout:1/363: stat d0/d27/d5f/f6f 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi096.stdout:7/324: write d0/d7/d8/f56 [2508768,5754] 0 2024-04-18T21:06:59.003 INFO:tasks.workunit.client.0.smithi096.stdout:7/325: readlink d0/d7/l30 0 2024-04-18T21:06:59.003 INFO:tasks.workunit.client.0.smithi096.stdout:7/326: chown d0/fc 63482 1 2024-04-18T21:06:59.004 INFO:tasks.workunit.client.0.smithi096.stdout:8/364: dread d0/d3/d14/d1b/f20 [0,4194304] 0 2024-04-18T21:06:59.006 INFO:tasks.workunit.client.0.smithi096.stdout:8/365: rename d0/d3/d3a/f47 to d0/d3/d14/d56/f7a 0 2024-04-18T21:06:59.006 INFO:tasks.workunit.client.0.smithi096.stdout:8/366: mknod d0/d64/d43/c7b 0 2024-04-18T21:06:59.007 INFO:tasks.workunit.client.0.smithi096.stdout:8/367: mknod d0/d3/d14/d1b/c7c 0 2024-04-18T21:06:59.008 INFO:tasks.workunit.client.0.smithi096.stdout:8/368: stat d0/d3/d1d/d2c/d46 0 2024-04-18T21:06:59.008 INFO:tasks.workunit.client.0.smithi096.stdout:8/369: unlink d0/f32 0 2024-04-18T21:06:59.008 INFO:tasks.workunit.client.0.smithi096.stdout:7/327: write d0/d20/f46 [581126,101194] 0 2024-04-18T21:06:59.009 INFO:tasks.workunit.client.0.smithi096.stdout:8/370: creat d0/d64/d43/f7d x:0 0 0 2024-04-18T21:06:59.009 INFO:tasks.workunit.client.0.smithi096.stdout:7/328: chown d0/f52 365138112 1 2024-04-18T21:06:59.010 INFO:tasks.workunit.client.0.smithi096.stdout:7/329: read d0/d11/f29 [88435,80815] 0 2024-04-18T21:06:59.012 INFO:tasks.workunit.client.0.smithi096.stdout:2/485: sync 2024-04-18T21:06:59.012 INFO:tasks.workunit.client.0.smithi096.stdout:3/314: sync 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi096.stdout:3/315: write d4/d6/d1b/d2c/d31/d11/f40 [719714,10032] 0 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi096.stdout:2/486: write d11/d13/d1a/d1e/d28/d4e/f93 [463716,36895] 0 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi096.stdout:3/316: readlink d4/d6/d22/l5f 0 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi096.stdout:2/487: write d11/d50/f71 [492686,41920] 0 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi096.stdout:3/317: chown d4/d6/d1b/d2c/f43 18 1 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi096.stdout:8/371: dwrite d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:06:59.018 INFO:tasks.workunit.client.0.smithi096.stdout:2/488: getdents d11/d13/d1d 0 2024-04-18T21:06:59.018 INFO:tasks.workunit.client.0.smithi096.stdout:2/489: dread - d11/d13/d1a/d1e/d28/f86 zero size 2024-04-18T21:06:59.019 INFO:tasks.workunit.client.0.smithi096.stdout:3/318: rename d4/d6/d7/c18 to d4/d6/d1b/c60 0 2024-04-18T21:06:59.019 INFO:tasks.workunit.client.0.smithi096.stdout:1/364: dread d0/f7 [0,4194304] 0 2024-04-18T21:06:59.020 INFO:tasks.workunit.client.0.smithi096.stdout:3/319: dread - d4/d8/f48 zero size 2024-04-18T21:06:59.020 INFO:tasks.workunit.client.0.smithi096.stdout:2/490: mknod d11/d13/d1a/d1e/d28/ca4 0 2024-04-18T21:06:59.020 INFO:tasks.workunit.client.0.smithi096.stdout:3/320: mknod d4/d8/d49/c61 0 2024-04-18T21:06:59.020 INFO:tasks.workunit.client.0.smithi096.stdout:1/365: rename d0/d27/d33/d59 to d0/d77 0 2024-04-18T21:06:59.021 INFO:tasks.workunit.client.0.smithi096.stdout:2/491: chown d11/d13/d1a/d1e/d28/d4e/d40/d51/f66 110346912 1 2024-04-18T21:06:59.021 INFO:tasks.workunit.client.0.smithi096.stdout:3/321: symlink d4/d6/d1b/d2c/d31/d4e/l62 0 2024-04-18T21:06:59.021 INFO:tasks.workunit.client.0.smithi096.stdout:2/492: mknod d11/d13/d1d/ca5 0 2024-04-18T21:06:59.022 INFO:tasks.workunit.client.0.smithi096.stdout:1/366: dread d0/df/f1a [0,4194304] 0 2024-04-18T21:06:59.022 INFO:tasks.workunit.client.0.smithi096.stdout:3/322: mkdir d4/d6/d1b/d63 0 2024-04-18T21:06:59.023 INFO:tasks.workunit.client.0.smithi096.stdout:1/367: symlink d0/df/d62/d69/d65/l78 0 2024-04-18T21:06:59.023 INFO:tasks.workunit.client.0.smithi096.stdout:3/323: mkdir d4/d6/d1b/d1d/d64 0 2024-04-18T21:06:59.024 INFO:tasks.workunit.client.0.smithi096.stdout:2/493: read d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 [296563,126473] 0 2024-04-18T21:06:59.028 INFO:tasks.workunit.client.0.smithi096.stdout:3/324: truncate d4/d6/d1b/d2c/f43 2747516 0 2024-04-18T21:06:59.035 INFO:tasks.workunit.client.0.smithi096.stdout:3/325: dwrite d4/d6/d1b/d2c/d31/f41 [4194304,4194304] 0 2024-04-18T21:06:59.035 INFO:tasks.workunit.client.0.smithi096.stdout:7/330: dread d0/d7/d8/f1e [4194304,4194304] 0 2024-04-18T21:06:59.037 INFO:tasks.workunit.client.0.smithi096.stdout:7/331: creat d0/d7/f5f x:0 0 0 2024-04-18T21:06:59.038 INFO:tasks.workunit.client.0.smithi096.stdout:7/332: truncate d0/d7/f5c 567035 0 2024-04-18T21:06:59.038 INFO:tasks.workunit.client.0.smithi096.stdout:7/333: mknod d0/d11/d18/d2e/c60 0 2024-04-18T21:06:59.039 INFO:tasks.workunit.client.0.smithi096.stdout:7/334: rename d0/d7/d42/f4f to d0/d20/d39/f61 0 2024-04-18T21:06:59.040 INFO:tasks.workunit.client.0.smithi096.stdout:7/335: write d0/d7/d8/f55 [2643160,85292] 0 2024-04-18T21:06:59.041 INFO:tasks.workunit.client.0.smithi096.stdout:7/336: chown d0/d7/d8/l15 2 1 2024-04-18T21:06:59.045 INFO:tasks.workunit.client.0.smithi096.stdout:2/494: dread d11/d13/d1a/d1e/d28/d4e/d40/f60 [0,4194304] 0 2024-04-18T21:06:59.046 INFO:tasks.workunit.client.0.smithi096.stdout:2/495: mknod d11/d13/d1d/d5d/ca6 0 2024-04-18T21:06:59.047 INFO:tasks.workunit.client.0.smithi096.stdout:7/337: dwrite d0/d7/f5f [0,4194304] 0 2024-04-18T21:06:59.048 INFO:tasks.workunit.client.0.smithi096.stdout:8/372: dread d0/f8 [0,4194304] 0 2024-04-18T21:06:59.048 INFO:tasks.workunit.client.0.smithi096.stdout:7/338: truncate d0/d11/f43 1631476 0 2024-04-18T21:06:59.049 INFO:tasks.workunit.client.0.smithi096.stdout:8/373: readlink d0/d3/d14/d56/d2f/l30 0 2024-04-18T21:06:59.053 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:59.029+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi096.stdout:8/374: dwrite d0/f12 [0,4194304] 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi096.stdout:8/375: creat d0/d3/d1d/d66/d68/f7e x:0 0 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi096.stdout:3/326: truncate d4/d6/d1b/d1d/f2b 5635438 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi096.stdout:2/496: dread d11/d13/f15 [0,4194304] 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi096.stdout:8/376: readlink d0/d64/l54 0 2024-04-18T21:06:59.060 INFO:tasks.workunit.client.0.smithi096.stdout:3/327: mknod d4/d6/d1b/d2c/c65 0 2024-04-18T21:06:59.060 INFO:tasks.workunit.client.0.smithi096.stdout:2/497: creat d11/d13/d1d/fa7 x:0 0 0 2024-04-18T21:06:59.061 INFO:tasks.workunit.client.0.smithi096.stdout:2/498: write d11/d13/d1d/f45 [1448478,72444] 0 2024-04-18T21:06:59.064 INFO:tasks.workunit.client.0.smithi096.stdout:2/499: truncate d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/fa0 685916 0 2024-04-18T21:06:59.064 INFO:tasks.workunit.client.0.smithi096.stdout:2/500: fdatasync d11/d13/f32 0 2024-04-18T21:06:59.065 INFO:tasks.workunit.client.0.smithi096.stdout:3/328: dwrite d4/d6/d22/d20/f44 [0,4194304] 0 2024-04-18T21:06:59.070 INFO:tasks.workunit.client.0.smithi096.stdout:2/501: dwrite d11/d13/d1a/d1e/d28/d4e/d63/f65 [0,4194304] 0 2024-04-18T21:06:59.071 INFO:tasks.workunit.client.0.smithi096.stdout:2/502: creat d11/d13/d1a/d1e/d9f/fa8 x:0 0 0 2024-04-18T21:06:59.086 INFO:tasks.workunit.client.0.smithi096.stdout:3/329: read d4/d6/d1b/d2c/f43 [1503558,2586] 0 2024-04-18T21:06:59.087 INFO:tasks.workunit.client.0.smithi096.stdout:3/330: creat d4/d6/f66 x:0 0 0 2024-04-18T21:06:59.089 INFO:tasks.workunit.client.0.smithi096.stdout:8/377: dread d0/d3/d1d/d2c/d61/f70 [0,4194304] 0 2024-04-18T21:06:59.090 INFO:tasks.workunit.client.0.smithi096.stdout:8/378: write d0/d3/d14/d33/f6b [972091,100524] 0 2024-04-18T21:06:59.091 INFO:tasks.workunit.client.0.smithi096.stdout:8/379: truncate d0/d3/d1d/d66/d68/f7e 499340 0 2024-04-18T21:06:59.091 INFO:tasks.workunit.client.0.smithi096.stdout:8/380: fdatasync d0/f12 0 2024-04-18T21:06:59.092 INFO:tasks.workunit.client.0.smithi096.stdout:8/381: mkdir d0/d3/d1d/d66/d68/d7f 0 2024-04-18T21:06:59.093 INFO:tasks.workunit.client.0.smithi096.stdout:3/331: dread d4/d6/d1b/d2c/f57 [0,4194304] 0 2024-04-18T21:06:59.094 INFO:tasks.workunit.client.0.smithi096.stdout:3/332: creat d4/d6/d1b/d1d/f67 x:0 0 0 2024-04-18T21:06:59.094 INFO:tasks.workunit.client.0.smithi096.stdout:8/382: read d0/d3/d14/d56/d4d/f5f [156753,74434] 0 2024-04-18T21:06:59.094 INFO:tasks.workunit.client.0.smithi096.stdout:3/333: readlink d4/d8/l59 0 2024-04-18T21:06:59.094 INFO:tasks.workunit.client.0.smithi096.stdout:3/334: creat d4/d6/d1b/d1d/f68 x:0 0 0 2024-04-18T21:06:59.095 INFO:tasks.workunit.client.0.smithi096.stdout:2/503: dread f2 [0,4194304] 0 2024-04-18T21:06:59.095 INFO:tasks.workunit.client.0.smithi096.stdout:3/335: fsync d4/d8/fa 0 2024-04-18T21:06:59.095 INFO:tasks.workunit.client.0.smithi096.stdout:8/383: creat d0/d3/d1d/d2c/d46/d78/f80 x:0 0 0 2024-04-18T21:06:59.095 INFO:tasks.workunit.client.0.smithi096.stdout:3/336: chown d4/d6/d1b/d2c/f5a 26162536 1 2024-04-18T21:06:59.096 INFO:tasks.workunit.client.0.smithi096.stdout:2/504: dread - d11/d13/d1a/d1e/d28/d4e/d5c/fa2 zero size 2024-04-18T21:06:59.096 INFO:tasks.workunit.client.0.smithi096.stdout:8/384: rename d0/d55 to d0/d3/d3a/d81 0 2024-04-18T21:06:59.096 INFO:tasks.workunit.client.0.smithi096.stdout:2/505: write d11/d13/d1a/d1e/f33 [985925,56916] 0 2024-04-18T21:06:59.097 INFO:tasks.workunit.client.0.smithi096.stdout:8/385: fdatasync d0/d3/db/f45 0 2024-04-18T21:06:59.099 INFO:tasks.workunit.client.0.smithi096.stdout:3/337: dread d4/d6/d1b/d1d/f28 [0,4194304] 0 2024-04-18T21:06:59.099 INFO:tasks.workunit.client.0.smithi096.stdout:3/338: dread - d4/d8/f48 zero size 2024-04-18T21:06:59.100 INFO:tasks.workunit.client.0.smithi096.stdout:3/339: chown d4/d6/d22/d20 656306 1 2024-04-18T21:06:59.101 INFO:tasks.workunit.client.0.smithi096.stdout:3/340: dread - d4/d6/f66 zero size 2024-04-18T21:06:59.101 INFO:tasks.workunit.client.0.smithi096.stdout:3/341: stat d4/d6/d1b 0 2024-04-18T21:06:59.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/342: creat d4/d6/d1b/d1d/d64/f69 x:0 0 0 2024-04-18T21:06:59.103 INFO:tasks.workunit.client.0.smithi096.stdout:3/343: symlink d4/d6/d1b/d1d/d64/l6a 0 2024-04-18T21:06:59.103 INFO:tasks.workunit.client.0.smithi096.stdout:2/506: dread d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f78 [0,4194304] 0 2024-04-18T21:06:59.103 INFO:tasks.workunit.client.0.smithi096.stdout:8/386: dread d0/d3/db/f6a [0,4194304] 0 2024-04-18T21:06:59.104 INFO:tasks.workunit.client.0.smithi096.stdout:2/507: readlink d11/d13/d1a/d1e/d28/d4e/l58 0 2024-04-18T21:06:59.104 INFO:tasks.workunit.client.0.smithi096.stdout:2/508: chown d11/d13/d1a/c22 75132688 1 2024-04-18T21:06:59.105 INFO:tasks.workunit.client.0.smithi096.stdout:2/509: link d11/d13/d1a/d1e/d28/d4e/d80/f95 d11/d50/d5b/fa9 0 2024-04-18T21:06:59.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/510: chown d11/d13/d1a/d1e/c6a 1 1 2024-04-18T21:06:59.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/511: symlink d11/d13/d1a/d1e/laa 0 2024-04-18T21:06:59.107 INFO:tasks.workunit.client.0.smithi096.stdout:2/512: chown d11/d13/d1a/d1e/d28/d4e/d40/f49 327242 1 2024-04-18T21:06:59.108 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:59.105+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:59.109 INFO:tasks.workunit.client.0.smithi096.stdout:3/344: write d4/d6/d1b/d2c/f43 [1520418,15525] 0 2024-04-18T21:06:59.109 INFO:tasks.workunit.client.0.smithi096.stdout:8/387: write d0/d3/f57 [3863653,115546] 0 2024-04-18T21:06:59.109 INFO:tasks.workunit.client.0.smithi096.stdout:2/513: link d11/d13/d1d/l74 d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d94/lab 0 2024-04-18T21:06:59.110 INFO:tasks.workunit.client.0.smithi096.stdout:2/514: mknod d11/d13/d1a/d1e/d28/d4e/d5c/cac 0 2024-04-18T21:06:59.110 INFO:tasks.workunit.client.0.smithi096.stdout:3/345: read d4/d8/fa [450486,32571] 0 2024-04-18T21:06:59.111 INFO:tasks.workunit.client.0.smithi096.stdout:3/346: write d4/d6/d22/d20/d46/f56 [636545,58071] 0 2024-04-18T21:06:59.111 INFO:tasks.workunit.client.0.smithi096.stdout:2/515: creat d11/d13/d1d/d5d/d97/fad x:0 0 0 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:5/313: sync 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:9/353: sync 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:6/337: sync 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:4/323: sync 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:0/315: sync 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:9/354: rename d0 to d0/dc/d18/d6d 22 2024-04-18T21:06:59.113 INFO:tasks.workunit.client.0.smithi096.stdout:3/347: write d4/d6/d1b/d2c/f5a [145079,3003] 0 2024-04-18T21:06:59.113 INFO:tasks.workunit.client.0.smithi096.stdout:2/516: chown d11/d50/d5b/l6c 2436024 1 2024-04-18T21:06:59.113 INFO:tasks.workunit.client.0.smithi096.stdout:5/314: fdatasync d2/f27 0 2024-04-18T21:06:59.114 INFO:tasks.workunit.client.0.smithi096.stdout:0/316: unlink d1/db/d30/d31/d39/l57 0 2024-04-18T21:06:59.114 INFO:tasks.workunit.client.0.smithi096.stdout:5/315: mknod d2/d38/d4c/c74 0 2024-04-18T21:06:59.114 INFO:tasks.workunit.client.0.smithi096.stdout:3/348: write d4/d6/d22/d20/d46/f56 [16393,121825] 0 2024-04-18T21:06:59.115 INFO:tasks.workunit.client.0.smithi096.stdout:5/316: stat d2/d11/d28/c43 0 2024-04-18T21:06:59.115 INFO:tasks.workunit.client.0.smithi096.stdout:2/517: link d11/d13/d1a/c29 d11/d13/cae 0 2024-04-18T21:06:59.116 INFO:tasks.workunit.client.0.smithi096.stdout:8/388: dwrite d0/d3/db/f6a [0,4194304] 0 2024-04-18T21:06:59.116 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:59.116 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:59.116 INFO:tasks.workunit.client.0.smithi096.stdout:5/317: chown d2/d11/f3b 224694 1 2024-04-18T21:06:59.117 INFO:tasks.workunit.client.0.smithi096.stdout:8/389: write d0/d3/d14/d33/f6b [28176,79264] 0 2024-04-18T21:06:59.119 INFO:tasks.workunit.client.0.smithi096.stdout:4/324: dread f1 [0,4194304] 0 2024-04-18T21:06:59.119 INFO:tasks.workunit.client.0.smithi096.stdout:2/518: creat d11/d13/d1a/faf x:0 0 0 2024-04-18T21:06:59.119 INFO:tasks.workunit.client.0.smithi096.stdout:4/325: chown d2/c56 0 1 2024-04-18T21:06:59.120 INFO:tasks.workunit.client.0.smithi096.stdout:8/390: unlink d0/d3/d14/d33/f5b 0 2024-04-18T21:06:59.120 INFO:tasks.workunit.client.0.smithi096.stdout:5/318: read d2/f10 [1171439,9437] 0 2024-04-18T21:06:59.122 INFO:tasks.workunit.client.0.smithi096.stdout:9/355: dwrite d0/f34 [0,4194304] 0 2024-04-18T21:06:59.122 INFO:tasks.workunit.client.0.smithi096.stdout:2/519: creat d11/d13/d1a/d1e/d28/d4e/d89/fb0 x:0 0 0 2024-04-18T21:06:59.122 INFO:tasks.workunit.client.0.smithi096.stdout:8/391: mknod d0/d3/d1d/d2c/c82 0 2024-04-18T21:06:59.122 INFO:tasks.workunit.client.0.smithi096.stdout:4/326: dread - d2/d1d/d3a/f45 zero size 2024-04-18T21:06:59.123 INFO:tasks.workunit.client.0.smithi096.stdout:4/327: chown d2/f18 743747513 1 2024-04-18T21:06:59.123 INFO:tasks.workunit.client.0.smithi096.stdout:3/349: dwrite d4/d8/f48 [0,4194304] 0 2024-04-18T21:06:59.123 INFO:tasks.workunit.client.0.smithi096.stdout:2/520: write d11/d13/d1a/d1e/d28/d4e/f3d [3262348,68565] 0 2024-04-18T21:06:59.125 INFO:tasks.workunit.client.0.smithi096.stdout:8/392: mkdir d0/d3/d1d/d83 0 2024-04-18T21:06:59.125 INFO:tasks.workunit.client.0.smithi096.stdout:9/356: creat d0/dc/d18/f6e x:0 0 0 2024-04-18T21:06:59.126 INFO:tasks.workunit.client.0.smithi096.stdout:9/357: write d0/dc/d5f/f68 [118870,31025] 0 2024-04-18T21:06:59.126 INFO:tasks.workunit.client.0.smithi096.stdout:9/358: dread - d0/dc/d5f/f61 zero size 2024-04-18T21:06:59.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/350: rmdir d4 39 2024-04-18T21:06:59.129 INFO:tasks.workunit.client.0.smithi096.stdout:8/393: unlink d0/d3/f6 0 2024-04-18T21:06:59.129 INFO:tasks.workunit.client.0.smithi096.stdout:3/351: mkdir d4/d6/d1b/d2c/d6b 0 2024-04-18T21:06:59.129 INFO:tasks.workunit.client.0.smithi096.stdout:4/328: dwrite d2/d1d/d3a/f45 [0,4194304] 0 2024-04-18T21:06:59.130 INFO:tasks.workunit.client.0.smithi096.stdout:8/394: mknod d0/d3/d1d/d2c/d46/d78/c84 0 2024-04-18T21:06:59.130 INFO:tasks.workunit.client.0.smithi096.stdout:4/329: mknod d2/d2f/d39/c6a 0 2024-04-18T21:06:59.132 INFO:tasks.workunit.client.0.smithi096.stdout:8/395: chown d0/d3/d14/d1b/c4e 176 1 2024-04-18T21:06:59.132 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi096.stdout:4/330: rename d2/l3 to d2/d1d/d3a/l6b 0 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi096.stdout:8/396: mknod d0/d3/d1d/d2c/d46/c85 0 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi096.stdout:4/331: fsync d2/f2c 0 2024-04-18T21:06:59.134 INFO:tasks.workunit.client.0.smithi096.stdout:9/359: dwrite d0/d28/d2f/f64 [0,4194304] 0 2024-04-18T21:06:59.134 INFO:tasks.workunit.client.0.smithi096.stdout:8/397: mkdir d0/d3/d14/d56/d4d/d86 0 2024-04-18T21:06:59.135 INFO:tasks.workunit.client.0.smithi096.stdout:6/338: dread d1/f1c [0,4194304] 0 2024-04-18T21:06:59.135 INFO:tasks.workunit.client.0.smithi096.stdout:3/352: dread d4/d6/d1b/d2c/d31/f41 [4194304,4194304] 0 2024-04-18T21:06:59.135 INFO:tasks.workunit.client.0.smithi096.stdout:8/398: chown d0/d3/d1d/d2c/d46/d78/f80 1232644 1 2024-04-18T21:06:59.136 INFO:tasks.workunit.client.0.smithi096.stdout:3/353: getdents d4 0 2024-04-18T21:06:59.137 INFO:tasks.workunit.client.0.smithi096.stdout:3/354: write d4/d6/d22/d20/f3f [247840,7665] 0 2024-04-18T21:06:59.138 INFO:tasks.workunit.client.0.smithi096.stdout:3/355: chown d4/d6/d1b/d2c/d5c 16154 1 2024-04-18T21:06:59.138 INFO:tasks.workunit.client.0.smithi096.stdout:3/356: fdatasync d4/d6/d1b/d1d/f2e 0 2024-04-18T21:06:59.139 INFO:tasks.workunit.client.0.smithi096.stdout:3/357: rmdir d4/d6/d1b/d2c/d31/d11 39 2024-04-18T21:06:59.140 INFO:tasks.workunit.client.0.smithi096.stdout:4/332: dwrite d2/d2f/d33/d55/d57/f5c [0,4194304] 0 2024-04-18T21:06:59.140 INFO:tasks.workunit.client.0.smithi096.stdout:3/358: mknod d4/d6/d1b/d2c/d31/d4e/c6c 0 2024-04-18T21:06:59.140 INFO:tasks.workunit.client.0.smithi096.stdout:4/333: chown d2/d2f/d33/d55/d57/c66 2966 1 2024-04-18T21:06:59.141 INFO:tasks.workunit.client.0.smithi096.stdout:3/359: fdatasync d4/d6/d1b/d1d/f28 0 2024-04-18T21:06:59.141 INFO:tasks.workunit.client.0.smithi096.stdout:4/334: write d2/d1d/f29 [3660936,125970] 0 2024-04-18T21:06:59.141 INFO:tasks.workunit.client.0.smithi096.stdout:4/335: creat d2/d2a/f6c x:0 0 0 2024-04-18T21:06:59.142 INFO:tasks.workunit.client.0.smithi096.stdout:4/336: mkdir d2/d2a/d54/d6d 0 2024-04-18T21:06:59.143 INFO:tasks.workunit.client.0.smithi096.stdout:4/337: mknod d2/d2f/d33/d55/d57/c6e 0 2024-04-18T21:06:59.143 INFO:tasks.workunit.client.0.smithi096.stdout:4/338: creat d2/d2f/d33/d55/f6f x:0 0 0 2024-04-18T21:06:59.146 INFO:tasks.workunit.client.0.smithi096.stdout:3/360: dwrite d4/d6/d1b/d1d/f67 [0,4194304] 0 2024-04-18T21:06:59.147 INFO:tasks.workunit.client.0.smithi096.stdout:9/360: truncate d0/f5 9768181 0 2024-04-18T21:06:59.149 INFO:tasks.workunit.client.0.smithi096.stdout:3/361: dread d4/d6/f32 [0,4194304] 0 2024-04-18T21:06:59.149 INFO:tasks.workunit.client.0.smithi096.stdout:3/362: symlink d4/d6/d22/d20/d46/l6d 0 2024-04-18T21:06:59.149 INFO:tasks.workunit.client.0.smithi096.stdout:6/339: write d1/f30 [836229,291] 0 2024-04-18T21:06:59.150 INFO:tasks.workunit.client.0.smithi096.stdout:6/340: rename d1/d5/f56 to d1/d5/f5f 0 2024-04-18T21:06:59.151 INFO:tasks.workunit.client.0.smithi096.stdout:6/341: fsync d1/d3a/d57/d26/f29 0 2024-04-18T21:06:59.154 INFO:tasks.workunit.client.0.smithi096.stdout:3/363: dwrite d4/d8/f1f [0,4194304] 0 2024-04-18T21:06:59.158 INFO:tasks.workunit.client.0.smithi096.stdout:3/364: symlink d4/d6/d22/l6e 0 2024-04-18T21:06:59.158 INFO:tasks.workunit.client.0.smithi096.stdout:6/342: dread d1/d5/f5f [0,4194304] 0 2024-04-18T21:06:59.158 INFO:tasks.workunit.client.0.smithi096.stdout:6/343: symlink d1/d5/l60 0 2024-04-18T21:06:59.158 INFO:tasks.workunit.client.0.smithi096.stdout:3/365: creat d4/d6/d22/d20/d46/f6f x:0 0 0 2024-04-18T21:06:59.159 INFO:tasks.workunit.client.0.smithi096.stdout:3/366: chown d4/d6/d22/l1e 8095772 1 2024-04-18T21:06:59.159 INFO:tasks.workunit.client.0.smithi096.stdout:3/367: stat d4/d6/d1b/d2c/d31/d11/f45 0 2024-04-18T21:06:59.160 INFO:tasks.workunit.client.0.smithi096.stdout:9/361: write d0/f58 [4661130,59503] 0 2024-04-18T21:06:59.160 INFO:tasks.workunit.client.0.smithi096.stdout:7/339: sync 2024-04-18T21:06:59.161 INFO:tasks.workunit.client.0.smithi096.stdout:1/368: sync 2024-04-18T21:06:59.161 INFO:tasks.workunit.client.0.smithi096.stdout:5/319: sync 2024-04-18T21:06:59.161 INFO:tasks.workunit.client.0.smithi096.stdout:0/317: sync 2024-04-18T21:06:59.161 INFO:tasks.workunit.client.0.smithi096.stdout:9/362: mkdir d0/dc/d6f 0 2024-04-18T21:06:59.161 INFO:tasks.workunit.client.0.smithi096.stdout:7/340: mkdir d0/d20/d62 0 2024-04-18T21:06:59.162 INFO:tasks.workunit.client.0.smithi096.stdout:0/318: mknod d1/db/d30/c69 0 2024-04-18T21:06:59.162 INFO:tasks.workunit.client.0.smithi096.stdout:7/341: rmdir d0 39 2024-04-18T21:06:59.163 INFO:tasks.workunit.client.0.smithi096.stdout:1/369: mknod d0/df/d62/d69/d6a/c79 0 2024-04-18T21:06:59.163 INFO:tasks.workunit.client.0.smithi096.stdout:9/363: creat d0/dc/d6f/f70 x:0 0 0 2024-04-18T21:06:59.163 INFO:tasks.workunit.client.0.smithi096.stdout:7/342: read - d0/f52 zero size 2024-04-18T21:06:59.163 INFO:tasks.workunit.client.0.smithi096.stdout:0/319: rename d1/f2 to d1/f6a 0 2024-04-18T21:06:59.163 INFO:tasks.workunit.client.0.smithi096.stdout:7/343: chown d0/d7/d8 586 1 2024-04-18T21:06:59.164 INFO:tasks.workunit.client.0.smithi096.stdout:9/364: write d0/f34 [4479791,52103] 0 2024-04-18T21:06:59.164 INFO:tasks.workunit.client.0.smithi096.stdout:1/370: chown d0/df/f2e 1081377936 1 2024-04-18T21:06:59.164 INFO:tasks.workunit.client.0.smithi096.stdout:0/320: chown d1/l2a 370 1 2024-04-18T21:06:59.165 INFO:tasks.workunit.client.0.smithi096.stdout:0/321: stat d1/f62 0 2024-04-18T21:06:59.165 INFO:tasks.workunit.client.0.smithi096.stdout:9/365: chown d0/d28/d3d 20361683 1 2024-04-18T21:06:59.166 INFO:tasks.workunit.client.0.smithi096.stdout:1/371: symlink d0/d27/d5f/d60/l7a 0 2024-04-18T21:06:59.166 INFO:tasks.workunit.client.0.smithi096.stdout:9/366: truncate d0/d28/d2f/f3c 713179 0 2024-04-18T21:06:59.168 INFO:tasks.workunit.client.0.smithi096.stdout:5/320: dwrite d2/d11/d28/d64/f6c [0,4194304] 0 2024-04-18T21:06:59.170 INFO:tasks.workunit.client.0.smithi096.stdout:5/321: mknod d2/c75 0 2024-04-18T21:06:59.172 INFO:tasks.workunit.client.0.smithi096.stdout:5/322: creat d2/d11/d28/d4a/d55/f76 x:0 0 0 2024-04-18T21:06:59.172 INFO:tasks.workunit.client.0.smithi096.stdout:3/368: fsync d4/d6/d22/d20/f3f 0 2024-04-18T21:06:59.173 INFO:tasks.workunit.client.0.smithi096.stdout:1/372: dwrite d0/d27/f73 [0,4194304] 0 2024-04-18T21:06:59.173 INFO:tasks.workunit.client.0.smithi096.stdout:5/323: write d2/d11/f1f [953275,7194] 0 2024-04-18T21:06:59.174 INFO:tasks.workunit.client.0.smithi096.stdout:3/369: symlink d4/d6/d1b/d63/l70 0 2024-04-18T21:06:59.174 INFO:tasks.workunit.client.0.smithi096.stdout:9/367: dwrite d0/dc/d18/f6e [0,4194304] 0 2024-04-18T21:06:59.180 INFO:tasks.workunit.client.0.smithi096.stdout:5/324: read d2/d18/fe [694153,52392] 0 2024-04-18T21:06:59.184 INFO:tasks.workunit.client.0.smithi096.stdout:8/399: dread d0/d3/fd [0,4194304] 0 2024-04-18T21:06:59.184 INFO:tasks.workunit.client.0.smithi096.stdout:2/521: dread d11/d13/d1a/d1e/f68 [0,4194304] 0 2024-04-18T21:06:59.185 INFO:tasks.workunit.client.0.smithi096.stdout:8/400: chown d0/d3/d1d/d2c/d61/f70 228 1 2024-04-18T21:06:59.185 INFO:tasks.workunit.client.0.smithi096.stdout:2/522: truncate d11/d13/d1d/d5d/f8d 1290273 0 2024-04-18T21:06:59.186 INFO:tasks.workunit.client.0.smithi096.stdout:8/401: write d0/d3/d14/d33/f3b [903802,110019] 0 2024-04-18T21:06:59.186 INFO:tasks.workunit.client.0.smithi096.stdout:2/523: write d11/d13/d1a/d1e/d28/d4e/f3d [3379026,99654] 0 2024-04-18T21:06:59.187 INFO:tasks.workunit.client.0.smithi096.stdout:2/524: creat d11/d13/d1a/d1e/d28/fb1 x:0 0 0 2024-04-18T21:06:59.187 INFO:tasks.workunit.client.0.smithi096.stdout:0/322: truncate d1/d23/d32/d43/f46 697470 0 2024-04-18T21:06:59.188 INFO:tasks.workunit.client.0.smithi096.stdout:2/525: creat d11/d13/d1a/d1e/d28/d4e/d89/fb2 x:0 0 0 2024-04-18T21:06:59.189 INFO:tasks.workunit.client.0.smithi096.stdout:2/526: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f92 [145449,37683] 0 2024-04-18T21:06:59.196 INFO:tasks.workunit.client.0.smithi096.stdout:7/344: truncate d0/d20/d39/f61 3102582 0 2024-04-18T21:06:59.196 INFO:tasks.workunit.client.0.smithi096.stdout:1/373: write d0/df/d16/d24/f2b [1862698,70904] 0 2024-04-18T21:06:59.196 INFO:tasks.workunit.client.0.smithi096.stdout:7/345: stat d0/d20/l5e 0 2024-04-18T21:06:59.196 INFO:tasks.workunit.client.0.smithi096.stdout:9/368: truncate d0/d8/d11/d48/f4a 250121 0 2024-04-18T21:06:59.197 INFO:tasks.workunit.client.0.smithi096.stdout:1/374: chown d0/f9 3 1 2024-04-18T21:06:59.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/369: creat d0/d8/f71 x:0 0 0 2024-04-18T21:06:59.198 INFO:tasks.workunit.client.0.smithi096.stdout:0/323: dread d1/db/d25/f37 [0,4194304] 0 2024-04-18T21:06:59.199 INFO:tasks.workunit.client.0.smithi096.stdout:1/375: rename d0/df/d62/d69/d6a/c6d to d0/df/d62/d69/d6a/c7b 0 2024-04-18T21:06:59.199 INFO:tasks.workunit.client.0.smithi096.stdout:0/324: write d1/db/d30/d31/d39/d5d/d60/d21/fa [211006,59404] 0 2024-04-18T21:06:59.200 INFO:tasks.workunit.client.0.smithi096.stdout:1/376: getdents d0/d27/d33 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi096.stdout:0/325: dwrite d1/f62 [0,4194304] 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi096.stdout:2/527: dread d11/d50/f83 [0,4194304] 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi096.stdout:1/377: dwrite d0/d27/d33/f58 [0,4194304] 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi096.stdout:2/528: fdatasync d11/d13/d1a/d1e/d28/d4e/d89/fb2 0 2024-04-18T21:06:59.208 INFO:tasks.workunit.client.0.smithi096.stdout:0/326: rmdir d1/db/d30/d31 39 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi096.stdout:1/378: dread d0/df/d16/d24/f35 [0,4194304] 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/327: stat d1/db/d30/d4a/l63 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/328: unlink d1/db/d25/f37 0 2024-04-18T21:06:59.210 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:59.207+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:59.210 INFO:tasks.workunit.client.0.smithi096.stdout:1/379: rename d0/df/f61 to d0/d27/f7c 0 2024-04-18T21:06:59.211 INFO:tasks.workunit.client.0.smithi096.stdout:0/329: creat d1/db/d30/d4a/d67/f6b x:0 0 0 2024-04-18T21:06:59.211 INFO:tasks.workunit.client.0.smithi096.stdout:9/370: dwrite d0/d8/d11/d48/f4a [0,4194304] 0 2024-04-18T21:06:59.212 INFO:tasks.workunit.client.0.smithi096.stdout:1/380: symlink d0/df/d30/d53/l7d 0 2024-04-18T21:06:59.212 INFO:tasks.workunit.client.0.smithi096.stdout:9/371: symlink d0/d28/d66/l72 0 2024-04-18T21:06:59.213 INFO:tasks.workunit.client.0.smithi096.stdout:1/381: unlink d0/f9 0 2024-04-18T21:06:59.213 INFO:tasks.workunit.client.0.smithi096.stdout:0/330: write d1/db/d30/d31/d39/f40 [977844,94867] 0 2024-04-18T21:06:59.213 INFO:tasks.workunit.client.0.smithi096.stdout:9/372: chown d0/f34 131964 1 2024-04-18T21:06:59.213 INFO:tasks.workunit.client.0.smithi096.stdout:2/529: truncate f1 2766895 0 2024-04-18T21:06:59.214 INFO:tasks.workunit.client.0.smithi096.stdout:0/331: creat d1/db/d30/f6c x:0 0 0 2024-04-18T21:06:59.215 INFO:tasks.workunit.client.0.smithi096.stdout:0/332: mkdir d1/db/d30/d31/d39/d6d 0 2024-04-18T21:06:59.216 INFO:tasks.workunit.client.0.smithi096.stdout:0/333: creat d1/db/d30/d31/d39/f6e x:0 0 0 2024-04-18T21:06:59.216 INFO:tasks.workunit.client.0.smithi096.stdout:0/334: mkdir d1/d23/d32/d43/d6f 0 2024-04-18T21:06:59.217 INFO:tasks.workunit.client.0.smithi096.stdout:0/335: mknod d1/d23/d32/c70 0 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi096.stdout:6/344: sync 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi096.stdout:4/339: sync 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi096.stdout:7/346: sync 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi096.stdout:7/347: fsync d0/d7/f5c 0 2024-04-18T21:06:59.219 INFO:tasks.workunit.client.0.smithi096.stdout:4/340: write d2/f58 [367945,61750] 0 2024-04-18T21:06:59.219 INFO:tasks.workunit.client.0.smithi096.stdout:1/382: dwrite d0/df/d16/d24/f3a [0,4194304] 0 2024-04-18T21:06:59.220 INFO:tasks.workunit.client.0.smithi096.stdout:7/348: truncate d0/d7/d8/f16 4363848 0 2024-04-18T21:06:59.221 INFO:tasks.workunit.client.0.smithi096.stdout:7/349: rmdir d0/d20/d4b 39 2024-04-18T21:06:59.221 INFO:tasks.workunit.client.0.smithi096.stdout:1/383: fdatasync d0/f39 0 2024-04-18T21:06:59.222 INFO:tasks.workunit.client.0.smithi096.stdout:7/350: mkdir d0/d7/d2f/d63 0 2024-04-18T21:06:59.223 INFO:tasks.workunit.client.0.smithi096.stdout:1/384: truncate d0/df/f1a 1063316 0 2024-04-18T21:06:59.224 INFO:tasks.workunit.client.0.smithi096.stdout:2/530: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/f9c [647569,39403] 0 2024-04-18T21:06:59.225 INFO:tasks.workunit.client.0.smithi096.stdout:6/345: dwrite d1/d3a/d36/f51 [0,4194304] 0 2024-04-18T21:06:59.226 INFO:tasks.workunit.client.0.smithi096.stdout:2/531: symlink d11/d13/d1d/d5d/d97/lb3 0 2024-04-18T21:06:59.226 INFO:tasks.workunit.client.0.smithi096.stdout:4/341: dwrite d2/f60 [0,4194304] 0 2024-04-18T21:06:59.226 INFO:tasks.workunit.client.0.smithi096.stdout:6/346: chown d1/d5/f1a 22615136 1 2024-04-18T21:06:59.227 INFO:tasks.workunit.client.0.smithi096.stdout:6/347: mkdir d1/d61 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/342: getdents d2/d2a/d54/d5b 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi096.stdout:2/532: creat d11/d13/d1a/d1e/d28/d4e/fb4 x:0 0 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/343: fdatasync d2/f18 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi096.stdout:6/348: dread - d1/d5/da/d44/d4e/f59 zero size 2024-04-18T21:06:59.229 INFO:tasks.workunit.client.0.smithi096.stdout:6/349: mknod d1/d3a/d36/c62 0 2024-04-18T21:06:59.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/344: symlink d2/d2f/d33/d55/d59/d5f/l70 0 2024-04-18T21:06:59.231 INFO:tasks.workunit.client.0.smithi096.stdout:4/345: unlink d2/d2a/f6c 0 2024-04-18T21:06:59.231 INFO:tasks.workunit.client.0.smithi096.stdout:4/346: mkdir d2/d2a/d54/d71 0 2024-04-18T21:06:59.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/351: truncate d0/d20/f46 74695 0 2024-04-18T21:06:59.232 INFO:tasks.workunit.client.0.smithi096.stdout:4/347: creat d2/d2f/d33/f72 x:0 0 0 2024-04-18T21:06:59.234 INFO:tasks.workunit.client.0.smithi096.stdout:4/348: creat d2/d2a/f73 x:0 0 0 2024-04-18T21:06:59.234 INFO:tasks.workunit.client.0.smithi096.stdout:7/352: getdents d0/d7 0 2024-04-18T21:06:59.234 INFO:tasks.workunit.client.0.smithi096.stdout:5/325: sync 2024-04-18T21:06:59.235 INFO:tasks.workunit.client.0.smithi096.stdout:3/370: sync 2024-04-18T21:06:59.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/402: sync 2024-04-18T21:06:59.235 INFO:tasks.workunit.client.0.smithi096.stdout:6/350: sync 2024-04-18T21:06:59.235 INFO:tasks.workunit.client.0.smithi096.stdout:4/349: write d2/f38 [4517816,107605] 0 2024-04-18T21:06:59.236 INFO:tasks.workunit.client.0.smithi096.stdout:3/371: dread - d4/d6/d1b/d2c/d31/d11/f55 zero size 2024-04-18T21:06:59.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/351: creat d1/d5/da/f63 x:0 0 0 2024-04-18T21:06:59.236 INFO:tasks.workunit.client.0.smithi096.stdout:0/336: dread d1/db/d30/d31/d39/d5d/d60/f3c [0,4194304] 0 2024-04-18T21:06:59.237 INFO:tasks.workunit.client.0.smithi096.stdout:2/533: dwrite d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 [0,4194304] 0 2024-04-18T21:06:59.237 INFO:tasks.workunit.client.0.smithi096.stdout:5/326: chown d2/l1e 1 1 2024-04-18T21:06:59.237 INFO:tasks.workunit.client.0.smithi096.stdout:6/352: readlink d1/d5/l3e 0 2024-04-18T21:06:59.238 INFO:tasks.workunit.client.0.smithi096.stdout:6/353: chown d1/d5/f5d 213292 1 2024-04-18T21:06:59.238 INFO:tasks.workunit.client.0.smithi096.stdout:6/354: fdatasync d1/f34 0 2024-04-18T21:06:59.238 INFO:tasks.workunit.client.0.smithi096.stdout:3/372: fsync d4/d8/f9 0 2024-04-18T21:06:59.239 INFO:tasks.workunit.client.0.smithi096.stdout:5/327: creat d2/d18/d61/d6d/f77 x:0 0 0 2024-04-18T21:06:59.239 INFO:tasks.workunit.client.0.smithi096.stdout:6/355: symlink d1/l64 0 2024-04-18T21:06:59.240 INFO:tasks.workunit.client.0.smithi096.stdout:0/337: creat d1/db/d30/d31/f71 x:0 0 0 2024-04-18T21:06:59.240 INFO:tasks.workunit.client.0.smithi096.stdout:5/328: readlink d2/d38/l47 0 2024-04-18T21:06:59.241 INFO:tasks.workunit.client.0.smithi096.stdout:0/338: read - d1/db/d30/f5b zero size 2024-04-18T21:06:59.242 INFO:tasks.workunit.client.0.smithi096.stdout:5/329: fdatasync d2/d11/f3d 0 2024-04-18T21:06:59.242 INFO:tasks.workunit.client.0.smithi096.stdout:6/356: creat d1/d3a/d57/f65 x:0 0 0 2024-04-18T21:06:59.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/330: creat d2/d11/d28/f78 x:0 0 0 2024-04-18T21:06:59.243 INFO:tasks.workunit.client.0.smithi096.stdout:4/350: dwrite d2/d2f/f36 [0,4194304] 0 2024-04-18T21:06:59.244 INFO:tasks.workunit.client.0.smithi096.stdout:4/351: write d2/f2e [8660974,23325] 0 2024-04-18T21:06:59.251 INFO:tasks.workunit.client.0.smithi096.stdout:4/352: dwrite d2/d2f/d33/f35 [0,4194304] 0 2024-04-18T21:06:59.252 INFO:tasks.workunit.client.0.smithi096.stdout:4/353: rmdir d2/d2f/d39/d43 39 2024-04-18T21:06:59.253 INFO:tasks.workunit.client.0.smithi096.stdout:4/354: write d2/f9 [2352837,122283] 0 2024-04-18T21:06:59.253 INFO:tasks.workunit.client.0.smithi096.stdout:4/355: readlink d2/d1d/l69 0 2024-04-18T21:06:59.254 INFO:tasks.workunit.client.0.smithi096.stdout:4/356: creat d2/d2f/f74 x:0 0 0 2024-04-18T21:06:59.254 INFO:tasks.workunit.client.0.smithi096.stdout:7/353: truncate d0/d7/d8/f1e 2429937 0 2024-04-18T21:06:59.254 INFO:tasks.workunit.client.0.smithi096.stdout:7/354: sync 2024-04-18T21:06:59.254 INFO:tasks.workunit.client.0.smithi096.stdout:7/355: readlink d0/d20/d39/l3d 0 2024-04-18T21:06:59.255 INFO:tasks.workunit.client.0.smithi096.stdout:4/357: truncate d2/d2a/f73 922907 0 2024-04-18T21:06:59.255 INFO:tasks.workunit.client.0.smithi096.stdout:7/356: chown d0/d11 207637798 1 2024-04-18T21:06:59.255 INFO:tasks.workunit.client.0.smithi096.stdout:4/358: stat d2/d2f/d33/d55/d57 0 2024-04-18T21:06:59.256 INFO:tasks.workunit.client.0.smithi096.stdout:4/359: unlink d2/d2f/f74 0 2024-04-18T21:06:59.256 INFO:tasks.workunit.client.0.smithi096.stdout:7/357: truncate d0/d11/f29 2311710 0 2024-04-18T21:06:59.256 INFO:tasks.workunit.client.0.smithi096.stdout:2/534: dread d11/d13/d1a/d1e/d28/d4e/d40/f4c [0,4194304] 0 2024-04-18T21:06:59.258 INFO:tasks.workunit.client.0.smithi096.stdout:2/535: truncate d11/d13/d1a/d1e/d28/d4e/d5c/fa2 662206 0 2024-04-18T21:06:59.259 INFO:tasks.workunit.client.0.smithi096.stdout:2/536: creat d11/d13/d1a/d1e/d28/d4e/d5c/fb5 x:0 0 0 2024-04-18T21:06:59.259 INFO:tasks.workunit.client.0.smithi096.stdout:2/537: sync 2024-04-18T21:06:59.260 INFO:tasks.workunit.client.0.smithi096.stdout:2/538: chown d11/d13/d1a/d1e/d28/d4e/d80/c98 278652 1 2024-04-18T21:06:59.261 INFO:tasks.workunit.client.0.smithi096.stdout:2/539: creat d11/d13/d1a/d1e/d28/d4e/d63/fb6 x:0 0 0 2024-04-18T21:06:59.262 INFO:tasks.workunit.client.0.smithi096.stdout:3/373: dread d4/d6/d1b/f3a [0,4194304] 0 2024-04-18T21:06:59.262 INFO:tasks.workunit.client.0.smithi096.stdout:2/540: creat d11/d50/d5b/fb7 x:0 0 0 2024-04-18T21:06:59.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/339: truncate d1/db/d30/d31/d39/d5d/d60/d21/fa 900771 0 2024-04-18T21:06:59.264 INFO:tasks.workunit.client.0.smithi096.stdout:3/374: getdents d4/d8 0 2024-04-18T21:06:59.264 INFO:tasks.workunit.client.0.smithi096.stdout:5/331: dwrite d2/f16 [0,4194304] 0 2024-04-18T21:06:59.265 INFO:tasks.workunit.client.0.smithi096.stdout:2/541: fsync d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/fa0 0 2024-04-18T21:06:59.265 INFO:tasks.workunit.client.0.smithi096.stdout:5/332: unlink d2/d11/c56 0 2024-04-18T21:06:59.265 INFO:tasks.workunit.client.0.smithi096.stdout:0/340: dread d1/d23/d32/d43/f46 [0,4194304] 0 2024-04-18T21:06:59.266 INFO:tasks.workunit.client.0.smithi096.stdout:5/333: fdatasync d2/d18/f5c 0 2024-04-18T21:06:59.266 INFO:tasks.workunit.client.0.smithi096.stdout:2/542: creat d11/d13/d1d/d5d/fb8 x:0 0 0 2024-04-18T21:06:59.267 INFO:tasks.workunit.client.0.smithi096.stdout:2/543: chown d11/l20 9050340 1 2024-04-18T21:06:59.267 INFO:tasks.workunit.client.0.smithi096.stdout:5/334: creat d2/f79 x:0 0 0 2024-04-18T21:06:59.268 INFO:tasks.workunit.client.0.smithi096.stdout:5/335: write d2/d18/f5c [781468,82334] 0 2024-04-18T21:06:59.268 INFO:tasks.workunit.client.0.smithi096.stdout:5/336: mkdir d2/d18/d61/d6f/d7a 0 2024-04-18T21:06:59.271 INFO:tasks.workunit.client.0.smithi096.stdout:3/375: read d4/d6/d1b/d2c/f5a [75607,82121] 0 2024-04-18T21:06:59.273 INFO:tasks.workunit.client.0.smithi096.stdout:9/373: dread d0/d28/d2f/f17 [0,4194304] 0 2024-04-18T21:06:59.273 INFO:tasks.workunit.client.0.smithi096.stdout:2/544: dwrite d11/d13/d1a/d1e/d28/f3e [0,4194304] 0 2024-04-18T21:06:59.275 INFO:tasks.workunit.client.0.smithi096.stdout:5/337: dwrite d2/d11/f5b [0,4194304] 0 2024-04-18T21:06:59.278 INFO:tasks.workunit.client.0.smithi096.stdout:9/374: dwrite d0/dc/d5f/f68 [0,4194304] 0 2024-04-18T21:06:59.280 INFO:tasks.workunit.client.0.smithi096.stdout:1/385: dread d0/df/d16/f37 [0,4194304] 0 2024-04-18T21:06:59.282 INFO:tasks.workunit.client.0.smithi096.stdout:3/376: rename d4/d6/d1b/d1d/l2f to d4/d6/d22/d20/d46/l71 0 2024-04-18T21:06:59.282 INFO:tasks.workunit.client.0.smithi096.stdout:5/338: mknod d2/d18/d61/d6d/c7b 0 2024-04-18T21:06:59.282 INFO:tasks.workunit.client.0.smithi096.stdout:9/375: symlink d0/d8/d9/d40/l73 0 2024-04-18T21:06:59.283 INFO:tasks.workunit.client.0.smithi096.stdout:6/357: dread d1/f30 [0,4194304] 0 2024-04-18T21:06:59.284 INFO:tasks.workunit.client.0.smithi096.stdout:8/403: dread d0/d3/db/f36 [0,4194304] 0 2024-04-18T21:06:59.284 INFO:tasks.workunit.client.0.smithi096.stdout:3/377: truncate d4/d6/d22/d20/d46/f6f 651880 0 2024-04-18T21:06:59.285 INFO:tasks.workunit.client.0.smithi096.stdout:8/404: creat d0/d3/d14/d1b/f87 x:0 0 0 2024-04-18T21:06:59.286 INFO:tasks.workunit.client.0.smithi096.stdout:8/405: fsync d0/d3/d14/d33/f59 0 2024-04-18T21:06:59.287 INFO:tasks.workunit.client.0.smithi096.stdout:2/545: write d11/f16 [999144,115868] 0 2024-04-18T21:06:59.288 INFO:tasks.workunit.client.0.smithi096.stdout:2/546: dread - d11/d13/d1d/d5d/fb8 zero size 2024-04-18T21:06:59.288 INFO:tasks.workunit.client.0.smithi096.stdout:9/376: dwrite d0/d28/d3d/f6b [0,4194304] 0 2024-04-18T21:06:59.289 INFO:tasks.workunit.client.0.smithi096.stdout:5/339: dwrite d2/f3a [0,4194304] 0 2024-04-18T21:06:59.291 INFO:tasks.workunit.client.0.smithi096.stdout:9/377: rename d0/c2b to d0/dc/d18/c74 0 2024-04-18T21:06:59.295 INFO:tasks.workunit.client.0.smithi096.stdout:2/547: dwrite d11/f7e [0,4194304] 0 2024-04-18T21:06:59.299 INFO:tasks.workunit.client.0.smithi096.stdout:9/378: read d0/d8/d9/d40/f55 [410,57523] 0 2024-04-18T21:06:59.300 INFO:tasks.workunit.client.0.smithi096.stdout:9/379: unlink d0/d8/d11/d39/c6c 0 2024-04-18T21:06:59.301 INFO:tasks.workunit.client.0.smithi096.stdout:9/380: unlink d0/d8/d11/f12 0 2024-04-18T21:06:59.301 INFO:tasks.workunit.client.0.smithi096.stdout:9/381: chown d0/d28/d3d/f6b 289528286 1 2024-04-18T21:06:59.302 INFO:tasks.workunit.client.0.smithi096.stdout:0/341: dread d1/db/d30/d31/f4c [0,4194304] 0 2024-04-18T21:06:59.303 INFO:tasks.workunit.client.0.smithi096.stdout:7/358: dread d0/d11/f32 [0,4194304] 0 2024-04-18T21:06:59.303 INFO:tasks.workunit.client.0.smithi096.stdout:0/342: mknod d1/d23/d32/d43/c72 0 2024-04-18T21:06:59.304 INFO:tasks.workunit.client.0.smithi096.stdout:0/343: symlink d1/db/d30/l73 0 2024-04-18T21:06:59.307 INFO:tasks.workunit.client.0.smithi096.stdout:9/382: dwrite d0/dc/d5f/f6a [0,4194304] 0 2024-04-18T21:06:59.308 INFO:tasks.workunit.client.0.smithi096.stdout:9/383: chown d0/d8/d9/d40/f55 210 1 2024-04-18T21:06:59.309 INFO:tasks.workunit.client.0.smithi096.stdout:7/359: dwrite d0/d7/f5f [4194304,4194304] 0 2024-04-18T21:06:59.309 INFO:tasks.workunit.client.0.smithi096.stdout:7/360: chown d0/d7/d2f/l38 5 1 2024-04-18T21:06:59.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:59.306+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:59.311 INFO:tasks.workunit.client.0.smithi096.stdout:9/384: mknod d0/d8/d11/c75 0 2024-04-18T21:06:59.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/361: truncate d0/d11/f17 2345656 0 2024-04-18T21:06:59.314 INFO:tasks.workunit.client.0.smithi096.stdout:7/362: chown d0/d20/f46 467332 1 2024-04-18T21:06:59.315 INFO:tasks.workunit.client.0.smithi096.stdout:7/363: creat d0/d20/d39/f64 x:0 0 0 2024-04-18T21:06:59.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/364: symlink d0/d7/d2f/d53/l65 0 2024-04-18T21:06:59.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/365: mknod d0/d7/d49/c66 0 2024-04-18T21:06:59.317 INFO:tasks.workunit.client.0.smithi096.stdout:9/385: dwrite d0/dc/d5f/f61 [0,4194304] 0 2024-04-18T21:06:59.318 INFO:tasks.workunit.client.0.smithi096.stdout:7/366: rename d0/d7/l30 to d0/d11/d18/l67 0 2024-04-18T21:06:59.318 INFO:tasks.workunit.client.0.smithi096.stdout:9/386: chown d0/d8/d11/f19 32845026 1 2024-04-18T21:06:59.322 INFO:tasks.workunit.client.0.smithi096.stdout:0/344: dread d1/db/d30/d31/d39/f40 [0,4194304] 0 2024-04-18T21:06:59.323 INFO:tasks.workunit.client.0.smithi096.stdout:0/345: mknod d1/db/d30/d31/d39/d5d/c74 0 2024-04-18T21:06:59.324 INFO:tasks.workunit.client.0.smithi096.stdout:9/387: dwrite d0/d8/d9/d40/f4e [0,4194304] 0 2024-04-18T21:06:59.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/346: creat d1/f75 x:0 0 0 2024-04-18T21:06:59.325 INFO:tasks.workunit.client.0.smithi096.stdout:9/388: rename d0/dc/d6f to d0/dc/d5f/d76 0 2024-04-18T21:06:59.326 INFO:tasks.workunit.client.0.smithi096.stdout:9/389: symlink d0/d8/d11/d48/l77 0 2024-04-18T21:06:59.326 INFO:tasks.workunit.client.0.smithi096.stdout:1/386: sync 2024-04-18T21:06:59.328 INFO:tasks.workunit.client.0.smithi096.stdout:1/387: mknod d0/df/d62/c7e 0 2024-04-18T21:06:59.329 INFO:tasks.workunit.client.0.smithi096.stdout:4/360: dread d2/d2f/d33/f35 [4194304,4194304] 0 2024-04-18T21:06:59.329 INFO:tasks.workunit.client.0.smithi096.stdout:1/388: rename d0/df/d16/d24/f40 to d0/d27/f7f 0 2024-04-18T21:06:59.330 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:59.330 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:59.330 INFO:tasks.workunit.client.0.smithi096.stdout:4/361: rename d2/d2a/c4e to d2/d2a/c75 0 2024-04-18T21:06:59.331 INFO:tasks.workunit.client.0.smithi096.stdout:1/389: chown d0/d27/d5f/d60 2696 1 2024-04-18T21:06:59.331 INFO:tasks.workunit.client.0.smithi096.stdout:1/390: mknod d0/df/d62/d69/c80 0 2024-04-18T21:06:59.331 INFO:tasks.workunit.client.0.smithi096.stdout:0/347: dwrite d1/db/d30/d31/d39/d5d/d60/d21/f1d [0,4194304] 0 2024-04-18T21:06:59.332 INFO:tasks.workunit.client.0.smithi096.stdout:4/362: getdents d2/d2f/d33/d55/d57 0 2024-04-18T21:06:59.332 INFO:tasks.workunit.client.0.smithi096.stdout:0/348: chown d1/db/d30/c33 29755 1 2024-04-18T21:06:59.332 INFO:tasks.workunit.client.0.smithi096.stdout:1/391: rmdir d0/d77 0 2024-04-18T21:06:59.332 INFO:tasks.workunit.client.0.smithi096.stdout:4/363: chown d2/f2e 14117918 1 2024-04-18T21:06:59.333 INFO:tasks.workunit.client.0.smithi096.stdout:1/392: mkdir d0/df/d30/d81 0 2024-04-18T21:06:59.333 INFO:tasks.workunit.client.0.smithi096.stdout:0/349: creat d1/d23/d32/f76 x:0 0 0 2024-04-18T21:06:59.334 INFO:tasks.workunit.client.0.smithi096.stdout:0/350: mkdir d1/db/d30/d31/d39/d77 0 2024-04-18T21:06:59.334 INFO:tasks.workunit.client.0.smithi096.stdout:0/351: creat d1/d23/d32/f78 x:0 0 0 2024-04-18T21:06:59.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/352: mkdir d1/db/d79 0 2024-04-18T21:06:59.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/353: creat d1/db/d79/f7a x:0 0 0 2024-04-18T21:06:59.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/354: dread - d1/db/d30/f5b zero size 2024-04-18T21:06:59.337 INFO:tasks.workunit.client.0.smithi096.stdout:0/355: rename d1/db/d30/d31/d39/d5d/d60/d21/l20 to d1/db/d25/d54/l7b 0 2024-04-18T21:06:59.338 INFO:tasks.workunit.client.0.smithi096.stdout:0/356: read d1/db/d30/d31/d39/d5d/d60/d21/f1d [726929,116724] 0 2024-04-18T21:06:59.339 INFO:tasks.workunit.client.0.smithi096.stdout:0/357: stat d1/db/d30/d31/d39/d5d/d60/d21 0 2024-04-18T21:06:59.340 INFO:tasks.workunit.client.0.smithi096.stdout:0/358: read - d1/db/d30/d31/d39/f55 zero size 2024-04-18T21:06:59.340 INFO:tasks.workunit.client.0.smithi096.stdout:9/390: truncate d0/d8/d11/d48/f4a 2346399 0 2024-04-18T21:06:59.341 INFO:tasks.workunit.client.0.smithi096.stdout:5/340: dread d2/d11/f29 [0,4194304] 0 2024-04-18T21:06:59.341 INFO:tasks.workunit.client.0.smithi096.stdout:6/358: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:59.341 INFO:tasks.workunit.client.0.smithi096.stdout:5/341: unlink d2/d11/f1f 0 2024-04-18T21:06:59.341 INFO:tasks.workunit.client.0.smithi096.stdout:9/391: creat d0/d8/d9/d40/f78 x:0 0 0 2024-04-18T21:06:59.342 INFO:tasks.workunit.client.0.smithi096.stdout:0/359: write d1/db/d30/d31/d39/d5d/d60/d21/f16 [7798424,12143] 0 2024-04-18T21:06:59.342 INFO:tasks.workunit.client.0.smithi096.stdout:9/392: dread - d0/dc/d5f/d76/f70 zero size 2024-04-18T21:06:59.343 INFO:tasks.workunit.client.0.smithi096.stdout:5/342: rename d2/f2c to d2/d11/d28/d4a/d55/f7c 0 2024-04-18T21:06:59.343 INFO:tasks.workunit.client.0.smithi096.stdout:0/360: unlink d1/db/c3a 0 2024-04-18T21:06:59.343 INFO:tasks.workunit.client.0.smithi096.stdout:9/393: rename d0/d28/d2f/f3c to d0/d8/d11/f79 0 2024-04-18T21:06:59.343 INFO:tasks.workunit.client.0.smithi096.stdout:5/343: symlink d2/d18/d61/l7d 0 2024-04-18T21:06:59.344 INFO:tasks.workunit.client.0.smithi096.stdout:9/394: rmdir d0/d28/d66 39 2024-04-18T21:06:59.344 INFO:tasks.workunit.client.0.smithi096.stdout:0/361: symlink d1/d23/d32/d43/d6f/l7c 0 2024-04-18T21:06:59.345 INFO:tasks.workunit.client.0.smithi096.stdout:5/344: mkdir d2/d11/d28/d64/d7e 0 2024-04-18T21:06:59.345 INFO:tasks.workunit.client.0.smithi096.stdout:9/395: fdatasync d0/d8/d9/d40/f78 0 2024-04-18T21:06:59.345 INFO:tasks.workunit.client.0.smithi096.stdout:5/345: fsync d2/d6a/f70 0 2024-04-18T21:06:59.346 INFO:tasks.workunit.client.0.smithi096.stdout:0/362: unlink d1/db/d30/l4e 0 2024-04-18T21:06:59.346 INFO:tasks.workunit.client.0.smithi096.stdout:9/396: write d0/d8/d9/d40/f78 [602885,6309] 0 2024-04-18T21:06:59.347 INFO:tasks.workunit.client.0.smithi096.stdout:0/363: mkdir d1/d23/d32/d7d 0 2024-04-18T21:06:59.347 INFO:tasks.workunit.client.0.smithi096.stdout:5/346: mknod d2/d18/d61/d6f/d7a/c7f 0 2024-04-18T21:06:59.347 INFO:tasks.workunit.client.0.smithi096.stdout:9/397: rmdir d0/d8/d11/d39 39 2024-04-18T21:06:59.347 INFO:tasks.workunit.client.0.smithi096.stdout:6/359: dwrite d1/f33 [0,4194304] 0 2024-04-18T21:06:59.348 INFO:tasks.workunit.client.0.smithi096.stdout:0/364: chown d1/db/d30/d4a 3708373 1 2024-04-18T21:06:59.348 INFO:tasks.workunit.client.0.smithi096.stdout:5/347: write d2/d6a/f70 [92682,81726] 0 2024-04-18T21:06:59.348 INFO:tasks.workunit.client.0.smithi096.stdout:0/365: dread - d1/db/d30/d4a/f4d zero size 2024-04-18T21:06:59.350 INFO:tasks.workunit.client.0.smithi096.stdout:3/378: dread d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:59.350 INFO:tasks.workunit.client.0.smithi096.stdout:9/398: unlink d0/dc/d18/c5e 0 2024-04-18T21:06:59.350 INFO:tasks.workunit.client.0.smithi096.stdout:5/348: creat d2/d11/d28/d4a/f80 x:0 0 0 2024-04-18T21:06:59.350 INFO:tasks.workunit.client.0.smithi096.stdout:0/366: mkdir d1/db/d79/d7e 0 2024-04-18T21:06:59.351 INFO:tasks.workunit.client.0.smithi096.stdout:6/360: write d1/d5/da/d44/d4e/d52/f54 [134978,119384] 0 2024-04-18T21:06:59.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:59.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/379: chown d4/d8/d49/c61 2628227 1 2024-04-18T21:06:59.353 INFO:tasks.workunit.client.0.smithi096.stdout:5/349: mkdir d2/d11/d28/d4a/d55/d81 0 2024-04-18T21:06:59.353 INFO:tasks.workunit.client.0.smithi096.stdout:6/361: chown d1/d3a/d57/f9 132 1 2024-04-18T21:06:59.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/380: read d4/d6/d1b/d1d/f28 [1010516,106371] 0 2024-04-18T21:06:59.354 INFO:tasks.workunit.client.0.smithi096.stdout:5/350: mknod d2/d18/d61/c82 0 2024-04-18T21:06:59.354 INFO:tasks.workunit.client.0.smithi096.stdout:0/367: creat d1/db/d30/d31/f7f x:0 0 0 2024-04-18T21:06:59.354 INFO:tasks.workunit.client.0.smithi096.stdout:8/406: dread d0/d3/db/f2d [0,4194304] 0 2024-04-18T21:06:59.354 INFO:tasks.workunit.client.0.smithi096.stdout:5/351: fsync d2/d11/f68 0 2024-04-18T21:06:59.354 INFO:tasks.workunit.client.0.smithi096.stdout:0/368: stat d1/db/d30/d31/d39/d5d/l68 0 2024-04-18T21:06:59.355 INFO:tasks.workunit.client.0.smithi096.stdout:8/407: symlink d0/d3/d14/d56/d2f/l88 0 2024-04-18T21:06:59.355 INFO:tasks.workunit.client.0.smithi096.stdout:5/352: creat d2/d11/d28/d4a/d55/d81/f83 x:0 0 0 2024-04-18T21:06:59.355 INFO:tasks.workunit.client.0.smithi096.stdout:8/408: dread - d0/d3/d14/f31 zero size 2024-04-18T21:06:59.356 INFO:tasks.workunit.client.0.smithi096.stdout:0/369: creat d1/db/d30/d31/d39/d6d/f80 x:0 0 0 2024-04-18T21:06:59.356 INFO:tasks.workunit.client.0.smithi096.stdout:8/409: chown d0/d3/d14 4697276 1 2024-04-18T21:06:59.357 INFO:tasks.workunit.client.0.smithi096.stdout:2/548: sync 2024-04-18T21:06:59.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/410: rmdir d0/d3/d3a 39 2024-04-18T21:06:59.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/381: sync 2024-04-18T21:06:59.357 INFO:tasks.workunit.client.0.smithi096.stdout:6/362: sync 2024-04-18T21:06:59.357 INFO:tasks.workunit.client.0.smithi096.stdout:0/370: creat d1/db/d30/f81 x:0 0 0 2024-04-18T21:06:59.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/411: fsync d0/d3/d1d/d2c/f44 0 2024-04-18T21:06:59.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/412: sync 2024-04-18T21:06:59.358 INFO:tasks.workunit.client.0.smithi096.stdout:3/382: write d4/d8/f48 [2757219,115397] 0 2024-04-18T21:06:59.358 INFO:tasks.workunit.client.0.smithi096.stdout:6/363: mkdir d1/d3a/d57/d66 0 2024-04-18T21:06:59.358 INFO:tasks.workunit.client.0.smithi096.stdout:6/364: dread - d1/d5/da/d44/d4e/f59 zero size 2024-04-18T21:06:59.359 INFO:tasks.workunit.client.0.smithi096.stdout:3/383: rename d4/d6/d1b/c60 to d4/d6/d22/d20/c72 0 2024-04-18T21:06:59.361 INFO:tasks.workunit.client.0.smithi096.stdout:2/549: dread d11/d13/d1a/d1e/d28/d4e/d63/f65 [0,4194304] 0 2024-04-18T21:06:59.362 INFO:tasks.workunit.client.0.smithi096.stdout:5/353: truncate d2/f3a 593504 0 2024-04-18T21:06:59.362 INFO:tasks.workunit.client.0.smithi096.stdout:8/413: dread d0/d3/db/f6a [0,4194304] 0 2024-04-18T21:06:59.364 INFO:tasks.workunit.client.0.smithi096.stdout:8/414: dread - d0/d3/d3a/f75 zero size 2024-04-18T21:06:59.364 INFO:tasks.workunit.client.0.smithi096.stdout:5/354: getdents d2/d38 0 2024-04-18T21:06:59.364 INFO:tasks.workunit.client.0.smithi096.stdout:2/550: getdents d11/d13/d1d/d5d 0 2024-04-18T21:06:59.364 INFO:tasks.workunit.client.0.smithi096.stdout:5/355: sync 2024-04-18T21:06:59.365 INFO:tasks.workunit.client.0.smithi096.stdout:8/415: fsync d0/d64/f6d 0 2024-04-18T21:06:59.365 INFO:tasks.workunit.client.0.smithi096.stdout:2/551: chown d11/d13/d1a/d1e/d28/d4e 2 1 2024-04-18T21:06:59.366 INFO:tasks.workunit.client.0.smithi096.stdout:0/371: read d1/db/d30/d31/d39/d5d/d60/d21/f16 [3812736,62407] 0 2024-04-18T21:06:59.366 INFO:tasks.workunit.client.0.smithi096.stdout:7/367: dread d0/d7/d8/f1e [0,4194304] 0 2024-04-18T21:06:59.366 INFO:tasks.workunit.client.0.smithi096.stdout:6/365: dwrite d1/d5/f1b [0,4194304] 0 2024-04-18T21:06:59.367 INFO:tasks.workunit.client.0.smithi096.stdout:5/356: mknod d2/d18/d61/d6f/c84 0 2024-04-18T21:06:59.368 INFO:tasks.workunit.client.0.smithi096.stdout:4/364: dread d2/d1d/f29 [0,4194304] 0 2024-04-18T21:06:59.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/393: dread d0/df/d16/f50 [0,4194304] 0 2024-04-18T21:06:59.370 INFO:tasks.workunit.client.0.smithi096.stdout:0/372: mkdir d1/db/d30/d31/d39/d82 0 2024-04-18T21:06:59.370 INFO:tasks.workunit.client.0.smithi096.stdout:5/357: creat d2/d38/d4c/f85 x:0 0 0 2024-04-18T21:06:59.371 INFO:tasks.workunit.client.0.smithi096.stdout:1/394: mknod d0/df/d62/d69/d65/c82 0 2024-04-18T21:06:59.371 INFO:tasks.workunit.client.0.smithi096.stdout:4/365: link d2/d1d/f5e d2/d2a/d54/d71/f76 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi096.stdout:7/368: symlink d0/d7/d42/l68 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi096.stdout:3/384: dwrite d4/d6/f32 [0,4194304] 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi096.stdout:8/416: dread d0/d3/db/f2d [0,4194304] 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi096.stdout:0/373: dread - d1/db/d30/f5b zero size 2024-04-18T21:06:59.373 INFO:tasks.workunit.client.0.smithi096.stdout:0/374: sync 2024-04-18T21:06:59.373 INFO:tasks.workunit.client.0.smithi096.stdout:2/552: getdents d11/d50/d5b 0 2024-04-18T21:06:59.373 INFO:tasks.workunit.client.0.smithi096.stdout:4/366: chown d2/d2a/d54/l64 37 1 2024-04-18T21:06:59.374 INFO:tasks.workunit.client.0.smithi096.stdout:2/553: read - d11/d13/d1a/d1e/d28/d4e/d89/fb2 zero size 2024-04-18T21:06:59.374 INFO:tasks.workunit.client.0.smithi096.stdout:1/395: creat d0/df/d62/f83 x:0 0 0 2024-04-18T21:06:59.375 INFO:tasks.workunit.client.0.smithi096.stdout:8/417: mknod d0/d64/d43/c89 0 2024-04-18T21:06:59.375 INFO:tasks.workunit.client.0.smithi096.stdout:3/385: creat d4/f73 x:0 0 0 2024-04-18T21:06:59.375 INFO:tasks.workunit.client.0.smithi096.stdout:1/396: readlink d0/l75 0 2024-04-18T21:06:59.375 INFO:tasks.workunit.client.0.smithi096.stdout:4/367: rename d2/d1d/d3a/l46 to d2/d2f/d33/d55/d59/l77 0 2024-04-18T21:06:59.375 INFO:tasks.workunit.client.0.smithi096.stdout:6/366: dwrite d1/d3a/d36/f51 [4194304,4194304] 0 2024-04-18T21:06:59.376 INFO:tasks.workunit.client.0.smithi096.stdout:8/418: creat d0/d3/d1d/d66/f8a x:0 0 0 2024-04-18T21:06:59.377 INFO:tasks.workunit.client.0.smithi096.stdout:1/397: rmdir d0/df/d62/d69 39 2024-04-18T21:06:59.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/419: creat d0/d3/d14/d56/d4d/d5a/f8b x:0 0 0 2024-04-18T21:06:59.378 INFO:tasks.workunit.client.0.smithi096.stdout:2/554: link f2 d11/d13/d1a/d1e/d28/d4e/d80/fb9 0 2024-04-18T21:06:59.378 INFO:tasks.workunit.client.0.smithi096.stdout:4/368: mkdir d2/d2a/d54/d6d/d78 0 2024-04-18T21:06:59.379 INFO:tasks.workunit.client.0.smithi096.stdout:6/367: mkdir d1/d3a/d57/d66/d67 0 2024-04-18T21:06:59.380 INFO:tasks.workunit.client.0.smithi096.stdout:6/368: creat d1/d5/da/d44/f68 x:0 0 0 2024-04-18T21:06:59.380 INFO:tasks.workunit.client.0.smithi096.stdout:7/369: dwrite d0/d7/d8/f56 [0,4194304] 0 2024-04-18T21:06:59.380 INFO:tasks.workunit.client.0.smithi096.stdout:8/420: truncate d0/d5d/f77 172184 0 2024-04-18T21:06:59.381 INFO:tasks.workunit.client.0.smithi096.stdout:2/555: unlink d11/d13/d1a/d1e/f33 0 2024-04-18T21:06:59.382 INFO:tasks.workunit.client.0.smithi096.stdout:8/421: rmdir d0/d64 39 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi096.stdout:6/369: creat d1/d5/f69 x:0 0 0 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi096.stdout:0/375: truncate d1/f3 992179 0 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi096.stdout:5/358: write d2/f3a [624422,47310] 0 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi096.stdout:7/370: symlink d0/d20/d62/l69 0 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi096.stdout:2/556: chown d11/d13/d1a/d1e/d28/d4e/f53 8281 1 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi096.stdout:8/422: mknod d0/d5d/c8c 0 2024-04-18T21:06:59.384 INFO:tasks.workunit.client.0.smithi096.stdout:5/359: stat d2/d18/d61/d6f 0 2024-04-18T21:06:59.384 INFO:tasks.workunit.client.0.smithi096.stdout:6/370: creat d1/d3a/d36/f6a x:0 0 0 2024-04-18T21:06:59.385 INFO:tasks.workunit.client.0.smithi096.stdout:0/376: creat d1/db/d30/d31/d39/d5d/d60/d21/d58/f83 x:0 0 0 2024-04-18T21:06:59.385 INFO:tasks.workunit.client.0.smithi096.stdout:8/423: write d0/d3/d14/d1b/f87 [132725,85700] 0 2024-04-18T21:06:59.385 INFO:tasks.workunit.client.0.smithi096.stdout:5/360: creat d2/d6a/f86 x:0 0 0 2024-04-18T21:06:59.385 INFO:tasks.workunit.client.0.smithi096.stdout:2/557: readlink d11/d13/d1a/d1e/d28/d4e/d40/d51/l73 0 2024-04-18T21:06:59.386 INFO:tasks.workunit.client.0.smithi096.stdout:6/371: getdents d1/d17 0 2024-04-18T21:06:59.386 INFO:tasks.workunit.client.0.smithi096.stdout:1/398: dwrite d0/d27/f73 [4194304,4194304] 0 2024-04-18T21:06:59.386 INFO:tasks.workunit.client.0.smithi096.stdout:5/361: write d2/d38/d4c/f85 [67085,78151] 0 2024-04-18T21:06:59.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/424: chown d0/d3/f49 3725435 1 2024-04-18T21:06:59.387 INFO:tasks.workunit.client.0.smithi096.stdout:0/377: creat d1/db/d30/d31/d39/d5d/f84 x:0 0 0 2024-04-18T21:06:59.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/372: stat d1/l16 0 2024-04-18T21:06:59.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/373: sync 2024-04-18T21:06:59.387 INFO:tasks.workunit.client.0.smithi096.stdout:0/378: chown d1/db/d30/d31/d39/d5d/d60/d21/f3f 1989428364 1 2024-04-18T21:06:59.388 INFO:tasks.workunit.client.0.smithi096.stdout:8/425: dread d0/d5d/f77 [0,4194304] 0 2024-04-18T21:06:59.388 INFO:tasks.workunit.client.0.smithi096.stdout:5/362: mkdir d2/d11/d28/d4a/d87 0 2024-04-18T21:06:59.388 INFO:tasks.workunit.client.0.smithi096.stdout:6/374: write d1/f1c [3951038,56553] 0 2024-04-18T21:06:59.388 INFO:tasks.workunit.client.0.smithi096.stdout:1/399: symlink d0/df/d62/d69/d6a/l84 0 2024-04-18T21:06:59.389 INFO:tasks.workunit.client.0.smithi096.stdout:6/375: chown d1/d17 470768341 1 2024-04-18T21:06:59.389 INFO:tasks.workunit.client.0.smithi096.stdout:5/363: rmdir d2/d11/d28/d4a/d55 39 2024-04-18T21:06:59.390 INFO:tasks.workunit.client.0.smithi096.stdout:8/426: write d0/d3/db/f6a [1872582,95915] 0 2024-04-18T21:06:59.390 INFO:tasks.workunit.client.0.smithi096.stdout:6/376: symlink d1/d5/da/l6b 0 2024-04-18T21:06:59.390 INFO:tasks.workunit.client.0.smithi096.stdout:1/400: truncate d0/df/f2e 642683 0 2024-04-18T21:06:59.391 INFO:tasks.workunit.client.0.smithi096.stdout:6/377: creat d1/d5/da/d55/f6c x:0 0 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi096.stdout:1/401: creat d0/df/d62/f85 x:0 0 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi096.stdout:5/364: unlink d2/d11/d28/d4a/d55/d81/f83 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi096.stdout:8/427: rename d0/d3/d14/d56/l2b to d0/d3/d14/d56/d2f/l8d 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi096.stdout:6/378: mknod d1/d5/da/d46/c6d 0 2024-04-18T21:06:59.393 INFO:tasks.workunit.client.0.smithi096.stdout:5/365: fdatasync d2/d11/f52 0 2024-04-18T21:06:59.393 INFO:tasks.workunit.client.0.smithi096.stdout:2/558: dwrite d11/d13/d1a/d1e/d28/d4e/d40/f60 [4194304,4194304] 0 2024-04-18T21:06:59.393 INFO:tasks.workunit.client.0.smithi096.stdout:1/402: symlink d0/df/d30/d53/l86 0 2024-04-18T21:06:59.393 INFO:tasks.workunit.client.0.smithi096.stdout:8/428: creat d0/f8e x:0 0 0 2024-04-18T21:06:59.393 INFO:tasks.workunit.client.0.smithi096.stdout:1/403: sync 2024-04-18T21:06:59.394 INFO:tasks.workunit.client.0.smithi096.stdout:6/379: creat d1/d3a/d57/d66/f6e x:0 0 0 2024-04-18T21:06:59.394 INFO:tasks.workunit.client.0.smithi096.stdout:3/386: dread d4/d6/d1b/d1d/f2b [4194304,4194304] 0 2024-04-18T21:06:59.394 INFO:tasks.workunit.client.0.smithi096.stdout:3/387: fdatasync d4/d6/d1b/d1d/f28 0 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:3/388: truncate d4/d8/f48 4654749 0 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:2/559: creat d11/d50/d8e/fba x:0 0 0 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:8/429: fdatasync d0/d3/d14/d56/d4d/f50 0 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:6/380: creat d1/d3a/d36/f6f x:0 0 0 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:1/404: mknod d0/c87 0 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:3/389: rmdir d4/d6/d1b/d1d 39 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:5/366: getdents d2/d18/d61/d6d 0 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:5/367: sync 2024-04-18T21:06:59.397 INFO:tasks.workunit.client.0.smithi096.stdout:2/560: write d11/d50/d5b/fa9 [828984,109639] 0 2024-04-18T21:06:59.397 INFO:tasks.workunit.client.0.smithi096.stdout:3/390: fsync d4/d6/d22/d20/f3f 0 2024-04-18T21:06:59.397 INFO:tasks.workunit.client.0.smithi096.stdout:1/405: mknod d0/d27/d5f/d60/c88 0 2024-04-18T21:06:59.398 INFO:tasks.workunit.client.0.smithi096.stdout:5/368: mkdir d2/d18/d61/d6f/d88 0 2024-04-18T21:06:59.398 INFO:tasks.workunit.client.0.smithi096.stdout:5/369: symlink d2/d38/l89 0 2024-04-18T21:06:59.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/430: read d0/d3/d14/d56/d4d/f5f [15298,126169] 0 2024-04-18T21:06:59.399 INFO:tasks.workunit.client.0.smithi096.stdout:5/370: rename d2/d11/f5b to d2/d18/f8a 0 2024-04-18T21:06:59.399 INFO:tasks.workunit.client.0.smithi096.stdout:3/391: dread d4/d6/d1b/d2c/d31/f5d [0,4194304] 0 2024-04-18T21:06:59.400 INFO:tasks.workunit.client.0.smithi096.stdout:5/371: write d2/d11/f71 [288827,35340] 0 2024-04-18T21:06:59.400 INFO:tasks.workunit.client.0.smithi096.stdout:8/431: truncate d0/d3/d14/d33/f69 151533 0 2024-04-18T21:06:59.401 INFO:tasks.workunit.client.0.smithi096.stdout:5/372: stat d2/d11/d28/f72 0 2024-04-18T21:06:59.402 INFO:tasks.workunit.client.0.smithi096.stdout:0/379: truncate d1/db/d30/f5c 680510 0 2024-04-18T21:06:59.402 INFO:tasks.workunit.client.0.smithi096.stdout:8/432: truncate d0/d3/d14/d33/f59 633703 0 2024-04-18T21:06:59.402 INFO:tasks.workunit.client.0.smithi096.stdout:3/392: getdents d4/d6/d1b/d2c/d31/d11 0 2024-04-18T21:06:59.402 INFO:tasks.workunit.client.0.smithi096.stdout:5/373: symlink d2/d38/l8b 0 2024-04-18T21:06:59.403 INFO:tasks.workunit.client.0.smithi096.stdout:8/433: write d0/f8e [660896,93540] 0 2024-04-18T21:06:59.404 INFO:tasks.workunit.client.0.smithi096.stdout:2/561: dwrite d11/d13/d1a/d1e/d28/d4e/fb4 [0,4194304] 0 2024-04-18T21:06:59.404 INFO:tasks.workunit.client.0.smithi096.stdout:8/434: write d0/f12 [4012849,83265] 0 2024-04-18T21:06:59.404 INFO:tasks.workunit.client.0.smithi096.stdout:3/393: rename d4/d6/d1b/d2c/d31/f52 to d4/d8/f74 0 2024-04-18T21:06:59.405 INFO:tasks.workunit.client.0.smithi096.stdout:7/371: dwrite d0/d20/d39/f61 [0,4194304] 0 2024-04-18T21:06:59.407 INFO:tasks.workunit.client.0.smithi096.stdout:2/562: mknod d11/d13/d1a/d1e/cbb 0 2024-04-18T21:06:59.408 INFO:tasks.workunit.client.0.smithi096.stdout:5/374: rename d2/d18/l45 to d2/d18/d61/d6f/d7a/l8c 0 2024-04-18T21:06:59.408 INFO:tasks.workunit.client.0.smithi096.stdout:3/394: write d4/d6/d1b/d2c/f5a [361333,89622] 0 2024-04-18T21:06:59.409 INFO:tasks.workunit.client.0.smithi096.stdout:8/435: creat d0/d3/d14/f8f x:0 0 0 2024-04-18T21:06:59.409 INFO:tasks.workunit.client.0.smithi096.stdout:6/381: write d1/d3a/f3f [1274309,90258] 0 2024-04-18T21:06:59.409 INFO:tasks.workunit.client.0.smithi096.stdout:2/563: dread - d11/d13/d1a/d1e/d28/d4e/f7a zero size 2024-04-18T21:06:59.410 INFO:tasks.workunit.client.0.smithi096.stdout:5/375: creat d2/d18/d61/d6f/d7a/f8d x:0 0 0 2024-04-18T21:06:59.410 INFO:tasks.workunit.client.0.smithi096.stdout:0/380: rename d1/db/d30/d31/d39/d5d/d60/d21 to d1/db/d30/d31/d85 0 2024-04-18T21:06:59.410 INFO:tasks.workunit.client.0.smithi096.stdout:8/436: symlink d0/d5d/l90 0 2024-04-18T21:06:59.410 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:06:59.409+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:06:59.410 INFO:tasks.workunit.client.0.smithi096.stdout:1/406: truncate d0/df/d16/d24/f4a 2898108 0 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi096.stdout:3/395: write d4/d6/d22/d20/d46/f6f [1492544,2558] 0 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi096.stdout:5/376: symlink d2/d11/d28/d4a/d55/l8e 0 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi096.stdout:6/382: truncate d1/d3a/d57/d66/f6e 166305 0 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi096.stdout:2/564: creat d11/d50/d5b/d8a/fbc x:0 0 0 2024-04-18T21:06:59.413 INFO:tasks.workunit.client.0.smithi096.stdout:6/383: rmdir d1/d17 39 2024-04-18T21:06:59.413 INFO:tasks.workunit.client.0.smithi096.stdout:0/381: creat d1/db/d30/f86 x:0 0 0 2024-04-18T21:06:59.414 INFO:tasks.workunit.client.0.smithi096.stdout:8/437: link d0/d64/l54 d0/d3/d14/d56/d2f/l91 0 2024-04-18T21:06:59.414 INFO:tasks.workunit.client.0.smithi096.stdout:7/372: dwrite d0/d20/d39/f4c [0,4194304] 0 2024-04-18T21:06:59.415 INFO:tasks.workunit.client.0.smithi096.stdout:6/384: write d1/d5/f5f [253196,109379] 0 2024-04-18T21:06:59.417 INFO:tasks.workunit.client.0.smithi096.stdout:8/438: creat d0/d3/d14/d33/f92 x:0 0 0 2024-04-18T21:06:59.421 INFO:tasks.workunit.client.0.smithi096.stdout:6/385: rename d1/d5/da/d44/d4e/l4b to d1/d3a/d36/l70 0 2024-04-18T21:06:59.422 INFO:tasks.workunit.client.0.smithi096.stdout:1/407: dwrite d0/f70 [0,4194304] 0 2024-04-18T21:06:59.422 INFO:tasks.workunit.client.0.smithi096.stdout:3/396: dwrite d4/f35 [0,4194304] 0 2024-04-18T21:06:59.422 INFO:tasks.workunit.client.0.smithi096.stdout:8/439: truncate d0/d3/d14/d33/f69 1015086 0 2024-04-18T21:06:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:6/386: dread - d1/d5/f69 zero size 2024-04-18T21:06:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:9/399: dread d0/d8/d11/d1f/f52 [0,4194304] 0 2024-04-18T21:06:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:3/397: chown d4/d6/d22/d20 39650659 1 2024-04-18T21:06:59.424 INFO:tasks.workunit.client.0.smithi096.stdout:2/565: dwrite d11/d13/d1a/d1e/d28/d4e/f3d [0,4194304] 0 2024-04-18T21:06:59.424 INFO:tasks.workunit.client.0.smithi096.stdout:6/387: mkdir d1/d5/da/d46/d71 0 2024-04-18T21:06:59.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/398: write d4/d6/d1b/d1d/f67 [3350067,32802] 0 2024-04-18T21:06:59.425 INFO:tasks.workunit.client.0.smithi096.stdout:6/388: stat d1/l12 0 2024-04-18T21:06:59.426 INFO:tasks.workunit.client.0.smithi096.stdout:9/400: truncate d0/d28/d2f/f17 661221 0 2024-04-18T21:06:59.426 INFO:tasks.workunit.client.0.smithi096.stdout:2/566: write d11/d13/d1a/d1e/d28/d4e/d63/f65 [2094398,11774] 0 2024-04-18T21:06:59.426 INFO:tasks.workunit.client.0.smithi096.stdout:6/389: write d1/d5/da/f63 [1006550,64639] 0 2024-04-18T21:06:59.426 INFO:tasks.workunit.client.0.smithi096.stdout:2/567: fsync d11/f39 0 2024-04-18T21:06:59.427 INFO:tasks.workunit.client.0.smithi096.stdout:9/401: chown d0/d28/d2f/f42 4552299 1 2024-04-18T21:06:59.427 INFO:tasks.workunit.client.0.smithi096.stdout:9/402: chown d0/d28/d3d/f62 27 1 2024-04-18T21:06:59.427 INFO:tasks.workunit.client.0.smithi096.stdout:5/377: truncate d2/d11/d28/d4a/d55/f7c 86064 0 2024-04-18T21:06:59.428 INFO:tasks.workunit.client.0.smithi096.stdout:2/568: creat d11/d50/d5b/fbd x:0 0 0 2024-04-18T21:06:59.429 INFO:tasks.workunit.client.0.smithi096.stdout:5/378: mkdir d2/d8f 0 2024-04-18T21:06:59.429 INFO:tasks.workunit.client.0.smithi096.stdout:6/390: truncate d1/d3a/d57/d26/f29 3123791 0 2024-04-18T21:06:59.430 INFO:tasks.workunit.client.0.smithi096.stdout:2/569: mkdir d11/d13/d1a/d1e/d28/d4e/d40/dbe 0 2024-04-18T21:06:59.430 INFO:tasks.workunit.client.0.smithi096.stdout:3/399: dread d4/d8/f1f [0,4194304] 0 2024-04-18T21:06:59.430 INFO:tasks.workunit.client.0.smithi096.stdout:9/403: getdents d0/d28 0 2024-04-18T21:06:59.431 INFO:tasks.workunit.client.0.smithi096.stdout:5/379: creat d2/d11/d28/d4a/d87/f90 x:0 0 0 2024-04-18T21:06:59.432 INFO:tasks.workunit.client.0.smithi096.stdout:9/404: dread - d0/d28/d3d/f54 zero size 2024-04-18T21:06:59.432 INFO:tasks.workunit.client.0.smithi096.stdout:7/373: dwrite d0/d11/f29 [0,4194304] 0 2024-04-18T21:06:59.432 INFO:tasks.workunit.client.0.smithi096.stdout:3/400: dread - d4/d6/d1b/d1d/d64/f69 zero size 2024-04-18T21:06:59.433 INFO:tasks.workunit.client.0.smithi096.stdout:5/380: dread d2/f10 [0,4194304] 0 2024-04-18T21:06:59.434 INFO:tasks.workunit.client.0.smithi096.stdout:6/391: getdents d1/d5 0 2024-04-18T21:06:59.434 INFO:tasks.workunit.client.0.smithi096.stdout:7/374: rmdir d0/d20/d39 39 2024-04-18T21:06:59.435 INFO:tasks.workunit.client.0.smithi096.stdout:9/405: fsync d0/d8/d9/f23 0 2024-04-18T21:06:59.435 INFO:tasks.workunit.client.0.smithi096.stdout:9/406: stat d0/dc 0 2024-04-18T21:06:59.436 INFO:tasks.workunit.client.0.smithi096.stdout:6/392: chown d1/d5/da/d44/f68 136 1 2024-04-18T21:06:59.436 INFO:tasks.workunit.client.0.smithi096.stdout:3/401: getdents d4/d6/d7 0 2024-04-18T21:06:59.436 INFO:tasks.workunit.client.0.smithi096.stdout:9/407: mkdir d0/d28/d7a 0 2024-04-18T21:06:59.436 INFO:tasks.workunit.client.0.smithi096.stdout:7/375: creat d0/d7/d8/f6a x:0 0 0 2024-04-18T21:06:59.438 INFO:tasks.workunit.client.0.smithi096.stdout:3/402: truncate d4/d6/d1b/d2c/f5a 1332413 0 2024-04-18T21:06:59.438 INFO:tasks.workunit.client.0.smithi096.stdout:2/570: dwrite d11/d13/d1a/d1e/d28/d4e/d63/fb6 [0,4194304] 0 2024-04-18T21:06:59.439 INFO:tasks.workunit.client.0.smithi096.stdout:7/376: stat d0/d7/d49 0 2024-04-18T21:06:59.439 INFO:tasks.workunit.client.0.smithi096.stdout:0/382: truncate d1/db/d30/d31/d39/d5d/d60/f3c 279587 0 2024-04-18T21:06:59.440 INFO:tasks.workunit.client.0.smithi096.stdout:1/408: read d0/d27/f7f [616819,68640] 0 2024-04-18T21:06:59.441 INFO:tasks.workunit.client.0.smithi096.stdout:5/381: dwrite d2/d18/f8a [4194304,4194304] 0 2024-04-18T21:06:59.441 INFO:tasks.workunit.client.0.smithi096.stdout:7/377: write d0/d7/d8/f6a [948878,52072] 0 2024-04-18T21:06:59.441 INFO:tasks.workunit.client.0.smithi096.stdout:0/383: dread - d1/db/d30/d31/d85/d58/f83 zero size 2024-04-18T21:06:59.442 INFO:tasks.workunit.client.0.smithi096.stdout:1/409: write d0/d27/f3c [690378,110123] 0 2024-04-18T21:06:59.443 INFO:tasks.workunit.client.0.smithi096.stdout:0/384: write d1/f75 [32344,76605] 0 2024-04-18T21:06:59.443 INFO:tasks.workunit.client.0.smithi096.stdout:5/382: creat d2/d18/d61/d6f/f91 x:0 0 0 2024-04-18T21:06:59.443 INFO:tasks.workunit.client.0.smithi096.stdout:7/378: truncate d0/f52 774182 0 2024-04-18T21:06:59.444 INFO:tasks.workunit.client.0.smithi096.stdout:1/410: chown d0/df/d16/d24 515751 1 2024-04-18T21:06:59.444 INFO:tasks.workunit.client.0.smithi096.stdout:6/393: dwrite d1/d3a/d36/f6f [0,4194304] 0 2024-04-18T21:06:59.445 INFO:tasks.workunit.client.0.smithi096.stdout:1/411: fdatasync d0/f3e 0 2024-04-18T21:06:59.445 INFO:tasks.workunit.client.0.smithi096.stdout:5/383: creat d2/d11/d28/d64/f92 x:0 0 0 2024-04-18T21:06:59.445 INFO:tasks.workunit.client.0.smithi096.stdout:5/384: sync 2024-04-18T21:06:59.445 INFO:tasks.workunit.client.0.smithi096.stdout:0/385: creat d1/db/d30/f87 x:0 0 0 2024-04-18T21:06:59.447 INFO:tasks.workunit.client.0.smithi096.stdout:0/386: chown d1/db/d25/d54 4608062 1 2024-04-18T21:06:59.448 INFO:tasks.workunit.client.0.smithi096.stdout:7/379: link d0/d11/c1f d0/d7/d2f/d53/c6b 0 2024-04-18T21:06:59.448 INFO:tasks.workunit.client.0.smithi096.stdout:5/385: dread d2/d18/fe [0,4194304] 0 2024-04-18T21:06:59.449 INFO:tasks.workunit.client.0.smithi096.stdout:2/571: dwrite d11/d13/d1a/d1e/d28/d4e/f53 [0,4194304] 0 2024-04-18T21:06:59.449 INFO:tasks.workunit.client.0.smithi096.stdout:4/369: dread d2/f26 [0,4194304] 0 2024-04-18T21:06:59.450 INFO:tasks.workunit.client.0.smithi096.stdout:7/380: rmdir d0/d7/d49 39 2024-04-18T21:06:59.450 INFO:tasks.workunit.client.0.smithi096.stdout:0/387: creat d1/db/d30/d4a/d67/f88 x:0 0 0 2024-04-18T21:06:59.450 INFO:tasks.workunit.client.0.smithi096.stdout:4/370: creat d2/d2a/f79 x:0 0 0 2024-04-18T21:06:59.451 INFO:tasks.workunit.client.0.smithi096.stdout:2/572: getdents d11/d13/d1d 0 2024-04-18T21:06:59.451 INFO:tasks.workunit.client.0.smithi096.stdout:4/371: truncate d2/f50 760291 0 2024-04-18T21:06:59.452 INFO:tasks.workunit.client.0.smithi096.stdout:7/381: write d0/d7/f5c [526204,103999] 0 2024-04-18T21:06:59.453 INFO:tasks.workunit.client.0.smithi096.stdout:7/382: write d0/f52 [1351233,82631] 0 2024-04-18T21:06:59.453 INFO:tasks.workunit.client.0.smithi096.stdout:0/388: truncate d1/db/d30/d31/d85/fa 1842008 0 2024-04-18T21:06:59.453 INFO:tasks.workunit.client.0.smithi096.stdout:0/389: sync 2024-04-18T21:06:59.455 INFO:tasks.workunit.client.0.smithi096.stdout:7/383: unlink d0/d11/f32 0 2024-04-18T21:06:59.456 INFO:tasks.workunit.client.0.smithi096.stdout:6/394: dread d1/d3a/d36/f42 [0,4194304] 0 2024-04-18T21:06:59.456 INFO:tasks.workunit.client.0.smithi096.stdout:7/384: mkdir d0/d20/d6c 0 2024-04-18T21:06:59.457 INFO:tasks.workunit.client.0.smithi096.stdout:5/386: dwrite d2/f10 [0,4194304] 0 2024-04-18T21:06:59.458 INFO:tasks.workunit.client.0.smithi096.stdout:5/387: stat d2/f20 0 2024-04-18T21:06:59.458 INFO:tasks.workunit.client.0.smithi096.stdout:6/395: mknod d1/d17/c72 0 2024-04-18T21:06:59.459 INFO:tasks.workunit.client.0.smithi096.stdout:7/385: write d0/d7/d8/f56 [2776371,111224] 0 2024-04-18T21:06:59.459 INFO:tasks.workunit.client.0.smithi096.stdout:4/372: dwrite d2/d2f/d33/f3b [0,4194304] 0 2024-04-18T21:06:59.459 INFO:tasks.workunit.client.0.smithi096.stdout:5/388: write d2/d11/d28/d64/f6c [1283662,89512] 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/386: symlink d0/d20/d62/l6d 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi096.stdout:6/396: rename d1/d5/da/l1d to d1/d5/da/d44/l73 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi096.stdout:4/373: creat d2/d2a/d54/d5b/f7a x:0 0 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi096.stdout:5/389: rename d2/d11/d28/d4a/d55/l5f to d2/d18/d61/d6d/l93 0 2024-04-18T21:06:59.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/374: write f1 [138486,86584] 0 2024-04-18T21:06:59.464 INFO:tasks.workunit.client.0.smithi096.stdout:5/390: write d2/d11/f52 [1012337,44273] 0 2024-04-18T21:06:59.464 INFO:tasks.workunit.client.0.smithi096.stdout:9/408: dread d0/d8/d9/f23 [0,4194304] 0 2024-04-18T21:06:59.465 INFO:tasks.workunit.client.0.smithi096.stdout:6/397: symlink d1/d5/da/d44/d4e/d52/l74 0 2024-04-18T21:06:59.465 INFO:tasks.workunit.client.0.smithi096.stdout:4/375: creat d2/d2a/f7b x:0 0 0 2024-04-18T21:06:59.466 INFO:tasks.workunit.client.0.smithi096.stdout:1/412: read d0/df/d16/d24/f2b [2005883,49237] 0 2024-04-18T21:06:59.466 INFO:tasks.workunit.client.0.smithi096.stdout:6/398: stat d1/d3a/d57/d26/f3c 0 2024-04-18T21:06:59.466 INFO:tasks.workunit.client.0.smithi096.stdout:9/409: fsync d0/d8/d11/f38 0 2024-04-18T21:06:59.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/413: symlink d0/df/d62/d69/d65/l89 0 2024-04-18T21:06:59.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/391: mknod d2/d18/d61/d6f/d7a/c94 0 2024-04-18T21:06:59.469 INFO:tasks.workunit.client.0.smithi096.stdout:6/399: read - d1/d17/f5c zero size 2024-04-18T21:06:59.469 INFO:tasks.workunit.client.0.smithi096.stdout:9/410: rename d0/d8/d11/d39/c46 to d0/d28/c7b 0 2024-04-18T21:06:59.469 INFO:tasks.workunit.client.0.smithi096.stdout:1/414: chown d0/df/f64 189645990 1 2024-04-18T21:06:59.470 INFO:tasks.workunit.client.0.smithi096.stdout:6/400: write d1/f33 [353349,47944] 0 2024-04-18T21:06:59.471 INFO:tasks.workunit.client.0.smithi096.stdout:5/392: creat d2/d18/d61/d6f/f95 x:0 0 0 2024-04-18T21:06:59.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/411: link d0/dc/d18/f6e d0/f7c 0 2024-04-18T21:06:59.472 INFO:tasks.workunit.client.0.smithi096.stdout:7/387: dwrite d0/fc [0,4194304] 0 2024-04-18T21:06:59.472 INFO:tasks.workunit.client.0.smithi096.stdout:0/390: read d1/f2d [1843862,120901] 0 2024-04-18T21:06:59.473 INFO:tasks.workunit.client.0.smithi096.stdout:0/391: sync 2024-04-18T21:06:59.473 INFO:tasks.workunit.client.0.smithi096.stdout:4/376: dwrite d2/d1d/f15 [0,4194304] 0 2024-04-18T21:06:59.474 INFO:tasks.workunit.client.0.smithi096.stdout:0/392: chown d1/db/d30/d31/d85/f5 40848375 1 2024-04-18T21:06:59.474 INFO:tasks.workunit.client.0.smithi096.stdout:1/415: link d0/c41 d0/df/d62/c8a 0 2024-04-18T21:06:59.475 INFO:tasks.workunit.client.0.smithi096.stdout:0/393: write d1/db/d30/f6c [617870,42994] 0 2024-04-18T21:06:59.475 INFO:tasks.workunit.client.0.smithi096.stdout:4/377: creat d2/d2a/d54/f7c x:0 0 0 2024-04-18T21:06:59.475 INFO:tasks.workunit.client.0.smithi096.stdout:5/393: mkdir d2/d18/d61/d6f/d88/d96 0 2024-04-18T21:06:59.475 INFO:tasks.workunit.client.0.smithi096.stdout:1/416: symlink d0/df/d62/d69/l8b 0 2024-04-18T21:06:59.476 INFO:tasks.workunit.client.0.smithi096.stdout:7/388: symlink d0/d7/l6e 0 2024-04-18T21:06:59.476 INFO:tasks.workunit.client.0.smithi096.stdout:9/412: link d0/l15 d0/d8/d9/d40/l7d 0 2024-04-18T21:06:59.476 INFO:tasks.workunit.client.0.smithi096.stdout:5/394: mknod d2/d6a/c97 0 2024-04-18T21:06:59.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/417: mknod d0/df/d62/c8c 0 2024-04-18T21:06:59.478 INFO:tasks.workunit.client.0.smithi096.stdout:4/378: mkdir d2/d2f/d33/d55/d57/d7d 0 2024-04-18T21:06:59.478 INFO:tasks.workunit.client.0.smithi096.stdout:1/418: fdatasync d0/df/d30/f4e 0 2024-04-18T21:06:59.478 INFO:tasks.workunit.client.0.smithi096.stdout:9/413: creat d0/d8/d11/d48/f7e x:0 0 0 2024-04-18T21:06:59.478 INFO:tasks.workunit.client.0.smithi096.stdout:0/394: write d1/db/d30/d31/d39/d5d/d60/f1f [441267,59746] 0 2024-04-18T21:06:59.479 INFO:tasks.workunit.client.0.smithi096.stdout:5/395: rename d2/d11/d28/c3e to d2/d11/c98 0 2024-04-18T21:06:59.480 INFO:tasks.workunit.client.0.smithi096.stdout:9/414: readlink d0/d8/d11/l37 0 2024-04-18T21:06:59.480 INFO:tasks.workunit.client.0.smithi096.stdout:5/396: stat d2/d11/d28/d4a/d69 0 2024-04-18T21:06:59.480 INFO:tasks.workunit.client.0.smithi096.stdout:4/379: link f0 d2/d1d/f7e 0 2024-04-18T21:06:59.480 INFO:tasks.workunit.client.0.smithi096.stdout:8/440: dread d0/d3/f5 [0,4194304] 0 2024-04-18T21:06:59.480 INFO:tasks.workunit.client.0.smithi096.stdout:0/395: dread - d1/d23/d32/d43/f4f zero size 2024-04-18T21:06:59.481 INFO:tasks.workunit.client.0.smithi096.stdout:6/401: dwrite d1/d5/da/d44/d4e/d52/f54 [0,4194304] 0 2024-04-18T21:06:59.481 INFO:tasks.workunit.client.0.smithi096.stdout:5/397: fsync d2/d38/d4c/f5e 0 2024-04-18T21:06:59.481 INFO:tasks.workunit.client.0.smithi096.stdout:8/441: chown d0/d5d/c8c 575 1 2024-04-18T21:06:59.482 INFO:tasks.workunit.client.0.smithi096.stdout:0/396: write d1/db/d30/f5b [765993,60913] 0 2024-04-18T21:06:59.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/419: mkdir d0/df/d62/d69/d6a/d8d 0 2024-04-18T21:06:59.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/420: chown d0/df/d16/f50 2257 1 2024-04-18T21:06:59.484 INFO:tasks.workunit.client.0.smithi096.stdout:1/421: chown d0/df/d30/f4e 35 1 2024-04-18T21:06:59.485 INFO:tasks.workunit.client.0.smithi096.stdout:6/402: creat d1/d3a/d57/d26/f75 x:0 0 0 2024-04-18T21:06:59.485 INFO:tasks.workunit.client.0.smithi096.stdout:5/398: rename d2/d38/d4c/f4e to d2/d11/d28/d64/d7e/f99 0 2024-04-18T21:06:59.485 INFO:tasks.workunit.client.0.smithi096.stdout:8/442: fdatasync d0/d3/f18 0 2024-04-18T21:06:59.485 INFO:tasks.workunit.client.0.smithi096.stdout:1/422: mknod d0/d27/d33/c8e 0 2024-04-18T21:06:59.486 INFO:tasks.workunit.client.0.smithi096.stdout:0/397: write d1/db/d25/f28 [7462705,115875] 0 2024-04-18T21:06:59.486 INFO:tasks.workunit.client.0.smithi096.stdout:6/403: symlink d1/d3a/d57/d66/l76 0 2024-04-18T21:06:59.486 INFO:tasks.workunit.client.0.smithi096.stdout:5/399: fdatasync d2/f2b 0 2024-04-18T21:06:59.486 INFO:tasks.workunit.client.0.smithi096.stdout:6/404: chown d1/d5/da/d44 17971 1 2024-04-18T21:06:59.486 INFO:tasks.workunit.client.0.smithi096.stdout:5/400: fsync d2/d11/f3b 0 2024-04-18T21:06:59.487 INFO:tasks.workunit.client.0.smithi096.stdout:0/398: write d1/f6a [189261,81707] 0 2024-04-18T21:06:59.488 INFO:tasks.workunit.client.0.smithi096.stdout:5/401: rmdir d2 39 2024-04-18T21:06:59.488 INFO:tasks.workunit.client.0.smithi096.stdout:6/405: rmdir d1/d5/da 39 2024-04-18T21:06:59.489 INFO:tasks.workunit.client.0.smithi096.stdout:5/402: symlink d2/d18/l9a 0 2024-04-18T21:06:59.489 INFO:tasks.workunit.client.0.smithi096.stdout:6/406: symlink d1/d5/da/d44/d4e/d52/l77 0 2024-04-18T21:06:59.489 INFO:tasks.workunit.client.0.smithi096.stdout:8/443: dread d0/d3/d14/d33/f3b [0,4194304] 0 2024-04-18T21:06:59.490 INFO:tasks.workunit.client.0.smithi096.stdout:3/403: dread d4/d8/f48 [0,4194304] 0 2024-04-18T21:06:59.490 INFO:tasks.workunit.client.0.smithi096.stdout:1/423: dread d0/f70 [0,4194304] 0 2024-04-18T21:06:59.490 INFO:tasks.workunit.client.0.smithi096.stdout:6/407: mknod d1/d3a/d57/d26/c78 0 2024-04-18T21:06:59.490 INFO:tasks.workunit.client.0.smithi096.stdout:1/424: fdatasync d0/f49 0 2024-04-18T21:06:59.491 INFO:tasks.workunit.client.0.smithi096.stdout:3/404: symlink d4/d8/l75 0 2024-04-18T21:06:59.491 INFO:tasks.workunit.client.0.smithi096.stdout:1/425: sync 2024-04-18T21:06:59.491 INFO:tasks.workunit.client.0.smithi096.stdout:6/408: symlink d1/d5/da/d55/l79 0 2024-04-18T21:06:59.492 INFO:tasks.workunit.client.0.smithi096.stdout:4/380: write d2/d2a/d54/d71/f76 [476553,62158] 0 2024-04-18T21:06:59.492 INFO:tasks.workunit.client.0.smithi096.stdout:5/403: getdents d2/d11/d28/d64 0 2024-04-18T21:06:59.492 INFO:tasks.workunit.client.0.smithi096.stdout:6/409: chown d1/d5/da/f2a 61711563 1 2024-04-18T21:06:59.493 INFO:tasks.workunit.client.0.smithi096.stdout:6/410: mkdir d1/d3a/d36/d7a 0 2024-04-18T21:06:59.493 INFO:tasks.workunit.client.0.smithi096.stdout:6/411: symlink d1/d5/l7b 0 2024-04-18T21:06:59.494 INFO:tasks.workunit.client.0.smithi096.stdout:6/412: unlink d1/d3a/d57/d26/fe 0 2024-04-18T21:06:59.495 INFO:tasks.workunit.client.0.smithi096.stdout:6/413: mkdir d1/d5/da/d46/d71/d7c 0 2024-04-18T21:06:59.496 INFO:tasks.workunit.client.0.smithi096.stdout:6/414: truncate d1/d3a/d57/d26/f29 2558781 0 2024-04-18T21:06:59.497 INFO:tasks.workunit.client.0.smithi096.stdout:6/415: chown d1/f1c 19336553 1 2024-04-18T21:06:59.497 INFO:tasks.workunit.client.0.smithi096.stdout:6/416: fsync d1/d3a/d36/f6f 0 2024-04-18T21:06:59.498 INFO:tasks.workunit.client.0.smithi096.stdout:6/417: rename d1/f33 to d1/d5/da/d44/f7d 0 2024-04-18T21:06:59.500 INFO:tasks.workunit.client.0.smithi096.stdout:4/381: truncate d2/d2f/d39/d43/f48 3690157 0 2024-04-18T21:06:59.502 INFO:tasks.workunit.client.0.smithi096.stdout:3/405: dwrite d4/d6/d1b/f38 [0,4194304] 0 2024-04-18T21:06:59.502 INFO:tasks.workunit.client.0.smithi096.stdout:2/573: dread d11/d13/f2d [0,4194304] 0 2024-04-18T21:06:59.503 INFO:tasks.workunit.client.0.smithi096.stdout:2/574: chown d11/d13/d1a/d1e/d9f 176833692 1 2024-04-18T21:06:59.504 INFO:tasks.workunit.client.0.smithi096.stdout:2/575: dread - d11/d13/d1d/fa7 zero size 2024-04-18T21:06:59.504 INFO:tasks.workunit.client.0.smithi096.stdout:4/382: unlink d2/d2f/d39/d43/c63 0 2024-04-18T21:06:59.504 INFO:tasks.workunit.client.0.smithi096.stdout:3/406: rename d4/d6/d1b/d1d/f67 to d4/d6/d22/d20/f76 0 2024-04-18T21:06:59.505 INFO:tasks.workunit.client.0.smithi096.stdout:2/576: mkdir d11/d13/d1a/d1e/dbf 0 2024-04-18T21:06:59.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/407: fdatasync d4/d6/d1b/d1d/d64/f69 0 2024-04-18T21:06:59.505 INFO:tasks.workunit.client.0.smithi096.stdout:6/418: dread d1/d5/f5f [0,4194304] 0 2024-04-18T21:06:59.506 INFO:tasks.workunit.client.0.smithi096.stdout:1/426: dread d0/d27/f7c [0,4194304] 0 2024-04-18T21:06:59.506 INFO:tasks.workunit.client.0.smithi096.stdout:4/383: mknod d2/d1d/d3a/c7f 0 2024-04-18T21:06:59.506 INFO:tasks.workunit.client.0.smithi096.stdout:2/577: readlink d11/d13/d1a/d1e/d28/d4e/l58 0 2024-04-18T21:06:59.507 INFO:tasks.workunit.client.0.smithi096.stdout:1/427: fdatasync d0/df/d16/d24/f31 0 2024-04-18T21:06:59.507 INFO:tasks.workunit.client.0.smithi096.stdout:3/408: symlink d4/d6/d1b/d1d/d64/l77 0 2024-04-18T21:06:59.507 INFO:tasks.workunit.client.0.smithi096.stdout:4/384: truncate d2/d2a/d54/d5b/f7a 763375 0 2024-04-18T21:06:59.508 INFO:tasks.workunit.client.0.smithi096.stdout:6/419: symlink d1/d5/da/d44/d4e/l7e 0 2024-04-18T21:06:59.508 INFO:tasks.workunit.client.0.smithi096.stdout:3/409: chown d4/d6/d22/l6e 903113 1 2024-04-18T21:06:59.508 INFO:tasks.workunit.client.0.smithi096.stdout:2/578: fsync d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/f9c 0 2024-04-18T21:06:59.509 INFO:tasks.workunit.client.0.smithi096.stdout:8/444: dread d0/d3/d14/d33/f6b [0,4194304] 0 2024-04-18T21:06:59.509 INFO:tasks.workunit.client.0.smithi096.stdout:6/420: chown d1/f3 3 1 2024-04-18T21:06:59.510 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:59.510 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:59.510 INFO:tasks.workunit.client.0.smithi096.stdout:4/385: rename d2/f58 to d2/d2a/d54/d71/f80 0 2024-04-18T21:06:59.511 INFO:tasks.workunit.client.0.smithi096.stdout:1/428: truncate d0/f3e 3845988 0 2024-04-18T21:06:59.511 INFO:tasks.workunit.client.0.smithi096.stdout:6/421: dread - d1/d5/f69 zero size 2024-04-18T21:06:59.511 INFO:tasks.workunit.client.0.smithi096.stdout:3/410: creat d4/d6/d1b/d1d/d64/f78 x:0 0 0 2024-04-18T21:06:59.511 INFO:tasks.workunit.client.0.smithi096.stdout:8/445: write d0/d3/db/f6a [697941,91485] 0 2024-04-18T21:06:59.511 INFO:tasks.workunit.client.0.smithi096.stdout:2/579: mkdir d11/d13/d1a/d1e/d28/d4e/d89/dc0 0 2024-04-18T21:06:59.511 INFO:tasks.workunit.client.0.smithi096.stdout:4/386: creat d2/d2a/d54/d6d/f81 x:0 0 0 2024-04-18T21:06:59.511 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:59.507+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:59.512 INFO:tasks.workunit.client.0.smithi096.stdout:1/429: mkdir d0/d27/d5f/d60/d8f 0 2024-04-18T21:06:59.513 INFO:tasks.workunit.client.0.smithi096.stdout:2/580: write d11/d13/f2d [2652034,33174] 0 2024-04-18T21:06:59.514 INFO:tasks.workunit.client.0.smithi096.stdout:8/446: getdents d0/d3/d14/d56/d4d 0 2024-04-18T21:06:59.516 INFO:tasks.workunit.client.0.smithi096.stdout:2/581: write d11/d13/d1a/d1e/d28/f59 [715802,8973] 0 2024-04-18T21:06:59.516 INFO:tasks.workunit.client.0.smithi096.stdout:7/389: dread d0/d7/fb [0,4194304] 0 2024-04-18T21:06:59.516 INFO:tasks.workunit.client.0.smithi096.stdout:3/411: dread d4/d6/f32 [0,4194304] 0 2024-04-18T21:06:59.517 INFO:tasks.workunit.client.0.smithi096.stdout:8/447: unlink d0/d3/d14/d56/d2f/l8d 0 2024-04-18T21:06:59.517 INFO:tasks.workunit.client.0.smithi096.stdout:4/387: dread d2/d2f/d33/f35 [4194304,4194304] 0 2024-04-18T21:06:59.519 INFO:tasks.workunit.client.0.smithi096.stdout:8/448: fsync d0/d3/d14/d56/d4d/f50 0 2024-04-18T21:06:59.519 INFO:tasks.workunit.client.0.smithi096.stdout:3/412: chown d4/d6/d7/c14 472364 1 2024-04-18T21:06:59.519 INFO:tasks.workunit.client.0.smithi096.stdout:5/404: dread d2/f2b [0,4194304] 0 2024-04-18T21:06:59.519 INFO:tasks.workunit.client.0.smithi096.stdout:6/422: dwrite d1/d5/da/f63 [0,4194304] 0 2024-04-18T21:06:59.520 INFO:tasks.workunit.client.0.smithi096.stdout:5/405: readlink d2/d38/l3f 0 2024-04-18T21:06:59.520 INFO:tasks.workunit.client.0.smithi096.stdout:7/390: creat d0/d7/d2f/d53/f6f x:0 0 0 2024-04-18T21:06:59.521 INFO:tasks.workunit.client.0.smithi096.stdout:2/582: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/cc1 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi096.stdout:1/430: dwrite d0/f7 [4194304,4194304] 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi096.stdout:3/413: symlink d4/d6/d1b/d1d/d64/l79 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi096.stdout:6/423: creat d1/d5/da/d46/d71/f7f x:0 0 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi096.stdout:4/388: link d2/f60 d2/d2a/d54/d71/f82 0 2024-04-18T21:06:59.523 INFO:tasks.workunit.client.0.smithi096.stdout:9/415: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:59.523 INFO:tasks.workunit.client.0.smithi096.stdout:5/406: rmdir d2/d18/d61 39 2024-04-18T21:06:59.523 INFO:tasks.workunit.client.0.smithi096.stdout:5/407: sync 2024-04-18T21:06:59.523 INFO:tasks.workunit.client.0.smithi096.stdout:4/389: write d2/d1d/f15 [1954712,4165] 0 2024-04-18T21:06:59.523 INFO:tasks.workunit.client.0.smithi096.stdout:5/408: fsync d2/d11/f3b 0 2024-04-18T21:06:59.524 INFO:tasks.workunit.client.0.smithi096.stdout:7/391: fdatasync d0/d20/f5d 0 2024-04-18T21:06:59.525 INFO:tasks.workunit.client.0.smithi096.stdout:2/583: mkdir d11/d50/d8e/dc2 0 2024-04-18T21:06:59.525 INFO:tasks.workunit.client.0.smithi096.stdout:3/414: creat d4/d6/d1b/d1d/f7a x:0 0 0 2024-04-18T21:06:59.526 INFO:tasks.workunit.client.0.smithi096.stdout:1/431: mkdir d0/d27/d5f/d60/d90 0 2024-04-18T21:06:59.526 INFO:tasks.workunit.client.0.smithi096.stdout:9/416: symlink d0/d8/d11/d39/l7f 0 2024-04-18T21:06:59.526 INFO:tasks.workunit.client.0.smithi096.stdout:4/390: creat d2/d2f/d39/d43/f83 x:0 0 0 2024-04-18T21:06:59.527 INFO:tasks.workunit.client.0.smithi096.stdout:5/409: mkdir d2/d9b 0 2024-04-18T21:06:59.527 INFO:tasks.workunit.client.0.smithi096.stdout:4/391: readlink d2/d1d/l4d 0 2024-04-18T21:06:59.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/432: write d0/df/d16/f54 [477677,113850] 0 2024-04-18T21:06:59.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/433: sync 2024-04-18T21:06:59.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/434: sync 2024-04-18T21:06:59.528 INFO:tasks.workunit.client.0.smithi096.stdout:4/392: mkdir d2/d2a/d84 0 2024-04-18T21:06:59.528 INFO:tasks.workunit.client.0.smithi096.stdout:9/417: mknod d0/dc/c80 0 2024-04-18T21:06:59.529 INFO:tasks.workunit.client.0.smithi096.stdout:5/410: write d2/d11/d28/f78 [381635,89616] 0 2024-04-18T21:06:59.529 INFO:tasks.workunit.client.0.smithi096.stdout:1/435: unlink d0/cb 0 2024-04-18T21:06:59.530 INFO:tasks.workunit.client.0.smithi096.stdout:4/393: chown d2/d2f 56 1 2024-04-18T21:06:59.530 INFO:tasks.workunit.client.0.smithi096.stdout:2/584: unlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/f9c 0 2024-04-18T21:06:59.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:59.532 INFO:tasks.workunit.client.0.smithi096.stdout:4/394: readlink d2/d2f/d33/l53 0 2024-04-18T21:06:59.532 INFO:tasks.workunit.client.0.smithi096.stdout:1/436: rmdir d0/d27/d5f/d60 39 2024-04-18T21:06:59.532 INFO:tasks.workunit.client.0.smithi096.stdout:4/395: stat d2 0 2024-04-18T21:06:59.532 INFO:tasks.workunit.client.0.smithi096.stdout:3/415: dread d4/d6/d1b/d2c/f53 [0,4194304] 0 2024-04-18T21:06:59.535 INFO:tasks.workunit.client.0.smithi096.stdout:1/437: write d0/df/d16/f54 [615314,48431] 0 2024-04-18T21:06:59.536 INFO:tasks.workunit.client.0.smithi096.stdout:6/424: dwrite d1/d3a/d36/f42 [0,4194304] 0 2024-04-18T21:06:59.536 INFO:tasks.workunit.client.0.smithi096.stdout:7/392: dwrite d0/d7/d49/f4e [0,4194304] 0 2024-04-18T21:06:59.536 INFO:tasks.workunit.client.0.smithi096.stdout:5/411: dread d2/d11/d28/f78 [0,4194304] 0 2024-04-18T21:06:59.537 INFO:tasks.workunit.client.0.smithi096.stdout:1/438: dread - d0/df/d62/f85 zero size 2024-04-18T21:06:59.537 INFO:tasks.workunit.client.0.smithi096.stdout:2/585: dread d11/d13/d1a/d1e/d28/d4e/d40/f4c [0,4194304] 0 2024-04-18T21:06:59.537 INFO:tasks.workunit.client.0.smithi096.stdout:5/412: fsync d2/d18/f8a 0 2024-04-18T21:06:59.538 INFO:tasks.workunit.client.0.smithi096.stdout:9/418: dwrite d0/dc/d5f/f61 [0,4194304] 0 2024-04-18T21:06:59.539 INFO:tasks.workunit.client.0.smithi096.stdout:9/419: chown d0/dc/c80 16 1 2024-04-18T21:06:59.540 INFO:tasks.workunit.client.0.smithi096.stdout:9/420: truncate d0/d8/d11/d48/f7e 258001 0 2024-04-18T21:06:59.541 INFO:tasks.workunit.client.0.smithi096.stdout:4/396: dread d2/d1d/f5e [0,4194304] 0 2024-04-18T21:06:59.542 INFO:tasks.workunit.client.0.smithi096.stdout:3/416: unlink d4/d6/d1b/d2c/d31/f5d 0 2024-04-18T21:06:59.542 INFO:tasks.workunit.client.0.smithi096.stdout:6/425: mkdir d1/d3a/d57/d66/d80 0 2024-04-18T21:06:59.543 INFO:tasks.workunit.client.0.smithi096.stdout:1/439: fdatasync d0/d27/d33/f3d 0 2024-04-18T21:06:59.543 INFO:tasks.workunit.client.0.smithi096.stdout:7/393: mknod d0/d20/d4b/c70 0 2024-04-18T21:06:59.543 INFO:tasks.workunit.client.0.smithi096.stdout:3/417: mknod d4/d8/d49/c7b 0 2024-04-18T21:06:59.544 INFO:tasks.workunit.client.0.smithi096.stdout:4/397: mknod d2/d1d/c85 0 2024-04-18T21:06:59.544 INFO:tasks.workunit.client.0.smithi096.stdout:0/399: dread d1/f6a [0,4194304] 0 2024-04-18T21:06:59.545 INFO:tasks.workunit.client.0.smithi096.stdout:6/426: stat d1/d3a/d57/d26 0 2024-04-18T21:06:59.545 INFO:tasks.workunit.client.0.smithi096.stdout:9/421: creat d0/d28/f81 x:0 0 0 2024-04-18T21:06:59.545 INFO:tasks.workunit.client.0.smithi096.stdout:7/394: mknod d0/d20/c71 0 2024-04-18T21:06:59.545 INFO:tasks.workunit.client.0.smithi096.stdout:4/398: chown d2/d1d/d3a/l6b 0 1 2024-04-18T21:06:59.545 INFO:tasks.workunit.client.0.smithi096.stdout:2/586: dwrite d11/d50/d5b/f8c [0,4194304] 0 2024-04-18T21:06:59.546 INFO:tasks.workunit.client.0.smithi096.stdout:9/422: dread - d0/dc/d5f/d76/f70 zero size 2024-04-18T21:06:59.547 INFO:tasks.workunit.client.0.smithi096.stdout:6/427: symlink d1/d3a/d57/d26/l81 0 2024-04-18T21:06:59.547 INFO:tasks.workunit.client.0.smithi096.stdout:4/399: mknod d2/d2a/d54/d5b/c86 0 2024-04-18T21:06:59.548 INFO:tasks.workunit.client.0.smithi096.stdout:3/418: write d4/d6/d1b/d2c/d31/d11/f45 [955959,12309] 0 2024-04-18T21:06:59.548 INFO:tasks.workunit.client.0.smithi096.stdout:2/587: rename d11/d13/d1a/d1e/d28/d4e/d5c/cac to d11/d13/d1d/d5d/d97/cc3 0 2024-04-18T21:06:59.548 INFO:tasks.workunit.client.0.smithi096.stdout:7/395: creat d0/d11/f72 x:0 0 0 2024-04-18T21:06:59.548 INFO:tasks.workunit.client.0.smithi096.stdout:9/423: creat d0/d8/d11/f82 x:0 0 0 2024-04-18T21:06:59.549 INFO:tasks.workunit.client.0.smithi096.stdout:3/419: symlink d4/d6/d1b/d2c/d31/d11/l7c 0 2024-04-18T21:06:59.549 INFO:tasks.workunit.client.0.smithi096.stdout:7/396: readlink d0/d7/d8/l37 0 2024-04-18T21:06:59.549 INFO:tasks.workunit.client.0.smithi096.stdout:5/413: write d2/d11/f3d [439051,39109] 0 2024-04-18T21:06:59.550 INFO:tasks.workunit.client.0.smithi096.stdout:6/428: link d1/d3a/d57/d66/f6e d1/d5/da/d55/f82 0 2024-04-18T21:06:59.550 INFO:tasks.workunit.client.0.smithi096.stdout:1/440: dwrite d0/d27/d33/f58 [0,4194304] 0 2024-04-18T21:06:59.550 INFO:tasks.workunit.client.0.smithi096.stdout:2/588: unlink d11/d13/d1a/d1e/d28/d4e/d5c/fa2 0 2024-04-18T21:06:59.550 INFO:tasks.workunit.client.0.smithi096.stdout:9/424: chown d0/d8/d9/f20 5890097 1 2024-04-18T21:06:59.551 INFO:tasks.workunit.client.0.smithi096.stdout:3/420: write d4/d6/d1b/d1d/f2e [2972250,114035] 0 2024-04-18T21:06:59.551 INFO:tasks.workunit.client.0.smithi096.stdout:0/400: write d1/db/d30/d31/d39/f66 [768192,103467] 0 2024-04-18T21:06:59.552 INFO:tasks.workunit.client.0.smithi096.stdout:1/441: write d0/f70 [546111,4629] 0 2024-04-18T21:06:59.552 INFO:tasks.workunit.client.0.smithi096.stdout:0/401: write d1/f62 [4760193,123793] 0 2024-04-18T21:06:59.553 INFO:tasks.workunit.client.0.smithi096.stdout:3/421: write d4/d6/d1b/d1d/d64/f78 [428813,84916] 0 2024-04-18T21:06:59.554 INFO:tasks.workunit.client.0.smithi096.stdout:9/425: write d0/d28/d3d/f6b [1022283,120253] 0 2024-04-18T21:06:59.555 INFO:tasks.workunit.client.0.smithi096.stdout:0/402: write d1/db/d30/d31/d39/d5d/d60/f1f [1433538,97578] 0 2024-04-18T21:06:59.556 INFO:tasks.workunit.client.0.smithi096.stdout:2/589: link d11/d13/d1d/d5d/l6e d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/lc4 0 2024-04-18T21:06:59.557 INFO:tasks.workunit.client.0.smithi096.stdout:5/414: write d2/d38/f63 [967944,45509] 0 2024-04-18T21:06:59.557 INFO:tasks.workunit.client.0.smithi096.stdout:3/422: unlink d4/d6/d1b/d2c/d31/d11/f45 0 2024-04-18T21:06:59.557 INFO:tasks.workunit.client.0.smithi096.stdout:2/590: stat d11/l27 0 2024-04-18T21:06:59.557 INFO:tasks.workunit.client.0.smithi096.stdout:6/429: dread d1/d3a/d36/f6f [0,4194304] 0 2024-04-18T21:06:59.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/397: dwrite d0/fc [0,4194304] 0 2024-04-18T21:06:59.558 INFO:tasks.workunit.client.0.smithi096.stdout:6/430: dread - d1/d5/f2c zero size 2024-04-18T21:06:59.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/415: fsync d2/d11/d28/d4a/d87/f90 0 2024-04-18T21:06:59.559 INFO:tasks.workunit.client.0.smithi096.stdout:3/423: write d4/d6/d1b/f38 [4173281,20315] 0 2024-04-18T21:06:59.559 INFO:tasks.workunit.client.0.smithi096.stdout:8/449: dread d0/fe [0,4194304] 0 2024-04-18T21:06:59.560 INFO:tasks.workunit.client.0.smithi096.stdout:5/416: read d2/f2b [732680,25568] 0 2024-04-18T21:06:59.561 INFO:tasks.workunit.client.0.smithi096.stdout:2/591: unlink cc 0 2024-04-18T21:06:59.561 INFO:tasks.workunit.client.0.smithi096.stdout:3/424: rmdir d4/d6/d7 39 2024-04-18T21:06:59.562 INFO:tasks.workunit.client.0.smithi096.stdout:9/426: dwrite d0/f34 [0,4194304] 0 2024-04-18T21:06:59.562 INFO:tasks.workunit.client.0.smithi096.stdout:1/442: dread d0/df/d16/f68 [0,4194304] 0 2024-04-18T21:06:59.562 INFO:tasks.workunit.client.0.smithi096.stdout:6/431: mknod d1/d3a/d36/d7a/c83 0 2024-04-18T21:06:59.562 INFO:tasks.workunit.client.0.smithi096.stdout:8/450: creat d0/d3/f93 x:0 0 0 2024-04-18T21:06:59.563 INFO:tasks.workunit.client.0.smithi096.stdout:5/417: write d2/d11/d28/f78 [22450,53132] 0 2024-04-18T21:06:59.563 INFO:tasks.workunit.client.0.smithi096.stdout:6/432: creat d1/d5/da/d46/d71/f84 x:0 0 0 2024-04-18T21:06:59.564 INFO:tasks.workunit.client.0.smithi096.stdout:3/425: symlink d4/d6/d1b/d2c/d31/l7d 0 2024-04-18T21:06:59.564 INFO:tasks.workunit.client.0.smithi096.stdout:2/592: mkdir d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5 0 2024-04-18T21:06:59.564 INFO:tasks.workunit.client.0.smithi096.stdout:1/443: write d0/d27/f7f [3278263,41446] 0 2024-04-18T21:06:59.564 INFO:tasks.workunit.client.0.smithi096.stdout:9/427: write d0/d8/d11/f79 [617332,64341] 0 2024-04-18T21:06:59.565 INFO:tasks.workunit.client.0.smithi096.stdout:2/593: creat d11/d50/d8e/fc6 x:0 0 0 2024-04-18T21:06:59.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/444: chown d0/df/d16/l3f 15172286 1 2024-04-18T21:06:59.566 INFO:tasks.workunit.client.0.smithi096.stdout:0/403: dwrite d1/db/d25/f28 [4194304,4194304] 0 2024-04-18T21:06:59.566 INFO:tasks.workunit.client.0.smithi096.stdout:6/433: write d1/d3a/d57/f65 [846291,62295] 0 2024-04-18T21:06:59.566 INFO:tasks.workunit.client.0.smithi096.stdout:1/445: stat d0/df/d62/f83 0 2024-04-18T21:06:59.567 INFO:tasks.workunit.client.0.smithi096.stdout:2/594: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f56 [635666,18414] 0 2024-04-18T21:06:59.567 INFO:tasks.workunit.client.0.smithi096.stdout:9/428: creat d0/d8/d11/d39/d63/f83 x:0 0 0 2024-04-18T21:06:59.568 INFO:tasks.workunit.client.0.smithi096.stdout:6/434: symlink d1/d5/da/d46/d71/l85 0 2024-04-18T21:06:59.568 INFO:tasks.workunit.client.0.smithi096.stdout:0/404: write d1/f6a [1373683,61655] 0 2024-04-18T21:06:59.568 INFO:tasks.workunit.client.0.smithi096.stdout:3/426: fsync d4/d6/d1b/f38 0 2024-04-18T21:06:59.569 INFO:tasks.workunit.client.0.smithi096.stdout:2/595: mknod d11/d13/d1a/d1e/cc7 0 2024-04-18T21:06:59.569 INFO:tasks.workunit.client.0.smithi096.stdout:9/429: creat d0/dc/d5f/d76/f84 x:0 0 0 2024-04-18T21:06:59.570 INFO:tasks.workunit.client.0.smithi096.stdout:3/427: fsync d4/d6/d1b/f38 0 2024-04-18T21:06:59.570 INFO:tasks.workunit.client.0.smithi096.stdout:6/435: symlink d1/d5/da/d46/d71/d7c/l86 0 2024-04-18T21:06:59.570 INFO:tasks.workunit.client.0.smithi096.stdout:9/430: write d0/f34 [60698,85698] 0 2024-04-18T21:06:59.571 INFO:tasks.workunit.client.0.smithi096.stdout:8/451: dwrite d0/d3/db/f6a [0,4194304] 0 2024-04-18T21:06:59.572 INFO:tasks.workunit.client.0.smithi096.stdout:6/436: chown d1/d5/da/d46 2 1 2024-04-18T21:06:59.572 INFO:tasks.workunit.client.0.smithi096.stdout:0/405: write d1/d23/d32/d43/f46 [545973,95733] 0 2024-04-18T21:06:59.574 INFO:tasks.workunit.client.0.smithi096.stdout:8/452: truncate d0/d64/f42 282958 0 2024-04-18T21:06:59.574 INFO:tasks.workunit.client.0.smithi096.stdout:9/431: mknod d0/dc/d18/c85 0 2024-04-18T21:06:59.576 INFO:tasks.workunit.client.0.smithi096.stdout:8/453: stat d0/d3/d14/d56/d2f 0 2024-04-18T21:06:59.578 INFO:tasks.workunit.client.0.smithi096.stdout:2/596: dwrite d11/d13/d1d/d5d/f8d [0,4194304] 0 2024-04-18T21:06:59.578 INFO:tasks.workunit.client.0.smithi096.stdout:1/446: dwrite d0/df/d16/f19 [4194304,4194304] 0 2024-04-18T21:06:59.578 INFO:tasks.workunit.client.0.smithi096.stdout:3/428: dwrite d4/d8/f74 [0,4194304] 0 2024-04-18T21:06:59.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/432: truncate d0/dc/d18/f6e 2591386 0 2024-04-18T21:06:59.579 INFO:tasks.workunit.client.0.smithi096.stdout:8/454: creat d0/f94 x:0 0 0 2024-04-18T21:06:59.579 INFO:tasks.workunit.client.0.smithi096.stdout:9/433: creat d0/dc/f86 x:0 0 0 2024-04-18T21:06:59.579 INFO:tasks.workunit.client.0.smithi096.stdout:1/447: mknod d0/df/d62/d69/d6a/c91 0 2024-04-18T21:06:59.580 INFO:tasks.workunit.client.0.smithi096.stdout:8/455: mknod d0/d3/d14/d56/d4d/d86/c95 0 2024-04-18T21:06:59.581 INFO:tasks.workunit.client.0.smithi096.stdout:9/434: mknod d0/d8/d9/d40/c87 0 2024-04-18T21:06:59.581 INFO:tasks.workunit.client.0.smithi096.stdout:2/597: rmdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d94 39 2024-04-18T21:06:59.581 INFO:tasks.workunit.client.0.smithi096.stdout:9/435: fdatasync d0/dc/d18/f29 0 2024-04-18T21:06:59.581 INFO:tasks.workunit.client.0.smithi096.stdout:7/398: write d0/d11/f17 [1532789,110468] 0 2024-04-18T21:06:59.582 INFO:tasks.workunit.client.0.smithi096.stdout:1/448: rename d0/d27/d33/f58 to d0/d27/d5f/d60/f92 0 2024-04-18T21:06:59.583 INFO:tasks.workunit.client.0.smithi096.stdout:9/436: fdatasync d0/dc/d5f/d76/f84 0 2024-04-18T21:06:59.583 INFO:tasks.workunit.client.0.smithi096.stdout:2/598: symlink d11/d13/d1a/d1e/d28/d4e/d89/d8b/lc8 0 2024-04-18T21:06:59.583 INFO:tasks.workunit.client.0.smithi096.stdout:7/399: chown d0/d11/f72 382342 1 2024-04-18T21:06:59.583 INFO:tasks.workunit.client.0.smithi096.stdout:2/599: dread - d11/d13/d1d/fa7 zero size 2024-04-18T21:06:59.584 INFO:tasks.workunit.client.0.smithi096.stdout:7/400: dread - d0/d7/f48 zero size 2024-04-18T21:06:59.584 INFO:tasks.workunit.client.0.smithi096.stdout:5/418: dread d2/f7 [0,4194304] 0 2024-04-18T21:06:59.585 INFO:tasks.workunit.client.0.smithi096.stdout:5/419: readlink d2/d11/d28/l37 0 2024-04-18T21:06:59.585 INFO:tasks.workunit.client.0.smithi096.stdout:8/456: dread d0/d3/d14/d33/f3b [0,4194304] 0 2024-04-18T21:06:59.585 INFO:tasks.workunit.client.0.smithi096.stdout:9/437: write d0/dc/d5f/f61 [1111298,59966] 0 2024-04-18T21:06:59.585 INFO:tasks.workunit.client.0.smithi096.stdout:7/401: symlink d0/d20/l73 0 2024-04-18T21:06:59.586 INFO:tasks.workunit.client.0.smithi096.stdout:6/437: truncate d1/d5/da/d44/d4e/d52/f54 957566 0 2024-04-18T21:06:59.586 INFO:tasks.workunit.client.0.smithi096.stdout:2/600: rmdir d11/d50/d8e/dc2 0 2024-04-18T21:06:59.586 INFO:tasks.workunit.client.0.smithi096.stdout:6/438: rmdir d1/d5/da/d46/d71 39 2024-04-18T21:06:59.587 INFO:tasks.workunit.client.0.smithi096.stdout:8/457: sync 2024-04-18T21:06:59.587 INFO:tasks.workunit.client.0.smithi096.stdout:9/438: link d0/d8/d11/d48/f67 d0/dc/f88 0 2024-04-18T21:06:59.587 INFO:tasks.workunit.client.0.smithi096.stdout:7/402: write d0/d20/d39/f4c [3773660,107002] 0 2024-04-18T21:06:59.588 INFO:tasks.workunit.client.0.smithi096.stdout:2/601: chown d11/d13/d1a/d1e/d28/d4e/l58 37851 1 2024-04-18T21:06:59.589 INFO:tasks.workunit.client.0.smithi096.stdout:6/439: creat d1/d5/f87 x:0 0 0 2024-04-18T21:06:59.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/403: write d0/fc [2976834,117486] 0 2024-04-18T21:06:59.589 INFO:tasks.workunit.client.0.smithi096.stdout:3/429: write d4/d6/d1b/d1d/f2b [1647844,130119] 0 2024-04-18T21:06:59.590 INFO:tasks.workunit.client.0.smithi096.stdout:9/439: readlink d0/d8/d9/d40/d43/l59 0 2024-04-18T21:06:59.590 INFO:tasks.workunit.client.0.smithi096.stdout:2/602: dread - d11/d13/d1a/d1e/f96 zero size 2024-04-18T21:06:59.590 INFO:tasks.workunit.client.0.smithi096.stdout:1/449: dwrite d0/d27/d5f/f51 [0,4194304] 0 2024-04-18T21:06:59.590 INFO:tasks.workunit.client.0.smithi096.stdout:8/458: dread d0/d3/d14/d33/f59 [0,4194304] 0 2024-04-18T21:06:59.591 INFO:tasks.workunit.client.0.smithi096.stdout:9/440: fsync d0/d8/d11/f38 0 2024-04-18T21:06:59.591 INFO:tasks.workunit.client.0.smithi096.stdout:3/430: read - d4/d6/d1b/d1d/f68 zero size 2024-04-18T21:06:59.591 INFO:tasks.workunit.client.0.smithi096.stdout:2/603: readlink d11/d13/d1a/d1e/d28/d4e/l5a 0 2024-04-18T21:06:59.593 INFO:tasks.workunit.client.0.smithi096.stdout:8/459: symlink d0/d3/d1d/d66/d68/d7f/l96 0 2024-04-18T21:06:59.594 INFO:tasks.workunit.client.0.smithi096.stdout:8/460: sync 2024-04-18T21:06:59.595 INFO:tasks.workunit.client.0.smithi096.stdout:2/604: write d11/d13/d1a/d1e/d28/d4e/d5c/fa1 [1797554,71399] 0 2024-04-18T21:06:59.595 INFO:tasks.workunit.client.0.smithi096.stdout:5/420: dwrite d2/d11/d28/d64/f6c [0,4194304] 0 2024-04-18T21:06:59.595 INFO:tasks.workunit.client.0.smithi096.stdout:1/450: getdents d0/df/d16 0 2024-04-18T21:06:59.596 INFO:tasks.workunit.client.0.smithi096.stdout:8/461: rename d0/d3/d14/d1b/c7c to d0/d3/d1d/d66/d68/c97 0 2024-04-18T21:06:59.596 INFO:tasks.workunit.client.0.smithi096.stdout:9/441: write d0/d8/d11/d48/f4a [3260554,62077] 0 2024-04-18T21:06:59.598 INFO:tasks.workunit.client.0.smithi096.stdout:8/462: write d0/d64/f6d [571515,105051] 0 2024-04-18T21:06:59.598 INFO:tasks.workunit.client.0.smithi096.stdout:2/605: creat d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5/fc9 x:0 0 0 2024-04-18T21:06:59.598 INFO:tasks.workunit.client.0.smithi096.stdout:9/442: mkdir d0/d8/d89 0 2024-04-18T21:06:59.599 INFO:tasks.workunit.client.0.smithi096.stdout:9/443: stat d0/d8/d11/f19 0 2024-04-18T21:06:59.600 INFO:tasks.workunit.client.0.smithi096.stdout:2/606: chown d11/d13/d1a/d1e/d9f 80522 1 2024-04-18T21:06:59.600 INFO:tasks.workunit.client.0.smithi096.stdout:2/607: chown d11/d13/d1a/d1e/l23 6 1 2024-04-18T21:06:59.600 INFO:tasks.workunit.client.0.smithi096.stdout:7/404: dwrite d0/d20/f46 [0,4194304] 0 2024-04-18T21:06:59.601 INFO:tasks.workunit.client.0.smithi096.stdout:9/444: creat d0/d28/d7a/f8a x:0 0 0 2024-04-18T21:06:59.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/405: creat d0/d7/d42/f74 x:0 0 0 2024-04-18T21:06:59.603 INFO:tasks.workunit.client.0.smithi096.stdout:7/406: symlink d0/d11/d18/l75 0 2024-04-18T21:06:59.603 INFO:tasks.workunit.client.0.smithi096.stdout:9/445: rmdir d0/d28/d7a 39 2024-04-18T21:06:59.604 INFO:tasks.workunit.client.0.smithi096.stdout:3/431: dread d4/d6/d22/d20/d46/f56 [0,4194304] 0 2024-04-18T21:06:59.605 INFO:tasks.workunit.client.0.smithi096.stdout:9/446: mknod d0/d8/d11/d39/c8b 0 2024-04-18T21:06:59.606 INFO:tasks.workunit.client.0.smithi096.stdout:3/432: mknod d4/d6/d1b/d1d/c7e 0 2024-04-18T21:06:59.607 INFO:tasks.workunit.client.0.smithi096.stdout:9/447: dread - d0/dc/d5f/d76/f70 zero size 2024-04-18T21:06:59.607 INFO:tasks.workunit.client.0.smithi096.stdout:8/463: dwrite d0/d3/f93 [0,4194304] 0 2024-04-18T21:06:59.608 INFO:tasks.workunit.client.0.smithi096.stdout:3/433: mkdir d4/d8/d7f 0 2024-04-18T21:06:59.608 INFO:tasks.workunit.client.0.smithi096.stdout:8/464: write d0/f8e [529224,124513] 0 2024-04-18T21:06:59.608 INFO:tasks.workunit.client.0.smithi096.stdout:6/440: dread d1/d3a/d57/d26/fb [0,4194304] 0 2024-04-18T21:06:59.610 INFO:tasks.workunit.client.0.smithi096.stdout:9/448: creat d0/d8/d11/d39/d63/f8c x:0 0 0 2024-04-18T21:06:59.610 INFO:tasks.workunit.client.0.smithi096.stdout:2/608: dwrite d11/d13/d1a/d1e/d28/d4e/d5c/fa1 [0,4194304] 0 2024-04-18T21:06:59.610 INFO:tasks.workunit.client.0.smithi096.stdout:9/449: dread - d0/dc/d5f/d76/f70 zero size 2024-04-18T21:06:59.611 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:59.611+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:59.612 INFO:tasks.workunit.client.0.smithi096.stdout:7/407: dwrite d0/d20/d39/f4c [0,4194304] 0 2024-04-18T21:06:59.612 INFO:tasks.workunit.client.0.smithi096.stdout:8/465: link d0/d3/f5 d0/d3/db/d6f/f98 0 2024-04-18T21:06:59.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/609: link d11/f39 d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/fca 0 2024-04-18T21:06:59.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/408: dread - d0/d11/f72 zero size 2024-04-18T21:06:59.613 INFO:tasks.workunit.client.0.smithi096.stdout:6/441: getdents d1/d5/da/d46/d71/d7c 0 2024-04-18T21:06:59.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/409: write d0/d7/d49/f57 [3274468,120122] 0 2024-04-18T21:06:59.614 INFO:tasks.workunit.client.0.smithi096.stdout:8/466: symlink d0/d3/d14/d56/d2f/l99 0 2024-04-18T21:06:59.616 INFO:tasks.workunit.client.0.smithi096.stdout:8/467: chown d0 1578689 1 2024-04-18T21:06:59.616 INFO:tasks.workunit.client.0.smithi096.stdout:6/442: symlink d1/d3a/d57/l88 0 2024-04-18T21:06:59.616 INFO:tasks.workunit.client.0.smithi096.stdout:7/410: rename d0/d7/d2f/d63 to d0/d7/d2f/d63/d76 22 2024-04-18T21:06:59.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/468: mknod d0/d3/d1d/c9a 0 2024-04-18T21:06:59.617 INFO:tasks.workunit.client.0.smithi096.stdout:7/411: dread - d0/d20/d39/f64 zero size 2024-04-18T21:06:59.617 INFO:tasks.workunit.client.0.smithi096.stdout:7/412: dread - d0/d7/d42/f74 zero size 2024-04-18T21:06:59.617 INFO:tasks.workunit.client.0.smithi096.stdout:6/443: dread - d1/d5/f69 zero size 2024-04-18T21:06:59.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/469: stat d0/d3/d1d/d66/d68/f7e 0 2024-04-18T21:06:59.618 INFO:tasks.workunit.client.0.smithi096.stdout:9/450: dwrite d0/dc/d5f/d76/f70 [0,4194304] 0 2024-04-18T21:06:59.619 INFO:tasks.workunit.client.0.smithi096.stdout:7/413: symlink d0/d7/d2f/l77 0 2024-04-18T21:06:59.619 INFO:tasks.workunit.client.0.smithi096.stdout:9/451: chown d0/d8/ca 52124 1 2024-04-18T21:06:59.620 INFO:tasks.workunit.client.0.smithi096.stdout:7/414: write d0/d7/d8/f6a [15562,81678] 0 2024-04-18T21:06:59.620 INFO:tasks.workunit.client.0.smithi096.stdout:7/415: stat d0 0 2024-04-18T21:06:59.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/416: write d0/d7/d8/f6a [1349988,103340] 0 2024-04-18T21:06:59.623 INFO:tasks.workunit.client.0.smithi096.stdout:7/417: symlink d0/d7/d2f/d63/l78 0 2024-04-18T21:06:59.623 INFO:tasks.workunit.client.0.smithi096.stdout:7/418: creat d0/d11/d18/d2e/f79 x:0 0 0 2024-04-18T21:06:59.623 INFO:tasks.workunit.client.0.smithi096.stdout:6/444: dwrite d1/d5/da/d44/d4e/f59 [0,4194304] 0 2024-04-18T21:06:59.625 INFO:tasks.workunit.client.0.smithi096.stdout:6/445: mknod d1/d3a/d57/d26/c89 0 2024-04-18T21:06:59.625 INFO:tasks.workunit.client.0.smithi096.stdout:7/419: unlink d0/d7/ff 0 2024-04-18T21:06:59.625 INFO:tasks.workunit.client.0.smithi096.stdout:6/446: dread - d1/d17/f5c zero size 2024-04-18T21:06:59.626 INFO:tasks.workunit.client.0.smithi096.stdout:6/447: chown d1/d3a/d57/l88 20618 1 2024-04-18T21:06:59.626 INFO:tasks.workunit.client.0.smithi096.stdout:6/448: fsync d1/f34 0 2024-04-18T21:06:59.627 INFO:tasks.workunit.client.0.smithi096.stdout:6/449: creat d1/d3a/d57/f8a x:0 0 0 2024-04-18T21:06:59.627 INFO:tasks.workunit.client.0.smithi096.stdout:6/450: chown d1/d5/da/fc 113348 1 2024-04-18T21:06:59.627 INFO:tasks.workunit.client.0.smithi096.stdout:7/420: link d0/d7/d2f/d53/l65 d0/d20/l7a 0 2024-04-18T21:06:59.628 INFO:tasks.workunit.client.0.smithi096.stdout:7/421: truncate d0/fc 5029228 0 2024-04-18T21:06:59.628 INFO:tasks.workunit.client.0.smithi096.stdout:6/451: mkdir d1/d5/da/d46/d71/d7c/d8b 0 2024-04-18T21:06:59.628 INFO:tasks.workunit.client.0.smithi096.stdout:6/452: dread - d1/f41 zero size 2024-04-18T21:06:59.629 INFO:tasks.workunit.client.0.smithi096.stdout:7/422: unlink d0/d7/d2f/l38 0 2024-04-18T21:06:59.630 INFO:tasks.workunit.client.0.smithi096.stdout:7/423: rename d0/d7/d49/f57 to d0/d7/d49/f7b 0 2024-04-18T21:06:59.630 INFO:tasks.workunit.client.0.smithi096.stdout:7/424: mknod d0/d7/d8/c7c 0 2024-04-18T21:06:59.632 INFO:tasks.workunit.client.0.smithi096.stdout:7/425: mkdir d0/d20/d62/d7d 0 2024-04-18T21:06:59.633 INFO:tasks.workunit.client.0.smithi096.stdout:7/426: mknod d0/d7/d2f/d53/c7e 0 2024-04-18T21:06:59.633 INFO:tasks.workunit.client.0.smithi096.stdout:5/421: dread d2/f16 [0,4194304] 0 2024-04-18T21:06:59.635 INFO:tasks.workunit.client.0.smithi096.stdout:5/422: truncate d2/d11/f52 1474791 0 2024-04-18T21:06:59.635 INFO:tasks.workunit.client.0.smithi096.stdout:6/453: dwrite d1/d17/f18 [4194304,4194304] 0 2024-04-18T21:06:59.640 INFO:tasks.workunit.client.0.smithi096.stdout:6/454: dread d1/d17/f18 [4194304,4194304] 0 2024-04-18T21:06:59.642 INFO:tasks.workunit.client.0.smithi096.stdout:5/423: dwrite d2/d38/d4c/f85 [0,4194304] 0 2024-04-18T21:06:59.642 INFO:tasks.workunit.client.0.smithi096.stdout:1/451: dread d0/d27/f38 [0,4194304] 0 2024-04-18T21:06:59.643 INFO:tasks.workunit.client.0.smithi096.stdout:6/455: getdents d1/d3a/d36 0 2024-04-18T21:06:59.643 INFO:tasks.workunit.client.0.smithi096.stdout:1/452: getdents d0/df/d62 0 2024-04-18T21:06:59.644 INFO:tasks.workunit.client.0.smithi096.stdout:1/453: creat d0/df/d62/d69/f93 x:0 0 0 2024-04-18T21:06:59.644 INFO:tasks.workunit.client.0.smithi096.stdout:6/456: creat d1/d5/da/d44/d4e/f8c x:0 0 0 2024-04-18T21:06:59.645 INFO:tasks.workunit.client.0.smithi096.stdout:1/454: write d0/df/f64 [808791,5851] 0 2024-04-18T21:06:59.645 INFO:tasks.workunit.client.0.smithi096.stdout:1/455: write d0/f17 [3914432,54965] 0 2024-04-18T21:06:59.647 INFO:tasks.workunit.client.0.smithi096.stdout:1/456: unlink d0/df/d16/l18 0 2024-04-18T21:06:59.648 INFO:tasks.workunit.client.0.smithi096.stdout:5/424: dwrite d2/d18/f5c [0,4194304] 0 2024-04-18T21:06:59.650 INFO:tasks.workunit.client.0.smithi096.stdout:5/425: truncate d2/d38/d4c/f6b 621204 0 2024-04-18T21:06:59.650 INFO:tasks.workunit.client.0.smithi096.stdout:6/457: dwrite d1/d3a/d36/f6f [4194304,4194304] 0 2024-04-18T21:06:59.651 INFO:tasks.workunit.client.0.smithi096.stdout:5/426: dread - d2/f44 zero size 2024-04-18T21:06:59.652 INFO:tasks.workunit.client.0.smithi096.stdout:6/458: write d1/d5/da/d46/d71/f84 [866068,130910] 0 2024-04-18T21:06:59.653 INFO:tasks.workunit.client.0.smithi096.stdout:9/452: dread d0/d8/d9/d40/f78 [0,4194304] 0 2024-04-18T21:06:59.653 INFO:tasks.workunit.client.0.smithi096.stdout:7/427: truncate d0/d11/f29 3307492 0 2024-04-18T21:06:59.653 INFO:tasks.workunit.client.0.smithi096.stdout:4/400: dread d2/d2f/f36 [0,4194304] 0 2024-04-18T21:06:59.653 INFO:tasks.workunit.client.0.smithi096.stdout:7/428: chown d0/d20/f46 278 1 2024-04-18T21:06:59.654 INFO:tasks.workunit.client.0.smithi096.stdout:6/459: rename d1/d5/l22 to d1/d3a/d57/l8d 0 2024-04-18T21:06:59.655 INFO:tasks.workunit.client.0.smithi096.stdout:7/429: chown d0/d20/l7a 0 1 2024-04-18T21:06:59.655 INFO:tasks.workunit.client.0.smithi096.stdout:4/401: getdents d2/d1d 0 2024-04-18T21:06:59.655 INFO:tasks.workunit.client.0.smithi096.stdout:7/430: chown d0/d7/d8/f55 1279 1 2024-04-18T21:06:59.656 INFO:tasks.workunit.client.0.smithi096.stdout:9/453: rename d0/l15 to d0/d8/d9/d40/d43/d4b/l8d 0 2024-04-18T21:06:59.656 INFO:tasks.workunit.client.0.smithi096.stdout:4/402: getdents d2 0 2024-04-18T21:06:59.657 INFO:tasks.workunit.client.0.smithi096.stdout:9/454: creat d0/d8/d9/d40/d43/f8e x:0 0 0 2024-04-18T21:06:59.657 INFO:tasks.workunit.client.0.smithi096.stdout:4/403: readlink d2/d2f/d33/l53 0 2024-04-18T21:06:59.657 INFO:tasks.workunit.client.0.smithi096.stdout:9/455: chown d0/dc/f88 39155913 1 2024-04-18T21:06:59.658 INFO:tasks.workunit.client.0.smithi096.stdout:4/404: getdents d2/d2f/d33/d55/d59 0 2024-04-18T21:06:59.658 INFO:tasks.workunit.client.0.smithi096.stdout:9/456: rename d0/d28/c5d to d0/d8/d11/d1f/c8f 0 2024-04-18T21:06:59.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/405: fdatasync d2/d2a/d54/d71/f82 0 2024-04-18T21:06:59.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/406: creat d2/d1d/f87 x:0 0 0 2024-04-18T21:06:59.660 INFO:tasks.workunit.client.0.smithi096.stdout:4/407: mkdir d2/d2f/d33/d55/d57/d88 0 2024-04-18T21:06:59.665 INFO:tasks.workunit.client.0.smithi096.stdout:9/457: truncate d0/dc/f25 1427926 0 2024-04-18T21:06:59.665 INFO:tasks.workunit.client.0.smithi096.stdout:9/458: creat d0/d8/d11/f90 x:0 0 0 2024-04-18T21:06:59.669 INFO:tasks.workunit.client.0.smithi096.stdout:2/610: dread d11/d13/d1a/d1e/d28/d4e/d80/fb9 [0,4194304] 0 2024-04-18T21:06:59.671 INFO:tasks.workunit.client.0.smithi096.stdout:2/611: write d11/d13/d1a/d1e/d28/d4e/f53 [848659,76393] 0 2024-04-18T21:06:59.672 INFO:tasks.workunit.client.0.smithi096.stdout:9/459: dwrite d0/d8/f3b [0,4194304] 0 2024-04-18T21:06:59.672 INFO:tasks.workunit.client.0.smithi096.stdout:8/470: dread d0/d3/f18 [0,4194304] 0 2024-04-18T21:06:59.672 INFO:tasks.workunit.client.0.smithi096.stdout:2/612: chown d11/d13/d1a/d1e/d28/d4e/d63/f9b 3948878 1 2024-04-18T21:06:59.672 INFO:tasks.workunit.client.0.smithi096.stdout:9/460: chown d0/d8/d11/d48/f67 63 1 2024-04-18T21:06:59.673 INFO:tasks.workunit.client.0.smithi096.stdout:2/613: mkdir d11/d50/d5b/dcb 0 2024-04-18T21:06:59.673 INFO:tasks.workunit.client.0.smithi096.stdout:8/471: mkdir d0/d3/d14/d56/d9b 0 2024-04-18T21:06:59.673 INFO:tasks.workunit.client.0.smithi096.stdout:9/461: readlink d0/dc/d18/l4f 0 2024-04-18T21:06:59.674 INFO:tasks.workunit.client.0.smithi096.stdout:2/614: mknod d11/d13/ccc 0 2024-04-18T21:06:59.674 INFO:tasks.workunit.client.0.smithi096.stdout:2/615: write d11/f16 [1824099,110626] 0 2024-04-18T21:06:59.675 INFO:tasks.workunit.client.0.smithi096.stdout:8/472: symlink d0/d3/d1d/d2c/d46/l9c 0 2024-04-18T21:06:59.675 INFO:tasks.workunit.client.0.smithi096.stdout:9/462: rename d0/dc/l2a to d0/d8/d11/d1f/l91 0 2024-04-18T21:06:59.675 INFO:tasks.workunit.client.0.smithi096.stdout:2/616: mknod d11/d13/d1a/d1e/d28/d4e/d5c/ccd 0 2024-04-18T21:06:59.675 INFO:tasks.workunit.client.0.smithi096.stdout:8/473: rmdir d0/d3/d14/d56/d4d 39 2024-04-18T21:06:59.678 INFO:tasks.workunit.client.0.smithi096.stdout:8/474: dread d0/d3/d14/d33/f6b [0,4194304] 0 2024-04-18T21:06:59.679 INFO:tasks.workunit.client.0.smithi096.stdout:6/460: dread d1/d5/da/f21 [0,4194304] 0 2024-04-18T21:06:59.680 INFO:tasks.workunit.client.0.smithi096.stdout:0/406: dread d1/db/d30/d31/f3b [0,4194304] 0 2024-04-18T21:06:59.680 INFO:tasks.workunit.client.0.smithi096.stdout:5/427: dread d2/fd [0,4194304] 0 2024-04-18T21:06:59.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/475: mkdir d0/d3/d14/d56/d4d/d9d 0 2024-04-18T21:06:59.681 INFO:tasks.workunit.client.0.smithi096.stdout:0/407: mkdir d1/d23/d32/d43/d6f/d89 0 2024-04-18T21:06:59.682 INFO:tasks.workunit.client.0.smithi096.stdout:5/428: write d2/d6a/f86 [886891,9390] 0 2024-04-18T21:06:59.682 INFO:tasks.workunit.client.0.smithi096.stdout:6/461: link d1/f41 d1/d3a/d36/f8e 0 2024-04-18T21:06:59.684 INFO:tasks.workunit.client.0.smithi096.stdout:2/617: dwrite f2 [0,4194304] 0 2024-04-18T21:06:59.684 INFO:tasks.workunit.client.0.smithi096.stdout:3/434: dread d4/d6/d1b/d2c/f43 [0,4194304] 0 2024-04-18T21:06:59.684 INFO:tasks.workunit.client.0.smithi096.stdout:0/408: chown d1/db/d30/d31/d39/d5d/f84 426443 1 2024-04-18T21:06:59.684 INFO:tasks.workunit.client.0.smithi096.stdout:9/463: dwrite d0/f7c [0,4194304] 0 2024-04-18T21:06:59.684 INFO:tasks.workunit.client.0.smithi096.stdout:9/464: fdatasync d0/f34 0 2024-04-18T21:06:59.686 INFO:tasks.workunit.client.0.smithi096.stdout:5/429: dread d2/d6a/f70 [0,4194304] 0 2024-04-18T21:06:59.687 INFO:tasks.workunit.client.0.smithi096.stdout:6/462: creat d1/d5/da/d46/d71/d7c/f8f x:0 0 0 2024-04-18T21:06:59.687 INFO:tasks.workunit.client.0.smithi096.stdout:0/409: fdatasync d1/db/d30/d31/d85/f1d 0 2024-04-18T21:06:59.688 INFO:tasks.workunit.client.0.smithi096.stdout:2/618: mkdir d11/d13/d1a/d1e/d28/d4e/d63/dce 0 2024-04-18T21:06:59.688 INFO:tasks.workunit.client.0.smithi096.stdout:3/435: creat d4/d6/d1b/d2c/d5c/f80 x:0 0 0 2024-04-18T21:06:59.690 INFO:tasks.workunit.client.0.smithi096.stdout:6/463: mkdir d1/d5/da/d90 0 2024-04-18T21:06:59.690 INFO:tasks.workunit.client.0.smithi096.stdout:5/430: dread d2/d11/f71 [0,4194304] 0 2024-04-18T21:06:59.690 INFO:tasks.workunit.client.0.smithi096.stdout:9/465: dread d0/dc/d5f/f61 [0,4194304] 0 2024-04-18T21:06:59.690 INFO:tasks.workunit.client.0.smithi096.stdout:3/436: chown d4/d8/c39 104065 1 2024-04-18T21:06:59.690 INFO:tasks.workunit.client.0.smithi096.stdout:0/410: chown d1/db/d30/d31/f47 52 1 2024-04-18T21:06:59.690 INFO:tasks.workunit.client.0.smithi096.stdout:2/619: symlink d11/d13/d1d/d5d/d97/lcf 0 2024-04-18T21:06:59.691 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:59.691 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:59.691 INFO:tasks.workunit.client.0.smithi096.stdout:8/476: dwrite d0/d3/d1d/f24 [0,4194304] 0 2024-04-18T21:06:59.692 INFO:tasks.workunit.client.0.smithi096.stdout:6/464: truncate d1/d17/f5c 703384 0 2024-04-18T21:06:59.692 INFO:tasks.workunit.client.0.smithi096.stdout:0/411: dread - d1/db/d30/f81 zero size 2024-04-18T21:06:59.692 INFO:tasks.workunit.client.0.smithi096.stdout:9/466: write d0/dc/f32 [2147297,116296] 0 2024-04-18T21:06:59.692 INFO:tasks.workunit.client.0.smithi096.stdout:5/431: chown d2/d18/d61/d6f/d88/d96 14 1 2024-04-18T21:06:59.692 INFO:tasks.workunit.client.0.smithi096.stdout:6/465: read - d1/f41 zero size 2024-04-18T21:06:59.693 INFO:tasks.workunit.client.0.smithi096.stdout:9/467: write d0/d8/d11/d39/d63/f83 [984099,91463] 0 2024-04-18T21:06:59.693 INFO:tasks.workunit.client.0.smithi096.stdout:5/432: creat d2/d11/d28/d4a/d55/d81/f9c x:0 0 0 2024-04-18T21:06:59.693 INFO:tasks.workunit.client.0.smithi096.stdout:9/468: chown d0/dc/d18/f29 0 1 2024-04-18T21:06:59.694 INFO:tasks.workunit.client.0.smithi096.stdout:8/477: getdents d0/d3/d1d/d66 0 2024-04-18T21:06:59.694 INFO:tasks.workunit.client.0.smithi096.stdout:6/466: mkdir d1/d61/d91 0 2024-04-18T21:06:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:5/433: chown d2/d11/d28/d4a/f59 922433986 1 2024-04-18T21:06:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/469: fsync d0/dc/f25 0 2024-04-18T21:06:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:2/620: link d11/d13/d1a/d1e/cbb d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/cd0 0 2024-04-18T21:06:59.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:59.696 INFO:tasks.workunit.client.0.smithi096.stdout:5/434: unlink d2/d18/c42 0 2024-04-18T21:06:59.697 INFO:tasks.workunit.client.0.smithi096.stdout:2/621: mknod d11/d50/d5b/dcb/cd1 0 2024-04-18T21:06:59.699 INFO:tasks.workunit.client.0.smithi096.stdout:9/470: rename d0/d28/d2f/f42 to d0/d8/d9/f92 0 2024-04-18T21:06:59.699 INFO:tasks.workunit.client.0.smithi096.stdout:5/435: mkdir d2/d18/d9d 0 2024-04-18T21:06:59.699 INFO:tasks.workunit.client.0.smithi096.stdout:0/412: dwrite d1/db/d30/f81 [0,4194304] 0 2024-04-18T21:06:59.700 INFO:tasks.workunit.client.0.smithi096.stdout:5/436: write d2/d11/f2d [4992906,39858] 0 2024-04-18T21:06:59.700 INFO:tasks.workunit.client.0.smithi096.stdout:9/471: write d0/d8/d11/f38 [2633807,14511] 0 2024-04-18T21:06:59.701 INFO:tasks.workunit.client.0.smithi096.stdout:9/472: stat d0/dc/d18/c1b 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi096.stdout:5/437: fsync d2/fd 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi096.stdout:1/457: sync 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi096.stdout:6/467: dwrite d1/d5/f2c [0,4194304] 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi096.stdout:3/437: dread d4/d8/f9 [0,4194304] 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi096.stdout:1/458: write d0/d27/f7f [5075404,72797] 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi096.stdout:5/438: mknod d2/d18/d61/d6f/c9e 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi096.stdout:1/459: stat d0/df/f5b 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi096.stdout:0/413: dwrite d1/f62 [0,4194304] 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi096.stdout:8/478: truncate d0/d3/db/f13 285158 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi096.stdout:5/439: truncate d2/d18/d61/d6f/d7a/f8d 496393 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi096.stdout:1/460: write d0/d27/f52 [3134480,90622] 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi096.stdout:0/414: fdatasync d1/db/d30/d31/f3b 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi096.stdout:0/415: fdatasync d1/d23/d32/f76 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi096.stdout:1/461: chown d0/df/d30/c4c 32 1 2024-04-18T21:06:59.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:59.712 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:59.710+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi096.stdout:1/462: rmdir d0/df/d30/d81 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi096.stdout:8/479: rename d0/d3/d1d/d66/d68/c97 to d0/d3/d14/d56/d4d/c9e 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi096.stdout:4/408: dread d2/f31 [0,4194304] 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi096.stdout:1/463: creat d0/df/d30/f94 x:0 0 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi096.stdout:8/480: mkdir d0/d3/d3a/d9f 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi096.stdout:4/409: stat d2/d2f/d33/d55/d59/d5f 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/468: dwrite d1/d3a/d57/d26/f29 [0,4194304] 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/464: fsync d0/f17 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi096.stdout:4/410: getdents d2/d2a/d54/d6d/d78 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/481: rename d0/d3/d14/d56/f5e to d0/d3/d1d/d66/d68/fa0 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi096.stdout:1/465: mkdir d0/df/d62/d69/d6a/d8d/d95 0 2024-04-18T21:06:59.719 INFO:tasks.workunit.client.0.smithi096.stdout:6/469: rename d1/d5/da/d46/c6d to d1/d5/da/d46/d71/c92 0 2024-04-18T21:06:59.719 INFO:tasks.workunit.client.0.smithi096.stdout:8/482: fdatasync d0/d3/d14/d1b/f20 0 2024-04-18T21:06:59.719 INFO:tasks.workunit.client.0.smithi096.stdout:4/411: truncate d2/d2a/d54/d71/f80 761093 0 2024-04-18T21:06:59.720 INFO:tasks.workunit.client.0.smithi096.stdout:5/440: dread d2/d11/f52 [0,4194304] 0 2024-04-18T21:06:59.721 INFO:tasks.workunit.client.0.smithi096.stdout:5/441: write d2/d38/f4b [1263199,111430] 0 2024-04-18T21:06:59.721 INFO:tasks.workunit.client.0.smithi096.stdout:6/470: creat d1/d5/da/d44/f93 x:0 0 0 2024-04-18T21:06:59.721 INFO:tasks.workunit.client.0.smithi096.stdout:3/438: dread d4/d8/fa [0,4194304] 0 2024-04-18T21:06:59.721 INFO:tasks.workunit.client.0.smithi096.stdout:4/412: mkdir d2/d2a/d54/d5b/d89 0 2024-04-18T21:06:59.722 INFO:tasks.workunit.client.0.smithi096.stdout:1/466: link d0/d27/d5f/d60/f92 d0/df/d62/d69/d65/f96 0 2024-04-18T21:06:59.722 INFO:tasks.workunit.client.0.smithi096.stdout:6/471: mkdir d1/d5/da/d90/d94 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi096.stdout:6/472: fsync d1/f1c 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi096.stdout:6/473: stat d1/d3a/d57/l88 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi096.stdout:9/473: dread d0/d28/d2f/f64 [0,4194304] 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi096.stdout:3/439: link d4/d6/c54 d4/d6/d1b/d2c/d5c/c81 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/467: creat d0/df/d62/d69/d6a/d8d/d95/f97 x:0 0 0 2024-04-18T21:06:59.726 INFO:tasks.workunit.client.0.smithi096.stdout:3/440: chown d4/d6/d1b/f3a 1 1 2024-04-18T21:06:59.726 INFO:tasks.workunit.client.0.smithi096.stdout:1/468: symlink d0/df/d16/d6c/l98 0 2024-04-18T21:06:59.728 INFO:tasks.workunit.client.0.smithi096.stdout:8/483: dwrite d0/d3/d14/d33/f6b [0,4194304] 0 2024-04-18T21:06:59.728 INFO:tasks.workunit.client.0.smithi096.stdout:1/469: rename d0/df/d62/d69/d65/f96 to d0/d27/d5f/d60/f99 0 2024-04-18T21:06:59.730 INFO:tasks.workunit.client.0.smithi096.stdout:8/484: mknod d0/d3/d14/d56/d9b/ca1 0 2024-04-18T21:06:59.731 INFO:tasks.workunit.client.0.smithi096.stdout:5/442: dread d2/f27 [0,4194304] 0 2024-04-18T21:06:59.732 INFO:tasks.workunit.client.0.smithi096.stdout:8/485: mknod d0/d3/d1d/d66/ca2 0 2024-04-18T21:06:59.732 INFO:tasks.workunit.client.0.smithi096.stdout:9/474: dwrite d0/dc/f36 [0,4194304] 0 2024-04-18T21:06:59.733 INFO:tasks.workunit.client.0.smithi096.stdout:5/443: rename d2/d11/f29 to d2/d38/d4c/f9f 0 2024-04-18T21:06:59.733 INFO:tasks.workunit.client.0.smithi096.stdout:8/486: creat d0/d3/d1d/d83/fa3 x:0 0 0 2024-04-18T21:06:59.734 INFO:tasks.workunit.client.0.smithi096.stdout:9/475: rename d0/d28/d2f/f64 to d0/dc/d5f/f93 0 2024-04-18T21:06:59.735 INFO:tasks.workunit.client.0.smithi096.stdout:1/470: dread d0/df/d30/f4e [0,4194304] 0 2024-04-18T21:06:59.735 INFO:tasks.workunit.client.0.smithi096.stdout:8/487: symlink d0/d3/d14/d56/d4d/d9d/la4 0 2024-04-18T21:06:59.735 INFO:tasks.workunit.client.0.smithi096.stdout:9/476: creat d0/dc/d5f/f94 x:0 0 0 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi096.stdout:1/471: creat d0/df/d16/d6c/f9a x:0 0 0 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi096.stdout:9/477: chown d0/d8/d11/d48/l77 26 1 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi096.stdout:8/488: symlink d0/d3/d14/d56/d4d/d86/la5 0 2024-04-18T21:06:59.737 INFO:tasks.workunit.client.0.smithi096.stdout:9/478: chown d0/d8/l3f 20438354 1 2024-04-18T21:06:59.738 INFO:tasks.workunit.client.0.smithi096.stdout:8/489: mknod d0/d3/d1d/d66/d68/d7f/ca6 0 2024-04-18T21:06:59.738 INFO:tasks.workunit.client.0.smithi096.stdout:9/479: write d0/d8/d11/f19 [2367880,90532] 0 2024-04-18T21:06:59.740 INFO:tasks.workunit.client.0.smithi096.stdout:4/413: truncate d2/d2f/d33/f35 865206 0 2024-04-18T21:06:59.740 INFO:tasks.workunit.client.0.smithi096.stdout:5/444: dwrite d2/d11/d28/f78 [0,4194304] 0 2024-04-18T21:06:59.740 INFO:tasks.workunit.client.0.smithi096.stdout:9/480: link d0/d28/f81 d0/d8/d11/f95 0 2024-04-18T21:06:59.741 INFO:tasks.workunit.client.0.smithi096.stdout:5/445: write d2/f79 [975381,53742] 0 2024-04-18T21:06:59.741 INFO:tasks.workunit.client.0.smithi096.stdout:4/414: unlink d2/d1d/l3e 0 2024-04-18T21:06:59.743 INFO:tasks.workunit.client.0.smithi096.stdout:9/481: rename d0/d8/d9/d40/f4e to d0/d8/d11/d1f/f96 0 2024-04-18T21:06:59.744 INFO:tasks.workunit.client.0.smithi096.stdout:9/482: readlink d0/d8/d11/d48/l77 0 2024-04-18T21:06:59.745 INFO:tasks.workunit.client.0.smithi096.stdout:9/483: getdents d0/d28/d3d 0 2024-04-18T21:06:59.745 INFO:tasks.workunit.client.0.smithi096.stdout:1/472: dwrite d0/d27/f7c [0,4194304] 0 2024-04-18T21:06:59.747 INFO:tasks.workunit.client.0.smithi096.stdout:1/473: write d0/df/d16/d24/f31 [381777,109080] 0 2024-04-18T21:06:59.747 INFO:tasks.workunit.client.0.smithi096.stdout:1/474: chown d0/f49 98844591 1 2024-04-18T21:06:59.748 INFO:tasks.workunit.client.0.smithi096.stdout:1/475: write d0/df/d16/d24/f31 [1170569,116550] 0 2024-04-18T21:06:59.748 INFO:tasks.workunit.client.0.smithi096.stdout:1/476: write d0/f44 [325727,27098] 0 2024-04-18T21:06:59.749 INFO:tasks.workunit.client.0.smithi096.stdout:1/477: rmdir d0/df/d62/d69/d6a/d8d 39 2024-04-18T21:06:59.752 INFO:tasks.workunit.client.0.smithi096.stdout:5/446: dread d2/d38/d4c/f6b [0,4194304] 0 2024-04-18T21:06:59.753 INFO:tasks.workunit.client.0.smithi096.stdout:1/478: dread d0/d27/f38 [0,4194304] 0 2024-04-18T21:06:59.753 INFO:tasks.workunit.client.0.smithi096.stdout:5/447: mkdir d2/d18/d9d/da0 0 2024-04-18T21:06:59.754 INFO:tasks.workunit.client.0.smithi096.stdout:4/415: truncate d2/d1d/f15 3972484 0 2024-04-18T21:06:59.754 INFO:tasks.workunit.client.0.smithi096.stdout:1/479: mkdir d0/df/d62/d69/d6a/d8d/d9b 0 2024-04-18T21:06:59.755 INFO:tasks.workunit.client.0.smithi096.stdout:5/448: mknod d2/d18/d61/d6f/d88/ca1 0 2024-04-18T21:06:59.755 INFO:tasks.workunit.client.0.smithi096.stdout:1/480: mkdir d0/df/d16/d24/d9c 0 2024-04-18T21:06:59.756 INFO:tasks.workunit.client.0.smithi096.stdout:5/449: readlink d2/l48 0 2024-04-18T21:06:59.756 INFO:tasks.workunit.client.0.smithi096.stdout:4/416: link d2/f38 d2/d2f/d33/f8a 0 2024-04-18T21:06:59.757 INFO:tasks.workunit.client.0.smithi096.stdout:5/450: write d2/d11/d28/d4a/d55/d81/f9c [411431,17622] 0 2024-04-18T21:06:59.758 INFO:tasks.workunit.client.0.smithi096.stdout:5/451: chown d2/d11/l19 98738249 1 2024-04-18T21:06:59.758 INFO:tasks.workunit.client.0.smithi096.stdout:5/452: mknod d2/d8f/ca2 0 2024-04-18T21:06:59.760 INFO:tasks.workunit.client.0.smithi096.stdout:5/453: creat d2/d18/d61/d6f/d88/d96/fa3 x:0 0 0 2024-04-18T21:06:59.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/484: write d0/d28/d2f/f17 [616881,101412] 0 2024-04-18T21:06:59.762 INFO:tasks.workunit.client.0.smithi096.stdout:5/454: mkdir d2/d18/d61/d6f/d88/d96/da4 0 2024-04-18T21:06:59.763 INFO:tasks.workunit.client.0.smithi096.stdout:1/481: dwrite d0/df/f1a [0,4194304] 0 2024-04-18T21:06:59.763 INFO:tasks.workunit.client.0.smithi096.stdout:4/417: dwrite d2/d2f/d33/f8a [4194304,4194304] 0 2024-04-18T21:06:59.763 INFO:tasks.workunit.client.0.smithi096.stdout:1/482: readlink d0/l1f 0 2024-04-18T21:06:59.764 INFO:tasks.workunit.client.0.smithi096.stdout:4/418: write d2/f50 [1702354,93766] 0 2024-04-18T21:06:59.765 INFO:tasks.workunit.client.0.smithi096.stdout:1/483: mkdir d0/df/d16/d6c/d9d 0 2024-04-18T21:06:59.766 INFO:tasks.workunit.client.0.smithi096.stdout:1/484: unlink d0/df/d62/d69/d65/l78 0 2024-04-18T21:06:59.766 INFO:tasks.workunit.client.0.smithi096.stdout:1/485: symlink d0/df/l9e 0 2024-04-18T21:06:59.768 INFO:tasks.workunit.client.0.smithi096.stdout:9/485: dread d0/d8/f3b [0,4194304] 0 2024-04-18T21:06:59.768 INFO:tasks.workunit.client.0.smithi096.stdout:8/490: dread d0/d3/d14/f2a [0,4194304] 0 2024-04-18T21:06:59.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/486: mknod d0/df/d16/d24/d9c/c9f 0 2024-04-18T21:06:59.769 INFO:tasks.workunit.client.0.smithi096.stdout:9/486: chown d0/d8/d9/d40/d43/d4b/f69 1602684592 1 2024-04-18T21:06:59.770 INFO:tasks.workunit.client.0.smithi096.stdout:9/487: creat d0/dc/d5f/f97 x:0 0 0 2024-04-18T21:06:59.771 INFO:tasks.workunit.client.0.smithi096.stdout:1/487: truncate d0/df/f2e 351662 0 2024-04-18T21:06:59.771 INFO:tasks.workunit.client.0.smithi096.stdout:9/488: write d0/d28/d7a/f8a [201215,123397] 0 2024-04-18T21:06:59.772 INFO:tasks.workunit.client.0.smithi096.stdout:1/488: creat d0/df/d62/d69/fa0 x:0 0 0 2024-04-18T21:06:59.772 INFO:tasks.workunit.client.0.smithi096.stdout:9/489: mknod d0/d28/d66/c98 0 2024-04-18T21:06:59.772 INFO:tasks.workunit.client.0.smithi096.stdout:1/489: write d0/d27/f73 [2959771,84487] 0 2024-04-18T21:06:59.773 INFO:tasks.workunit.client.0.smithi096.stdout:8/491: dread d0/d3/d1d/f24 [0,4194304] 0 2024-04-18T21:06:59.773 INFO:tasks.workunit.client.0.smithi096.stdout:9/490: symlink d0/d28/l99 0 2024-04-18T21:06:59.774 INFO:tasks.workunit.client.0.smithi096.stdout:6/474: dread d1/d17/f18 [0,4194304] 0 2024-04-18T21:06:59.775 INFO:tasks.workunit.client.0.smithi096.stdout:9/491: write d0/dc/d5f/f68 [395610,112639] 0 2024-04-18T21:06:59.775 INFO:tasks.workunit.client.0.smithi096.stdout:8/492: dread d0/d3/d14/d33/f59 [0,4194304] 0 2024-04-18T21:06:59.775 INFO:tasks.workunit.client.0.smithi096.stdout:9/492: getdents d0/d8/d89 0 2024-04-18T21:06:59.775 INFO:tasks.workunit.client.0.smithi096.stdout:8/493: chown d0/d3/d14/d56/f7a 1916892 1 2024-04-18T21:06:59.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/475: write d1/d5/da/d44/d4e/f59 [4638660,53651] 0 2024-04-18T21:06:59.776 INFO:tasks.workunit.client.0.smithi096.stdout:9/493: dread - d0/d8/d11/f95 zero size 2024-04-18T21:06:59.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/476: dread - d1/d5/f5d zero size 2024-04-18T21:06:59.776 INFO:tasks.workunit.client.0.smithi096.stdout:9/494: read - d0/d28/d3d/f62 zero size 2024-04-18T21:06:59.778 INFO:tasks.workunit.client.0.smithi096.stdout:9/495: truncate d0/d8/d11/d48/f67 306760 0 2024-04-18T21:06:59.778 INFO:tasks.workunit.client.0.smithi096.stdout:6/477: creat d1/d5/da/d44/d4e/f95 x:0 0 0 2024-04-18T21:06:59.778 INFO:tasks.workunit.client.0.smithi096.stdout:9/496: symlink d0/d28/d3d/l9a 0 2024-04-18T21:06:59.779 INFO:tasks.workunit.client.0.smithi096.stdout:6/478: mknod d1/d5/da/d44/d4e/c96 0 2024-04-18T21:06:59.780 INFO:tasks.workunit.client.0.smithi096.stdout:8/494: dread d0/d3/d14/d33/f3b [0,4194304] 0 2024-04-18T21:06:59.780 INFO:tasks.workunit.client.0.smithi096.stdout:4/419: truncate d2/f2e 594568 0 2024-04-18T21:06:59.780 INFO:tasks.workunit.client.0.smithi096.stdout:6/479: chown d1/d17/l1f 114428 1 2024-04-18T21:06:59.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/497: link d0/f7c d0/d28/d7a/f9b 0 2024-04-18T21:06:59.781 INFO:tasks.workunit.client.0.smithi096.stdout:0/416: dread d1/db/d30/d31/d39/f52 [0,4194304] 0 2024-04-18T21:06:59.781 INFO:tasks.workunit.client.0.smithi096.stdout:8/495: fdatasync d0/d3/db/f36 0 2024-04-18T21:06:59.782 INFO:tasks.workunit.client.0.smithi096.stdout:6/480: mkdir d1/d5/da/d44/d97 0 2024-04-18T21:06:59.782 INFO:tasks.workunit.client.0.smithi096.stdout:9/498: getdents d0 0 2024-04-18T21:06:59.783 INFO:tasks.workunit.client.0.smithi096.stdout:4/420: getdents d2/d2f/d33/d55/d59 0 2024-04-18T21:06:59.783 INFO:tasks.workunit.client.0.smithi096.stdout:0/417: rename d1/d23/d32/d43/d6f/d89 to d1/d23/d32/d43/d6f/d8a 0 2024-04-18T21:06:59.783 INFO:tasks.workunit.client.0.smithi096.stdout:9/499: chown d0/dc/c4d 3710 1 2024-04-18T21:06:59.784 INFO:tasks.workunit.client.0.smithi096.stdout:0/418: stat d1/db/l18 0 2024-04-18T21:06:59.784 INFO:tasks.workunit.client.0.smithi096.stdout:1/490: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:59.785 INFO:tasks.workunit.client.0.smithi096.stdout:1/491: fsync d0/df/f5b 0 2024-04-18T21:06:59.785 INFO:tasks.workunit.client.0.smithi096.stdout:0/419: creat d1/d23/d32/d43/d6f/f8b x:0 0 0 2024-04-18T21:06:59.786 INFO:tasks.workunit.client.0.smithi096.stdout:1/492: fdatasync d0/df/d16/d24/f2b 0 2024-04-18T21:06:59.788 INFO:tasks.workunit.client.0.smithi096.stdout:1/493: mknod d0/df/d62/d69/d6a/d8d/ca1 0 2024-04-18T21:06:59.788 INFO:tasks.workunit.client.0.smithi096.stdout:8/496: dwrite d0/d3/db/f6a [0,4194304] 0 2024-04-18T21:06:59.788 INFO:tasks.workunit.client.0.smithi096.stdout:6/481: dwrite d1/f1c [8388608,4194304] 0 2024-04-18T21:06:59.790 INFO:tasks.workunit.client.0.smithi096.stdout:8/497: dread d0/d3/d14/d33/f59 [0,4194304] 0 2024-04-18T21:06:59.792 INFO:tasks.workunit.client.0.smithi096.stdout:1/494: rmdir d0/df/d16/d24 39 2024-04-18T21:06:59.792 INFO:tasks.workunit.client.0.smithi096.stdout:8/498: unlink d0/d3/d14/l39 0 2024-04-18T21:06:59.792 INFO:tasks.workunit.client.0.smithi096.stdout:6/482: mknod d1/d5/c98 0 2024-04-18T21:06:59.793 INFO:tasks.workunit.client.0.smithi096.stdout:1/495: write d0/d27/f3c [166141,129912] 0 2024-04-18T21:06:59.793 INFO:tasks.workunit.client.0.smithi096.stdout:8/499: creat d0/d3/d14/d56/d4d/d5a/fa7 x:0 0 0 2024-04-18T21:06:59.794 INFO:tasks.workunit.client.0.smithi096.stdout:6/483: getdents d1/d3a/d57/d66 0 2024-04-18T21:06:59.794 INFO:tasks.workunit.client.0.smithi096.stdout:6/484: mknod d1/d5/c99 0 2024-04-18T21:06:59.795 INFO:tasks.workunit.client.0.smithi096.stdout:6/485: fdatasync d1/d3a/d57/d26/f3c 0 2024-04-18T21:06:59.796 INFO:tasks.workunit.client.0.smithi096.stdout:8/500: link d0/d3/d14/d56/d4d/d86/la5 d0/d3/d14/d56/la8 0 2024-04-18T21:06:59.799 INFO:tasks.workunit.client.0.smithi096.stdout:8/501: dread d0/d3/d14/d56/f7a [0,4194304] 0 2024-04-18T21:06:59.800 INFO:tasks.workunit.client.0.smithi096.stdout:0/420: dread d1/db/d30/f5c [0,4194304] 0 2024-04-18T21:06:59.801 INFO:tasks.workunit.client.0.smithi096.stdout:0/421: dread - d1/db/d30/d31/d39/d6d/f80 zero size 2024-04-18T21:06:59.801 INFO:tasks.workunit.client.0.smithi096.stdout:0/422: fsync d1/db/d30/d4a/d67/f88 0 2024-04-18T21:06:59.804 INFO:tasks.workunit.client.0.smithi096.stdout:0/423: link d1/l2a d1/db/d30/d31/d85/d58/l8c 0 2024-04-18T21:06:59.804 INFO:tasks.workunit.client.0.smithi096.stdout:0/424: readlink d1/lc 0 2024-04-18T21:06:59.806 INFO:tasks.workunit.client.0.smithi096.stdout:8/502: dwrite d0/d3/d1d/d2c/f4b [0,4194304] 0 2024-04-18T21:06:59.806 INFO:tasks.workunit.client.0.smithi096.stdout:8/503: stat d0/d3/d14/d56/d4d/d9d 0 2024-04-18T21:06:59.807 INFO:tasks.workunit.client.0.smithi096.stdout:8/504: readlink d0/d3/d3a/d81/l79 0 2024-04-18T21:06:59.808 INFO:tasks.workunit.client.0.smithi096.stdout:8/505: creat d0/d3/db/d6f/fa9 x:0 0 0 2024-04-18T21:06:59.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/506: chown d0/d3/d14/d56/d2f/l91 1624059 1 2024-04-18T21:06:59.811 INFO:tasks.workunit.client.0.smithi096.stdout:0/425: dwrite d1/db/d30/d31/f71 [0,4194304] 0 2024-04-18T21:06:59.811 INFO:tasks.workunit.client.0.smithi096.stdout:8/507: truncate d0/d3/d14/d1b/f87 929553 0 2024-04-18T21:06:59.811 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:06:59.811+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:06:59.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/508: link d0/d3/d1d/d66/ca2 d0/d3/d1d/d2c/caa 0 2024-04-18T21:06:59.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/509: chown d0/d3/d1d/d66/d68 111 1 2024-04-18T21:06:59.817 INFO:tasks.workunit.client.0.smithi096.stdout:2/622: sync 2024-04-18T21:06:59.817 INFO:tasks.workunit.client.0.smithi096.stdout:7/431: sync 2024-04-18T21:06:59.817 INFO:tasks.workunit.client.0.smithi096.stdout:8/510: rename d0/d3/d1d/d2c to d0/d3/d3a/dab 0 2024-04-18T21:06:59.818 INFO:tasks.workunit.client.0.smithi096.stdout:2/623: write d11/d13/d1d/d5d/f8d [1685421,109972] 0 2024-04-18T21:06:59.819 INFO:tasks.workunit.client.0.smithi096.stdout:8/511: rename d0/d3/d14 to d0/d3/d1d/d66/d68/d7f/dac 0 2024-04-18T21:06:59.820 INFO:tasks.workunit.client.0.smithi096.stdout:2/624: rmdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82 39 2024-04-18T21:06:59.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/512: rename d0/d3/c28 to d0/d3/d3a/cad 0 2024-04-18T21:06:59.821 INFO:tasks.workunit.client.0.smithi096.stdout:8/513: readlink d0/l26 0 2024-04-18T21:06:59.821 INFO:tasks.workunit.client.0.smithi096.stdout:2/625: write d11/d50/f83 [1479859,123342] 0 2024-04-18T21:06:59.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/626: mkdir d11/d13/d1a/d1e/d28/d4e/d80/dd2 0 2024-04-18T21:06:59.823 INFO:tasks.workunit.client.0.smithi096.stdout:2/627: write d11/d50/f71 [1044285,10206] 0 2024-04-18T21:06:59.823 INFO:tasks.workunit.client.0.smithi096.stdout:8/514: symlink d0/d3/d1d/d66/d68/d7f/dac/d56/d9b/lae 0 2024-04-18T21:06:59.823 INFO:tasks.workunit.client.0.smithi096.stdout:2/628: write d11/d13/f2d [4521340,128841] 0 2024-04-18T21:06:59.824 INFO:tasks.workunit.client.0.smithi096.stdout:6/486: dread d1/f14 [0,4194304] 0 2024-04-18T21:06:59.824 INFO:tasks.workunit.client.0.smithi096.stdout:1/496: dread d0/d27/f73 [4194304,4194304] 0 2024-04-18T21:06:59.824 INFO:tasks.workunit.client.0.smithi096.stdout:8/515: truncate d0/d3/db/f36 4983636 0 2024-04-18T21:06:59.824 INFO:tasks.workunit.client.0.smithi096.stdout:2/629: stat d11/d13/d1a/c29 0 2024-04-18T21:06:59.826 INFO:tasks.workunit.client.0.smithi096.stdout:2/630: mknod d11/d13/d1a/d1e/d28/d4e/d80/dd2/cd3 0 2024-04-18T21:06:59.827 INFO:tasks.workunit.client.0.smithi096.stdout:1/497: read d0/df/d16/d24/f31 [98404,85712] 0 2024-04-18T21:06:59.828 INFO:tasks.workunit.client.0.smithi096.stdout:2/631: mknod d11/d13/d1a/d1e/d28/cd4 0 2024-04-18T21:06:59.828 INFO:tasks.workunit.client.0.smithi096.stdout:7/432: dread d0/d20/f2d [0,4194304] 0 2024-04-18T21:06:59.829 INFO:tasks.workunit.client.0.smithi096.stdout:1/498: chown d0/df/d62/d69/d6a/c91 6358 1 2024-04-18T21:06:59.829 INFO:tasks.workunit.client.0.smithi096.stdout:0/426: dread d1/db/d30/d31/d39/f40 [0,4194304] 0 2024-04-18T21:06:59.830 INFO:tasks.workunit.client.0.smithi096.stdout:2/632: read d11/d13/f15 [1192356,124009] 0 2024-04-18T21:06:59.830 INFO:tasks.workunit.client.0.smithi096.stdout:1/499: chown d0/df/f64 327778 1 2024-04-18T21:06:59.830 INFO:tasks.workunit.client.0.smithi096.stdout:0/427: write d1/f2d [8863867,21780] 0 2024-04-18T21:06:59.830 INFO:tasks.workunit.client.0.smithi096.stdout:6/487: truncate d1/d5/f1a 1353817 0 2024-04-18T21:06:59.831 INFO:tasks.workunit.client.0.smithi096.stdout:2/633: chown fe 19721476 1 2024-04-18T21:06:59.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/516: dwrite d0/d3/db/f6a [0,4194304] 0 2024-04-18T21:06:59.831 INFO:tasks.workunit.client.0.smithi096.stdout:6/488: fdatasync d1/d3a/d57/d26/f3c 0 2024-04-18T21:06:59.832 INFO:tasks.workunit.client.0.smithi096.stdout:0/428: chown d1/db/d30/d31/d85/l34 56499544 1 2024-04-18T21:06:59.832 INFO:tasks.workunit.client.0.smithi096.stdout:8/517: read - d0/d3/d1d/d66/d68/d7f/dac/f8f zero size 2024-04-18T21:06:59.833 INFO:tasks.workunit.client.0.smithi096.stdout:8/518: dread - d0/d3/d1d/d83/fa3 zero size 2024-04-18T21:06:59.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/634: unlink d11/d13/d1a/d1e/d28/d4e/d40/f60 0 2024-04-18T21:06:59.834 INFO:tasks.workunit.client.0.smithi096.stdout:6/489: creat d1/d61/d91/f9a x:0 0 0 2024-04-18T21:06:59.835 INFO:tasks.workunit.client.0.smithi096.stdout:8/519: fdatasync d0/d3/f23 0 2024-04-18T21:06:59.835 INFO:tasks.workunit.client.0.smithi096.stdout:2/635: write d11/d50/f77 [44831,93430] 0 2024-04-18T21:06:59.835 INFO:tasks.workunit.client.0.smithi096.stdout:6/490: write d1/d3a/d36/f6f [5043125,127101] 0 2024-04-18T21:06:59.838 INFO:tasks.workunit.client.0.smithi096.stdout:6/491: mkdir d1/d3a/d57/d66/d9b 0 2024-04-18T21:06:59.838 INFO:tasks.workunit.client.0.smithi096.stdout:8/520: creat d0/d3/faf x:0 0 0 2024-04-18T21:06:59.839 INFO:tasks.workunit.client.0.smithi096.stdout:0/429: link d1/db/d30/d31/d39/d5d/d60/f3c d1/d23/d32/d7d/f8d 0 2024-04-18T21:06:59.843 INFO:tasks.workunit.client.0.smithi096.stdout:7/433: dread d0/d11/f43 [0,4194304] 0 2024-04-18T21:06:59.843 INFO:tasks.workunit.client.0.smithi096.stdout:0/430: rename d1/db/d30/d31/d85/f1d to d1/f8e 0 2024-04-18T21:06:59.846 INFO:tasks.workunit.client.0.smithi096.stdout:2/636: dwrite d11/f16 [0,4194304] 0 2024-04-18T21:06:59.847 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-18T21:06:59.849 INFO:tasks.workunit.client.0.smithi096.stdout:8/521: dwrite d0/d3/d1d/d66/d68/d7f/dac/f8f [0,4194304] 0 2024-04-18T21:06:59.849 INFO:tasks.workunit.client.0.smithi096.stdout:0/431: mknod d1/d23/d32/d43/d6f/c8f 0 2024-04-18T21:06:59.849 INFO:tasks.workunit.client.0.smithi096.stdout:8/522: chown d0/d3/lf 4169139 1 2024-04-18T21:06:59.850 INFO:tasks.workunit.client.0.smithi096.stdout:7/434: getdents d0/d11/d18/d2e 0 2024-04-18T21:06:59.850 INFO:tasks.workunit.client.0.smithi096.stdout:0/432: symlink d1/db/d30/d31/d85/l90 0 2024-04-18T21:06:59.851 INFO:tasks.workunit.client.0.smithi096.stdout:7/435: stat d0/d7/c2a 0 2024-04-18T21:06:59.851 INFO:tasks.workunit.client.0.smithi096.stdout:6/492: dwrite d1/d3a/d57/f9 [4194304,4194304] 0 2024-04-18T21:06:59.851 INFO:tasks.workunit.client.0.smithi096.stdout:8/523: rename d0/d5d/l90 to d0/d64/lb0 0 2024-04-18T21:06:59.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/433: fsync d1/db/d30/d31/d39/d5d/d60/f1f 0 2024-04-18T21:06:59.854 INFO:tasks.workunit.client.0.smithi096.stdout:8/524: unlink d0/d3/d1d/d66/d68/d7f/dac/d33/f69 0 2024-04-18T21:06:59.854 INFO:tasks.workunit.client.0.smithi096.stdout:0/434: mkdir d1/d23/d32/d43/d6f/d8a/d91 0 2024-04-18T21:06:59.855 INFO:tasks.workunit.client.0.smithi096.stdout:0/435: fdatasync d1/f2d 0 2024-04-18T21:06:59.855 INFO:tasks.workunit.client.0.smithi096.stdout:8/525: symlink d0/d3/d1d/d66/lb1 0 2024-04-18T21:06:59.857 INFO:tasks.workunit.client.0.smithi096.stdout:8/526: chown d0/d3/f18 164463090 1 2024-04-18T21:06:59.857 INFO:tasks.workunit.client.0.smithi096.stdout:1/500: dread d0/d27/d5f/d60/f99 [0,4194304] 0 2024-04-18T21:06:59.858 INFO:tasks.workunit.client.0.smithi096.stdout:2/637: read d11/f7e [1085122,1464] 0 2024-04-18T21:06:59.859 INFO:tasks.workunit.client.0.smithi096.stdout:1/501: write d0/f70 [2245695,117588] 0 2024-04-18T21:06:59.861 INFO:tasks.workunit.client.0.smithi096.stdout:6/493: dwrite d1/d5/da/d46/d71/d7c/f8f [0,4194304] 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi096.stdout:6/494: write d1/d5/ff [4570434,23202] 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi096.stdout:0/436: dwrite d1/db/d30/f6c [0,4194304] 0 2024-04-18T21:06:59.864 INFO:tasks.workunit.client.0.smithi096.stdout:1/502: mkdir d0/df/d30/d53/da2 0 2024-04-18T21:06:59.864 INFO:tasks.workunit.client.0.smithi096.stdout:6/495: mknod d1/d17/c9c 0 2024-04-18T21:06:59.866 INFO:tasks.workunit.client.0.smithi096.stdout:2/638: rmdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/d9a 0 2024-04-18T21:06:59.866 INFO:tasks.workunit.client.0.smithi096.stdout:8/527: creat d0/d3/fb2 x:0 0 0 2024-04-18T21:06:59.866 INFO:tasks.workunit.client.0.smithi096.stdout:2/639: fsync d11/d13/d1a/d1e/d28/d4e/fb4 0 2024-04-18T21:06:59.867 INFO:tasks.workunit.client.0.smithi096.stdout:0/437: creat d1/db/f92 x:0 0 0 2024-04-18T21:06:59.867 INFO:tasks.workunit.client.0.smithi096.stdout:1/503: stat d0/df/d16/d24/c2c 0 2024-04-18T21:06:59.868 INFO:tasks.workunit.client.0.smithi096.stdout:0/438: unlink d1/db/d30/d4a/f4d 0 2024-04-18T21:06:59.869 INFO:tasks.workunit.client.0.smithi096.stdout:0/439: creat d1/db/d79/d7e/f93 x:0 0 0 2024-04-18T21:06:59.870 INFO:tasks.workunit.client.0.smithi096.stdout:0/440: chown d1/db/d30/d4a/d67/f6b 1558 1 2024-04-18T21:06:59.872 INFO:tasks.workunit.client.0.smithi096.stdout:9/500: sync 2024-04-18T21:06:59.872 INFO:tasks.workunit.client.0.smithi096.stdout:5/455: sync 2024-04-18T21:06:59.872 INFO:tasks.workunit.client.0.smithi096.stdout:4/421: sync 2024-04-18T21:06:59.872 INFO:tasks.workunit.client.0.smithi096.stdout:3/441: sync 2024-04-18T21:06:59.874 INFO:tasks.workunit.client.0.smithi096.stdout:5/456: truncate d2/d18/d61/d6f/f91 274861 0 2024-04-18T21:06:59.875 INFO:tasks.workunit.client.0.smithi096.stdout:4/422: rename d2/d2f/d33/l53 to d2/d1d/l8b 0 2024-04-18T21:06:59.876 INFO:tasks.workunit.client.0.smithi096.stdout:7/436: dread d0/d7/d8/f1e [0,4194304] 0 2024-04-18T21:06:59.876 INFO:tasks.workunit.client.0.smithi096.stdout:2/640: dwrite d11/d50/f71 [0,4194304] 0 2024-04-18T21:06:59.876 INFO:tasks.workunit.client.0.smithi096.stdout:8/528: getdents d0/d3/d1d/d66/d68/d7f/dac 0 2024-04-18T21:06:59.876 INFO:tasks.workunit.client.0.smithi096.stdout:5/457: mknod d2/d8f/ca5 0 2024-04-18T21:06:59.877 INFO:tasks.workunit.client.0.smithi096.stdout:1/504: dread - d0/df/d62/f83 zero size 2024-04-18T21:06:59.878 INFO:tasks.workunit.client.0.smithi096.stdout:7/437: write d0/fc [5662949,17176] 0 2024-04-18T21:06:59.878 INFO:tasks.workunit.client.0.smithi096.stdout:4/423: write d2/d2f/d33/f3b [2804776,102643] 0 2024-04-18T21:06:59.878 INFO:tasks.workunit.client.0.smithi096.stdout:8/529: write d0/d3/d3a/dab/f4b [3267789,2510] 0 2024-04-18T21:06:59.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/442: rename d4/d6/l17 to d4/d6/d7/l82 0 2024-04-18T21:06:59.879 INFO:tasks.workunit.client.0.smithi096.stdout:4/424: rmdir d2/d2f/d33 39 2024-04-18T21:06:59.880 INFO:tasks.workunit.client.0.smithi096.stdout:7/438: mkdir d0/d20/d4b/d7f 0 2024-04-18T21:06:59.880 INFO:tasks.workunit.client.0.smithi096.stdout:5/458: write d2/d18/d61/d6d/f77 [88377,106714] 0 2024-04-18T21:06:59.880 INFO:tasks.workunit.client.0.smithi096.stdout:2/641: unlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f92 0 2024-04-18T21:06:59.881 INFO:tasks.workunit.client.0.smithi096.stdout:0/441: dwrite d1/f6a [0,4194304] 0 2024-04-18T21:06:59.881 INFO:tasks.workunit.client.0.smithi096.stdout:4/425: fdatasync d2/f4c 0 2024-04-18T21:06:59.883 INFO:tasks.workunit.client.0.smithi096.stdout:2/642: chown d11/d13/d1a/d1e/d28/ca4 21950759 1 2024-04-18T21:06:59.884 INFO:tasks.workunit.client.0.smithi096.stdout:8/530: mkdir d0/d3/d1d/d66/d68/d7f/dac/d1b/db3 0 2024-04-18T21:06:59.884 INFO:tasks.workunit.client.0.smithi096.stdout:0/442: fdatasync d1/db/d30/d31/d85/f16 0 2024-04-18T21:06:59.884 INFO:tasks.workunit.client.0.smithi096.stdout:9/501: dwrite d0/dc/d5f/f94 [0,4194304] 0 2024-04-18T21:06:59.884 INFO:tasks.workunit.client.0.smithi096.stdout:7/439: symlink d0/d20/d62/d7d/l80 0 2024-04-18T21:06:59.884 INFO:tasks.workunit.client.0.smithi096.stdout:5/459: mknod d2/d11/d28/d4a/d69/ca6 0 2024-04-18T21:06:59.887 INFO:tasks.workunit.client.0.smithi096.stdout:5/460: fsync d2/d6a/f70 0 2024-04-18T21:06:59.887 INFO:tasks.workunit.client.0.smithi096.stdout:0/443: readlink d1/d23/l2b 0 2024-04-18T21:06:59.887 INFO:tasks.workunit.client.0.smithi096.stdout:9/502: creat d0/d28/d7a/f9c x:0 0 0 2024-04-18T21:06:59.887 INFO:tasks.workunit.client.0.smithi096.stdout:5/461: chown d2/d38/l8b 6 1 2024-04-18T21:06:59.887 INFO:tasks.workunit.client.0.smithi096.stdout:7/440: mknod d0/d20/d4b/c81 0 2024-04-18T21:06:59.888 INFO:tasks.workunit.client.0.smithi096.stdout:5/462: fsync d2/d11/f2d 0 2024-04-18T21:06:59.888 INFO:tasks.workunit.client.0.smithi096.stdout:5/463: read d2/d38/d4c/f85 [2531296,76890] 0 2024-04-18T21:06:59.888 INFO:tasks.workunit.client.0.smithi096.stdout:7/441: symlink d0/d11/d18/l82 0 2024-04-18T21:06:59.891 INFO:tasks.workunit.client.0.smithi096.stdout:4/426: dread d2/d2a/d54/d71/f76 [0,4194304] 0 2024-04-18T21:06:59.894 INFO:tasks.workunit.client.0.smithi096.stdout:1/505: truncate d0/d27/f7f 2808487 0 2024-04-18T21:06:59.895 INFO:tasks.workunit.client.0.smithi096.stdout:5/464: rmdir d2/d18/d61/d6f/d88/d96/da4 0 2024-04-18T21:06:59.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/643: dwrite d11/d50/d5b/d8a/fbc [0,4194304] 0 2024-04-18T21:06:59.897 INFO:tasks.workunit.client.0.smithi096.stdout:8/531: dwrite d0/d3/d1d/d66/d68/d7f/dac/f31 [0,4194304] 0 2024-04-18T21:06:59.897 INFO:tasks.workunit.client.0.smithi096.stdout:0/444: dwrite d1/f6a [0,4194304] 0 2024-04-18T21:06:59.897 INFO:tasks.workunit.client.0.smithi096.stdout:1/506: chown d0/df/d16/d24/f35 2540 1 2024-04-18T21:06:59.898 INFO:tasks.workunit.client.0.smithi096.stdout:5/465: mkdir d2/d11/d28/d4a/d87/da7 0 2024-04-18T21:06:59.898 INFO:tasks.workunit.client.0.smithi096.stdout:9/503: dwrite d0/d28/d3d/f62 [0,4194304] 0 2024-04-18T21:06:59.901 INFO:tasks.workunit.client.0.smithi096.stdout:2/644: dread - d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/fca zero size 2024-04-18T21:06:59.902 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:59.902 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:59.904 INFO:tasks.workunit.client.0.smithi096.stdout:4/427: link d2/d2a/d54/d71/f82 d2/d2f/d33/d55/d59/d5f/f8c 0 2024-04-18T21:06:59.906 INFO:tasks.workunit.client.0.smithi096.stdout:1/507: getdents d0/df/d62/d69/d6a/d8d 0 2024-04-18T21:06:59.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/645: link d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 d11/fd5 0 2024-04-18T21:06:59.907 INFO:tasks.workunit.client.0.smithi096.stdout:1/508: symlink d0/df/d16/la3 0 2024-04-18T21:06:59.909 INFO:tasks.workunit.client.0.smithi096.stdout:8/532: dwrite d0/d3/d1d/d66/d68/d7f/dac/d33/f92 [0,4194304] 0 2024-04-18T21:06:59.910 INFO:tasks.workunit.client.0.smithi096.stdout:0/445: dwrite d1/db/d30/f87 [0,4194304] 0 2024-04-18T21:06:59.912 INFO:tasks.workunit.client.0.smithi096.stdout:8/533: fsync d0/d3/d1d/d66/d68/d7f/dac/d33/f6b 0 2024-04-18T21:06:59.913 INFO:tasks.workunit.client.0.smithi096.stdout:0/446: unlink d1/db/d30/d31/d39/f6e 0 2024-04-18T21:06:59.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:06:59.910+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:06:59.913 INFO:tasks.workunit.client.0.smithi096.stdout:9/504: dwrite d0/dc/f25 [0,4194304] 0 2024-04-18T21:06:59.914 INFO:tasks.workunit.client.0.smithi096.stdout:9/505: chown d0/dc/d5f/f68 1247665130 1 2024-04-18T21:06:59.914 INFO:tasks.workunit.client.0.smithi096.stdout:8/534: mkdir d0/d3/d1d/d66/d68/d7f/dac/d33/db4 0 2024-04-18T21:06:59.915 INFO:tasks.workunit.client.0.smithi096.stdout:4/428: write f0 [2507102,116927] 0 2024-04-18T21:06:59.915 INFO:tasks.workunit.client.0.smithi096.stdout:0/447: rename d1/db/d30/d31/d85/f3f to d1/db/d30/d31/d65/f94 0 2024-04-18T21:06:59.917 INFO:tasks.workunit.client.0.smithi096.stdout:9/506: creat d0/d8/d11/f9d x:0 0 0 2024-04-18T21:06:59.917 INFO:tasks.workunit.client.0.smithi096.stdout:2/646: truncate d11/d13/d1a/d1e/d28/d4e/f3d 4058491 0 2024-04-18T21:06:59.918 INFO:tasks.workunit.client.0.smithi096.stdout:1/509: dwrite d0/df/d16/f55 [0,4194304] 0 2024-04-18T21:06:59.918 INFO:tasks.workunit.client.0.smithi096.stdout:0/448: truncate d1/db/d30/f5b 1268770 0 2024-04-18T21:06:59.919 INFO:tasks.workunit.client.0.smithi096.stdout:9/507: rename d0/d28/d3d/l51 to d0/d8/l9e 0 2024-04-18T21:06:59.919 INFO:tasks.workunit.client.0.smithi096.stdout:1/510: creat d0/df/d16/d6c/d9d/fa4 x:0 0 0 2024-04-18T21:06:59.919 INFO:tasks.workunit.client.0.smithi096.stdout:0/449: rename d1 to d1/db/d30/d31/d65/d95 22 2024-04-18T21:06:59.919 INFO:tasks.workunit.client.0.smithi096.stdout:2/647: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/cd6 0 2024-04-18T21:06:59.920 INFO:tasks.workunit.client.0.smithi096.stdout:5/466: dread d2/f46 [0,4194304] 0 2024-04-18T21:06:59.920 INFO:tasks.workunit.client.0.smithi096.stdout:0/450: stat d1/db/d30/d31/d39 0 2024-04-18T21:06:59.921 INFO:tasks.workunit.client.0.smithi096.stdout:2/648: symlink d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5/ld7 0 2024-04-18T21:06:59.923 INFO:tasks.workunit.client.0.smithi096.stdout:2/649: getdents d11/d13/d1a/d1e/d28/d4e/d40/d51/d57 0 2024-04-18T21:06:59.925 INFO:tasks.workunit.client.0.smithi096.stdout:2/650: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/cd8 0 2024-04-18T21:06:59.925 INFO:tasks.workunit.client.0.smithi096.stdout:5/467: dread d2/d38/d4c/f85 [0,4194304] 0 2024-04-18T21:06:59.927 INFO:tasks.workunit.client.0.smithi096.stdout:1/511: read d0/f17 [1907015,107238] 0 2024-04-18T21:06:59.927 INFO:tasks.workunit.client.0.smithi096.stdout:5/468: creat d2/d18/d9d/da0/fa8 x:0 0 0 2024-04-18T21:06:59.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:59.929 INFO:tasks.workunit.client.0.smithi096.stdout:5/469: readlink d2/d11/d28/d4a/d55/l8e 0 2024-04-18T21:06:59.929 INFO:tasks.workunit.client.0.smithi096.stdout:1/512: unlink d0/df/d30/l76 0 2024-04-18T21:06:59.930 INFO:tasks.workunit.client.0.smithi096.stdout:5/470: creat d2/d38/fa9 x:0 0 0 2024-04-18T21:06:59.931 INFO:tasks.workunit.client.0.smithi096.stdout:1/513: chown d0/df/d16/d24/f31 111 1 2024-04-18T21:06:59.932 INFO:tasks.workunit.client.0.smithi096.stdout:9/508: dwrite d0/d8/d11/f95 [0,4194304] 0 2024-04-18T21:06:59.932 INFO:tasks.workunit.client.0.smithi096.stdout:0/451: dwrite d1/d23/d32/d7d/f8d [0,4194304] 0 2024-04-18T21:06:59.933 INFO:tasks.workunit.client.0.smithi096.stdout:5/471: creat d2/d6a/faa x:0 0 0 2024-04-18T21:06:59.933 INFO:tasks.workunit.client.0.smithi096.stdout:9/509: mknod d0/d8/d9/d40/c9f 0 2024-04-18T21:06:59.934 INFO:tasks.workunit.client.0.smithi096.stdout:0/452: unlink d1/db/d30/d31/d85/fe 0 2024-04-18T21:06:59.934 INFO:tasks.workunit.client.0.smithi096.stdout:2/651: dwrite d11/d50/d8e/f99 [0,4194304] 0 2024-04-18T21:06:59.934 INFO:tasks.workunit.client.0.smithi096.stdout:5/472: chown d2/d18/d61/d6f/d7a/f8d 321215 1 2024-04-18T21:06:59.934 INFO:tasks.workunit.client.0.smithi096.stdout:9/510: write d0/d8/d11/f82 [345973,18589] 0 2024-04-18T21:06:59.935 INFO:tasks.workunit.client.0.smithi096.stdout:5/473: chown d2/f10 711179 1 2024-04-18T21:06:59.935 INFO:tasks.workunit.client.0.smithi096.stdout:4/429: read d2/fc [66503,108461] 0 2024-04-18T21:06:59.935 INFO:tasks.workunit.client.0.smithi096.stdout:2/652: dread - d11/d13/d1a/d1e/d28/d4e/f7a zero size 2024-04-18T21:06:59.936 INFO:tasks.workunit.client.0.smithi096.stdout:5/474: chown d2/d18/d9d 148248987 1 2024-04-18T21:06:59.936 INFO:tasks.workunit.client.0.smithi096.stdout:4/430: mknod d2/d2a/c8d 0 2024-04-18T21:06:59.937 INFO:tasks.workunit.client.0.smithi096.stdout:4/431: chown d2/c27 1 1 2024-04-18T21:06:59.937 INFO:tasks.workunit.client.0.smithi096.stdout:5/475: mkdir d2/d18/d9d/da0/dab 0 2024-04-18T21:06:59.938 INFO:tasks.workunit.client.0.smithi096.stdout:2/653: readlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/lc4 0 2024-04-18T21:06:59.938 INFO:tasks.workunit.client.0.smithi096.stdout:5/476: fdatasync d2/d6a/f70 0 2024-04-18T21:06:59.939 INFO:tasks.workunit.client.0.smithi096.stdout:2/654: symlink d11/d13/d1a/d1e/d28/d4e/d63/ld9 0 2024-04-18T21:06:59.942 INFO:tasks.workunit.client.0.smithi096.stdout:2/655: mknod d11/d13/d1a/cda 0 2024-04-18T21:06:59.942 INFO:tasks.workunit.client.0.smithi096.stdout:5/477: truncate d2/d18/d61/d6f/d88/d96/fa3 503526 0 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi096.stdout:1/514: write d0/df/d16/d24/f4a [2868173,60480] 0 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi096.stdout:2/656: chown d11/f7e 213797771 1 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi096.stdout:0/453: dwrite d1/db/d30/f87 [0,4194304] 0 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi096.stdout:5/478: stat d2/d18/d61/d6d 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi096.stdout:8/535: dread d0/fe [0,4194304] 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi096.stdout:4/432: truncate d2/d1d/f29 28620 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi096.stdout:1/515: rename d0/d27/f52 to d0/d27/d5f/d60/fa5 0 2024-04-18T21:06:59.946 INFO:tasks.workunit.client.0.smithi096.stdout:5/479: link d2/d11/f3d d2/d18/d9d/da0/fac 0 2024-04-18T21:06:59.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/454: mkdir d1/d23/d32/d43/d6f/d8a/d96 0 2024-04-18T21:06:59.946 INFO:tasks.workunit.client.0.smithi096.stdout:4/433: creat d2/d2a/d54/d71/f8e x:0 0 0 2024-04-18T21:06:59.946 INFO:tasks.workunit.client.0.smithi096.stdout:8/536: symlink d0/d3/d1d/d66/d68/d7f/dac/d1b/lb5 0 2024-04-18T21:06:59.946 INFO:tasks.workunit.client.0.smithi096.stdout:1/516: creat d0/df/d16/d6c/fa6 x:0 0 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi096.stdout:5/480: creat d2/d11/d28/d4a/d69/fad x:0 0 0 2024-04-18T21:06:59.948 INFO:tasks.workunit.client.0.smithi096.stdout:8/537: dread d0/d3/d1d/d66/d68/d7f/dac/d56/f7a [0,4194304] 0 2024-04-18T21:06:59.950 INFO:tasks.workunit.client.0.smithi096.stdout:5/481: creat d2/d18/d9d/da0/dab/fae x:0 0 0 2024-04-18T21:06:59.950 INFO:tasks.workunit.client.0.smithi096.stdout:8/538: unlink d0/d3/d3a/dab/d46/d78/c84 0 2024-04-18T21:06:59.951 INFO:tasks.workunit.client.0.smithi096.stdout:5/482: symlink d2/d11/d28/d4a/d87/da7/laf 0 2024-04-18T21:06:59.951 INFO:tasks.workunit.client.0.smithi096.stdout:0/455: dread d1/db/d30/d31/f71 [0,4194304] 0 2024-04-18T21:06:59.952 INFO:tasks.workunit.client.0.smithi096.stdout:1/517: dread d0/d27/d5f/d60/f99 [0,4194304] 0 2024-04-18T21:06:59.952 INFO:tasks.workunit.client.0.smithi096.stdout:2/657: dwrite d11/d13/d1a/f26 [0,4194304] 0 2024-04-18T21:06:59.952 INFO:tasks.workunit.client.0.smithi096.stdout:5/483: write d2/d11/d28/d64/f6c [2064690,47516] 0 2024-04-18T21:06:59.954 INFO:tasks.workunit.client.0.smithi096.stdout:8/539: symlink d0/d3/d1d/d66/d68/d7f/dac/d33/db4/lb6 0 2024-04-18T21:06:59.954 INFO:tasks.workunit.client.0.smithi096.stdout:1/518: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:59.954 INFO:tasks.workunit.client.0.smithi096.stdout:0/456: mknod d1/db/d79/c97 0 2024-04-18T21:06:59.954 INFO:tasks.workunit.client.0.smithi096.stdout:5/484: mknod d2/d11/d28/d4a/d55/d81/cb0 0 2024-04-18T21:06:59.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/658: rename d11/d13/d1a/d1e/d28/d4e/d89/d8b/lc8 to d11/d50/d5b/d8a/ldb 0 2024-04-18T21:06:59.955 INFO:tasks.workunit.client.0.smithi096.stdout:9/511: dread d0/f5 [8388608,4194304] 0 2024-04-18T21:06:59.956 INFO:tasks.workunit.client.0.smithi096.stdout:4/434: write d2/d2f/d33/d55/d59/d5f/f8c [5022356,8576] 0 2024-04-18T21:06:59.957 INFO:tasks.workunit.client.0.smithi096.stdout:5/485: link d2/f79 d2/d18/d61/d6f/d7a/fb1 0 2024-04-18T21:06:59.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/512: link d0/d8/d11/d1f/f96 d0/fa0 0 2024-04-18T21:06:59.958 INFO:tasks.workunit.client.0.smithi096.stdout:4/435: write d2/d2f/d33/d55/f6f [453702,116958] 0 2024-04-18T21:06:59.958 INFO:tasks.workunit.client.0.smithi096.stdout:0/457: getdents d1/db/d30/d4a 0 2024-04-18T21:06:59.958 INFO:tasks.workunit.client.0.smithi096.stdout:4/436: fdatasync d2/f18 0 2024-04-18T21:06:59.958 INFO:tasks.workunit.client.0.smithi096.stdout:2/659: link d11/d13/d1a/f1c d11/d13/d1a/d1e/d28/d4e/d63/dce/fdc 0 2024-04-18T21:06:59.958 INFO:tasks.workunit.client.0.smithi096.stdout:5/486: symlink d2/d11/d28/d4a/d55/d81/lb2 0 2024-04-18T21:06:59.959 INFO:tasks.workunit.client.0.smithi096.stdout:5/487: unlink d2/d38/d4c/f6b 0 2024-04-18T21:06:59.959 INFO:tasks.workunit.client.0.smithi096.stdout:2/660: chown d11/d13/d1a/l85 385155 1 2024-04-18T21:06:59.959 INFO:tasks.workunit.client.0.smithi096.stdout:9/513: rename d0/dc/d18 to d0/d28/da1 0 2024-04-18T21:06:59.960 INFO:tasks.workunit.client.0.smithi096.stdout:5/488: symlink d2/d38/lb3 0 2024-04-18T21:06:59.960 INFO:tasks.workunit.client.0.smithi096.stdout:4/437: link d2/d2f/d39/c6a d2/d2f/d33/d55/d57/c8f 0 2024-04-18T21:06:59.960 INFO:tasks.workunit.client.0.smithi096.stdout:0/458: rename d1/d23/d32/d43/f50 to d1/d23/d32/d43/d6f/d8a/d96/f98 0 2024-04-18T21:06:59.961 INFO:tasks.workunit.client.0.smithi096.stdout:8/540: truncate d0/d3/d1d/d66/d68/fa0 657021 0 2024-04-18T21:06:59.961 INFO:tasks.workunit.client.0.smithi096.stdout:5/489: mknod d2/d18/d61/cb4 0 2024-04-18T21:06:59.961 INFO:tasks.workunit.client.0.smithi096.stdout:9/514: creat d0/d8/d9/d40/d43/fa2 x:0 0 0 2024-04-18T21:06:59.961 INFO:tasks.workunit.client.0.smithi096.stdout:2/661: creat d11/d50/fdd x:0 0 0 2024-04-18T21:06:59.962 INFO:tasks.workunit.client.0.smithi096.stdout:0/459: chown d1/db/d30/d31/d39/l56 380 1 2024-04-18T21:06:59.962 INFO:tasks.workunit.client.0.smithi096.stdout:4/438: mkdir d2/d2a/d54/d5b/d89/d90 0 2024-04-18T21:06:59.962 INFO:tasks.workunit.client.0.smithi096.stdout:5/490: readlink d2/d11/d28/d4a/d87/da7/laf 0 2024-04-18T21:06:59.962 INFO:tasks.workunit.client.0.smithi096.stdout:9/515: chown d0/dc/f36 740652026 1 2024-04-18T21:06:59.963 INFO:tasks.workunit.client.0.smithi096.stdout:0/460: chown d1/d23/d32/d43/f46 29988 1 2024-04-18T21:06:59.963 INFO:tasks.workunit.client.0.smithi096.stdout:5/491: fdatasync d2/f79 0 2024-04-18T21:06:59.963 INFO:tasks.workunit.client.0.smithi096.stdout:4/439: mknod d2/d1d/d3a/c91 0 2024-04-18T21:06:59.963 INFO:tasks.workunit.client.0.smithi096.stdout:9/516: mkdir d0/d8/d9/d40/d43/d4b/da3 0 2024-04-18T21:06:59.964 INFO:tasks.workunit.client.0.smithi096.stdout:0/461: truncate d1/f75 300562 0 2024-04-18T21:06:59.964 INFO:tasks.workunit.client.0.smithi096.stdout:5/492: unlink d2/f20 0 2024-04-18T21:06:59.964 INFO:tasks.workunit.client.0.smithi096.stdout:9/517: stat d0/d8/d9/d40/d43/l59 0 2024-04-18T21:06:59.965 INFO:tasks.workunit.client.0.smithi096.stdout:2/662: dread d11/f16 [0,4194304] 0 2024-04-18T21:06:59.967 INFO:tasks.workunit.client.0.smithi096.stdout:0/462: creat d1/db/d25/f99 x:0 0 0 2024-04-18T21:06:59.967 INFO:tasks.workunit.client.0.smithi096.stdout:2/663: mknod d11/d13/d1a/d1e/d28/d4e/d89/cde 0 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi096.stdout:1/519: dread d0/df/d16/f68 [0,4194304] 0 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi096.stdout:9/518: getdents d0/d8/d11/d1f 0 2024-04-18T21:06:59.969 INFO:tasks.workunit.client.0.smithi096.stdout:0/463: rmdir d1/db/d30/d31/d39/d5d 39 2024-04-18T21:06:59.970 INFO:tasks.workunit.client.0.smithi096.stdout:2/664: stat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/cd0 0 2024-04-18T21:06:59.970 INFO:tasks.workunit.client.0.smithi096.stdout:0/464: chown d1/db/d30/d31/d85 671033414 1 2024-04-18T21:06:59.970 INFO:tasks.workunit.client.0.smithi096.stdout:0/465: chown d1/f3 18246 1 2024-04-18T21:06:59.971 INFO:tasks.workunit.client.0.smithi096.stdout:5/493: dwrite d2/d11/f21 [0,4194304] 0 2024-04-18T21:06:59.974 INFO:tasks.workunit.client.0.smithi096.stdout:2/665: mknod d11/d50/d5b/d8a/cdf 0 2024-04-18T21:06:59.974 INFO:tasks.workunit.client.0.smithi096.stdout:5/494: mkdir d2/d18/d9d/da0/db5 0 2024-04-18T21:06:59.974 INFO:tasks.workunit.client.0.smithi096.stdout:6/496: sync 2024-04-18T21:06:59.975 INFO:tasks.workunit.client.0.smithi096.stdout:0/466: getdents d1/db/d30/d31/d65 0 2024-04-18T21:06:59.976 INFO:tasks.workunit.client.0.smithi096.stdout:6/497: fdatasync d1/f13 0 2024-04-18T21:06:59.976 INFO:tasks.workunit.client.0.smithi096.stdout:1/520: dwrite d0/d27/d5f/f51 [0,4194304] 0 2024-04-18T21:06:59.978 INFO:tasks.workunit.client.0.smithi096.stdout:1/521: chown d0/df/d62/d69/d6a/d8d/ca1 9307 1 2024-04-18T21:06:59.979 INFO:tasks.workunit.client.0.smithi096.stdout:5/495: mknod d2/d11/d28/cb6 0 2024-04-18T21:06:59.979 INFO:tasks.workunit.client.0.smithi096.stdout:2/666: mknod d11/d13/d1d/d5d/ce0 0 2024-04-18T21:06:59.980 INFO:tasks.workunit.client.0.smithi096.stdout:4/440: dwrite d2/d2f/d39/d43/f48 [4194304,4194304] 0 2024-04-18T21:06:59.980 INFO:tasks.workunit.client.0.smithi096.stdout:5/496: write d2/d38/fa9 [97454,109542] 0 2024-04-18T21:06:59.980 INFO:tasks.workunit.client.0.smithi096.stdout:7/442: dread d0/d20/d39/f4c [0,4194304] 0 2024-04-18T21:06:59.982 INFO:tasks.workunit.client.0.smithi096.stdout:6/498: symlink d1/d5/da/d46/d71/d7c/d8b/l9d 0 2024-04-18T21:06:59.982 INFO:tasks.workunit.client.0.smithi096.stdout:5/497: symlink d2/d8f/lb7 0 2024-04-18T21:06:59.982 INFO:tasks.workunit.client.0.smithi096.stdout:4/441: rename d2/d2a/d54/d5b/f7a to d2/d2a/d54/d6d/f92 0 2024-04-18T21:06:59.982 INFO:tasks.workunit.client.0.smithi096.stdout:0/467: symlink d1/d23/d32/d7d/l9a 0 2024-04-18T21:06:59.982 INFO:tasks.workunit.client.0.smithi096.stdout:2/667: mknod d11/d13/d1a/d1e/d28/d4e/d89/dc0/ce1 0 2024-04-18T21:06:59.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/498: rename d2/d18/d61 to d2/d18/d61/d6d/db8 22 2024-04-18T21:06:59.983 INFO:tasks.workunit.client.0.smithi096.stdout:6/499: symlink d1/d5/da/d46/d71/d7c/l9e 0 2024-04-18T21:06:59.983 INFO:tasks.workunit.client.0.smithi096.stdout:0/468: write d1/db/d25/f99 [987601,80109] 0 2024-04-18T21:06:59.984 INFO:tasks.workunit.client.0.smithi096.stdout:5/499: creat d2/d8f/fb9 x:0 0 0 2024-04-18T21:06:59.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/442: link d2/d2a/d54/d71/f80 d2/d2a/f93 0 2024-04-18T21:06:59.985 INFO:tasks.workunit.client.0.smithi096.stdout:6/500: write d1/d3a/d36/f6f [2720292,46905] 0 2024-04-18T21:06:59.986 INFO:tasks.workunit.client.0.smithi096.stdout:5/500: mkdir d2/d11/d28/d64/dba 0 2024-04-18T21:06:59.986 INFO:tasks.workunit.client.0.smithi096.stdout:1/522: dwrite d0/df/d16/d6c/f9a [0,4194304] 0 2024-04-18T21:06:59.986 INFO:tasks.workunit.client.0.smithi096.stdout:2/668: rename d11/d13/d1a/d1e/d28/d4e/d40/d51/l73 to d11/d13/d1a/le2 0 2024-04-18T21:06:59.986 INFO:tasks.workunit.client.0.smithi096.stdout:0/469: write d1/d23/d32/f78 [648736,78710] 0 2024-04-18T21:06:59.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/501: mkdir d1/d3a/d57/d66/d9b/d9f 0 2024-04-18T21:06:59.988 INFO:tasks.workunit.client.0.smithi096.stdout:1/523: mknod d0/d27/d5f/ca7 0 2024-04-18T21:06:59.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/502: stat d1/d3a/d36/f8e 0 2024-04-18T21:06:59.989 INFO:tasks.workunit.client.0.smithi096.stdout:2/669: creat d11/d13/d1a/fe3 x:0 0 0 2024-04-18T21:06:59.989 INFO:tasks.workunit.client.0.smithi096.stdout:9/519: dread d0/f34 [0,4194304] 0 2024-04-18T21:06:59.989 INFO:tasks.workunit.client.0.smithi096.stdout:1/524: fsync d0/df/d16/f19 0 2024-04-18T21:06:59.990 INFO:tasks.workunit.client.0.smithi096.stdout:2/670: fsync d11/f16 0 2024-04-18T21:06:59.991 INFO:tasks.workunit.client.0.smithi096.stdout:5/501: write d2/d18/d61/d6f/d88/d96/fa3 [1312308,9473] 0 2024-04-18T21:06:59.992 INFO:tasks.workunit.client.0.smithi096.stdout:1/525: mkdir d0/df/d16/d24/da8 0 2024-04-18T21:06:59.992 INFO:tasks.workunit.client.0.smithi096.stdout:7/443: dread d0/d7/d8/f6a [0,4194304] 0 2024-04-18T21:06:59.993 INFO:tasks.workunit.client.0.smithi096.stdout:5/502: chown d2/d6a/f70 5 1 2024-04-18T21:06:59.994 INFO:tasks.workunit.client.0.smithi096.stdout:4/443: dwrite d2/d2a/f73 [0,4194304] 0 2024-04-18T21:06:59.994 INFO:tasks.workunit.client.0.smithi096.stdout:2/671: creat d11/d50/fe4 x:0 0 0 2024-04-18T21:06:59.994 INFO:tasks.workunit.client.0.smithi096.stdout:1/526: symlink d0/df/d62/d69/d65/la9 0 2024-04-18T21:06:59.994 INFO:tasks.workunit.client.0.smithi096.stdout:7/444: fdatasync d0/d7/d49/f7b 0 2024-04-18T21:06:59.994 INFO:tasks.workunit.client.0.smithi096.stdout:3/443: dread d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:06:59.995 INFO:tasks.workunit.client.0.smithi096.stdout:7/445: symlink d0/d7/d49/l83 0 2024-04-18T21:06:59.996 INFO:tasks.workunit.client.0.smithi096.stdout:4/444: truncate d2/d2f/d33/f35 894815 0 2024-04-18T21:06:59.996 INFO:tasks.workunit.client.0.smithi096.stdout:3/444: creat d4/d6/d1b/d1d/d64/f83 x:0 0 0 2024-04-18T21:06:59.997 INFO:tasks.workunit.client.0.smithi096.stdout:2/672: creat d11/d13/d1a/d1e/d28/d4e/d40/dbe/fe5 x:0 0 0 2024-04-18T21:06:59.997 INFO:tasks.workunit.client.0.smithi096.stdout:6/503: dwrite d1/d3a/d57/f8a [0,4194304] 0 2024-04-18T21:07:00.001 INFO:tasks.workunit.client.0.smithi096.stdout:4/445: mknod d2/d2f/d33/c94 0 2024-04-18T21:07:00.001 INFO:tasks.workunit.client.0.smithi096.stdout:3/445: mkdir d4/d6/d1b/d2c/d5c/d84 0 2024-04-18T21:07:00.001 INFO:tasks.workunit.client.0.smithi096.stdout:6/504: mkdir d1/d5/da/d44/d97/da0 0 2024-04-18T21:07:00.002 INFO:tasks.workunit.client.0.smithi096.stdout:5/503: dwrite f0 [0,4194304] 0 2024-04-18T21:07:00.002 INFO:tasks.workunit.client.0.smithi096.stdout:4/446: mknod d2/d2a/d54/d5b/c95 0 2024-04-18T21:07:00.003 INFO:tasks.workunit.client.0.smithi096.stdout:3/446: mkdir d4/d6/d1b/d2c/d31/d85 0 2024-04-18T21:07:00.003 INFO:tasks.workunit.client.0.smithi096.stdout:4/447: stat d2/d1d/f5e 0 2024-04-18T21:07:00.003 INFO:tasks.workunit.client.0.smithi096.stdout:0/470: read d1/db/d25/f3d [147957,79761] 0 2024-04-18T21:07:00.003 INFO:tasks.workunit.client.0.smithi096.stdout:1/527: dwrite d0/df/d16/d6c/fa6 [0,4194304] 0 2024-04-18T21:07:00.004 INFO:tasks.workunit.client.0.smithi096.stdout:0/471: readlink d1/d23/d32/d7d/l9a 0 2024-04-18T21:07:00.005 INFO:tasks.workunit.client.0.smithi096.stdout:5/504: symlink d2/d18/lbb 0 2024-04-18T21:07:00.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/472: read d1/d23/d32/d7d/f8d [2862761,18938] 0 2024-04-18T21:07:00.005 INFO:tasks.workunit.client.0.smithi096.stdout:5/505: write d2/fd [1385499,62394] 0 2024-04-18T21:07:00.006 INFO:tasks.workunit.client.0.smithi096.stdout:4/448: getdents d2/d2f/d39 0 2024-04-18T21:07:00.006 INFO:tasks.workunit.client.0.smithi096.stdout:5/506: write d2/f27 [184766,77184] 0 2024-04-18T21:07:00.007 INFO:tasks.workunit.client.0.smithi096.stdout:0/473: symlink d1/db/d30/d31/d39/l9b 0 2024-04-18T21:07:00.007 INFO:tasks.workunit.client.0.smithi096.stdout:4/449: creat d2/d2f/d33/d55/d59/f96 x:0 0 0 2024-04-18T21:07:00.007 INFO:tasks.workunit.client.0.smithi096.stdout:5/507: fsync d2/d18/d61/d6d/f77 0 2024-04-18T21:07:00.008 INFO:tasks.workunit.client.0.smithi096.stdout:0/474: truncate d1/f2d 9804528 0 2024-04-18T21:07:00.008 INFO:tasks.workunit.client.0.smithi096.stdout:5/508: symlink d2/d11/d28/d4a/d55/lbc 0 2024-04-18T21:07:00.009 INFO:tasks.workunit.client.0.smithi096.stdout:5/509: readlink d2/d11/l67 0 2024-04-18T21:07:00.009 INFO:tasks.workunit.client.0.smithi096.stdout:0/475: unlink d1/db/d30/d4a/d67/f6b 0 2024-04-18T21:07:00.010 INFO:tasks.workunit.client.0.smithi096.stdout:1/528: dwrite d0/df/f5b [0,4194304] 0 2024-04-18T21:07:00.010 INFO:tasks.workunit.client.0.smithi096.stdout:0/476: mknod d1/d23/d32/d43/d6f/d8a/d96/c9c 0 2024-04-18T21:07:00.011 INFO:tasks.workunit.client.0.smithi096.stdout:0/477: write d1/db/f92 [449394,127502] 0 2024-04-18T21:07:00.012 INFO:tasks.workunit.client.0.smithi096.stdout:5/510: getdents d2/d6a 0 2024-04-18T21:07:00.012 INFO:tasks.workunit.client.0.smithi096.stdout:1/529: symlink d0/d27/d5f/d60/laa 0 2024-04-18T21:07:00.012 INFO:tasks.workunit.client.0.smithi096.stdout:5/511: creat d2/d8f/fbd x:0 0 0 2024-04-18T21:07:00.013 INFO:tasks.workunit.client.0.smithi096.stdout:1/530: mkdir d0/df/d16/d6c/dab 0 2024-04-18T21:07:00.013 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:00.009+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:00.013 INFO:tasks.workunit.client.0.smithi096.stdout:5/512: unlink d2/d8f/fb9 0 2024-04-18T21:07:00.016 INFO:tasks.workunit.client.0.smithi096.stdout:5/513: mkdir d2/d11/d28/d4a/d55/d81/dbe 0 2024-04-18T21:07:00.016 INFO:tasks.workunit.client.0.smithi096.stdout:1/531: rename d0/df/d62/d69 to d0/df/d16/d24/dac 0 2024-04-18T21:07:00.019 INFO:tasks.workunit.client.0.smithi096.stdout:1/532: link d0/d27/d5f/d60/fa5 d0/df/d16/d24/dac/d6a/fad 0 2024-04-18T21:07:00.019 INFO:tasks.workunit.client.0.smithi096.stdout:0/478: dwrite d1/f6a [0,4194304] 0 2024-04-18T21:07:00.021 INFO:tasks.workunit.client.0.smithi096.stdout:1/533: rename d0/f39 to d0/df/d16/d24/da8/fae 0 2024-04-18T21:07:00.021 INFO:tasks.workunit.client.0.smithi096.stdout:0/479: symlink d1/db/d25/d54/l9d 0 2024-04-18T21:07:00.022 INFO:tasks.workunit.client.0.smithi096.stdout:0/480: fdatasync d1/db/d25/f3d 0 2024-04-18T21:07:00.022 INFO:tasks.workunit.client.0.smithi096.stdout:1/534: truncate d0/d27/f7f 206949 0 2024-04-18T21:07:00.023 INFO:tasks.workunit.client.0.smithi096.stdout:1/535: chown d0/df/d16/d24/c2c 844618773 1 2024-04-18T21:07:00.023 INFO:tasks.workunit.client.0.smithi096.stdout:5/514: dwrite d2/d11/d28/d4a/d55/f76 [0,4194304] 0 2024-04-18T21:07:00.024 INFO:tasks.workunit.client.0.smithi096.stdout:5/515: chown d2/d18/d61/d6d/f77 114783620 1 2024-04-18T21:07:00.025 INFO:tasks.workunit.client.0.smithi096.stdout:0/481: link d1/d23/d32/d43/d6f/d8a/d96/c9c d1/db/d30/d31/d39/c9e 0 2024-04-18T21:07:00.025 INFO:tasks.workunit.client.0.smithi096.stdout:5/516: truncate d2/d11/d28/d64/f6c 4768192 0 2024-04-18T21:07:00.025 INFO:tasks.workunit.client.0.smithi096.stdout:0/482: symlink d1/db/d30/d31/d85/d58/l9f 0 2024-04-18T21:07:00.026 INFO:tasks.workunit.client.0.smithi096.stdout:5/517: link d2/d38/f63 d2/d18/d61/fbf 0 2024-04-18T21:07:00.026 INFO:tasks.workunit.client.0.smithi096.stdout:0/483: write d1/db/d30/f81 [3964554,66833] 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi096.stdout:5/518: unlink d2/d11/d28/d4a/d55/f60 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi096.stdout:0/484: write d1/db/d30/f5b [396470,31905] 0 2024-04-18T21:07:00.028 INFO:tasks.workunit.client.0.smithi096.stdout:5/519: mknod d2/d9b/cc0 0 2024-04-18T21:07:00.028 INFO:tasks.workunit.client.0.smithi096.stdout:5/520: symlink d2/d11/d28/d4a/d87/da7/lc1 0 2024-04-18T21:07:00.029 INFO:tasks.workunit.client.0.smithi096.stdout:5/521: write d2/d11/d28/f72 [67697,18550] 0 2024-04-18T21:07:00.030 INFO:tasks.workunit.client.0.smithi096.stdout:5/522: creat d2/d11/d28/d4a/d55/fc2 x:0 0 0 2024-04-18T21:07:00.039 INFO:tasks.workunit.client.0.smithi096.stdout:0/485: read d1/f75 [268247,73592] 0 2024-04-18T21:07:00.040 INFO:tasks.workunit.client.0.smithi096.stdout:5/523: read d2/f1b [1384560,31242] 0 2024-04-18T21:07:00.041 INFO:tasks.workunit.client.0.smithi096.stdout:5/524: symlink d2/lc3 0 2024-04-18T21:07:00.042 INFO:tasks.workunit.client.0.smithi096.stdout:3/447: dread d4/d6/d1b/d2c/d31/d11/f40 [0,4194304] 0 2024-04-18T21:07:00.042 INFO:tasks.workunit.client.0.smithi096.stdout:3/448: write d4/d6/d1b/d1d/f68 [368755,22152] 0 2024-04-18T21:07:00.044 INFO:tasks.workunit.client.0.smithi096.stdout:3/449: read d4/d6/f32 [3106756,20069] 0 2024-04-18T21:07:00.045 INFO:tasks.workunit.client.0.smithi096.stdout:3/450: write d4/d6/d1b/d1d/d64/f83 [1041871,43034] 0 2024-04-18T21:07:00.046 INFO:tasks.workunit.client.0.smithi096.stdout:3/451: chown d4/d6/d1b/d2c/d31/d11/f40 95300 1 2024-04-18T21:07:00.047 INFO:tasks.workunit.client.0.smithi096.stdout:5/525: dwrite d2/d38/d4c/f9f [0,4194304] 0 2024-04-18T21:07:00.047 INFO:tasks.workunit.client.0.smithi096.stdout:3/452: write d4/d6/d1b/d2c/d31/f41 [708394,48953] 0 2024-04-18T21:07:00.048 INFO:tasks.workunit.client.0.smithi096.stdout:3/453: symlink d4/d6/d1b/d1d/l86 0 2024-04-18T21:07:00.049 INFO:tasks.workunit.client.0.smithi096.stdout:3/454: stat d4/d6/c3c 0 2024-04-18T21:07:00.050 INFO:tasks.workunit.client.0.smithi096.stdout:3/455: write d4/d6/d22/d20/f3f [443865,34836] 0 2024-04-18T21:07:00.052 INFO:tasks.workunit.client.0.smithi096.stdout:3/456: read d4/d6/d1b/d1d/f68 [5000,128580] 0 2024-04-18T21:07:00.052 INFO:tasks.workunit.client.0.smithi096.stdout:5/526: dread d2/d18/d61/d6f/d88/d96/fa3 [0,4194304] 0 2024-04-18T21:07:00.053 INFO:tasks.workunit.client.0.smithi096.stdout:3/457: write d4/d6/d22/f3e [797432,80882] 0 2024-04-18T21:07:00.054 INFO:tasks.workunit.client.0.smithi096.stdout:5/527: fdatasync d2/f46 0 2024-04-18T21:07:00.055 INFO:tasks.workunit.client.0.smithi096.stdout:0/486: dwrite d1/db/d30/d31/d85/fa [0,4194304] 0 2024-04-18T21:07:00.055 INFO:tasks.workunit.client.0.smithi096.stdout:1/536: dread d0/d27/f7f [0,4194304] 0 2024-04-18T21:07:00.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/528: symlink d2/d18/d9d/da0/dab/lc4 0 2024-04-18T21:07:00.058 INFO:tasks.workunit.client.0.smithi096.stdout:0/487: chown d1/db/d30/d31/f4c 142948116 1 2024-04-18T21:07:00.059 INFO:tasks.workunit.client.0.smithi096.stdout:5/529: write d2/d11/d28/d4a/d55/f76 [3757366,102350] 0 2024-04-18T21:07:00.059 INFO:tasks.workunit.client.0.smithi096.stdout:0/488: creat d1/d23/d32/d7d/fa0 x:0 0 0 2024-04-18T21:07:00.060 INFO:tasks.workunit.client.0.smithi096.stdout:0/489: creat d1/d23/d32/d43/d6f/fa1 x:0 0 0 2024-04-18T21:07:00.061 INFO:tasks.workunit.client.0.smithi096.stdout:0/490: mknod d1/db/d30/d4a/d67/ca2 0 2024-04-18T21:07:00.062 INFO:tasks.workunit.client.0.smithi096.stdout:1/537: dwrite d0/d27/d33/f3d [4194304,4194304] 0 2024-04-18T21:07:00.062 INFO:tasks.workunit.client.0.smithi096.stdout:0/491: write d1/db/d30/f6c [778506,97279] 0 2024-04-18T21:07:00.063 INFO:tasks.workunit.client.0.smithi096.stdout:0/492: mkdir d1/da3 0 2024-04-18T21:07:00.063 INFO:tasks.workunit.client.0.smithi096.stdout:1/538: readlink d0/df/d16/d24/dac/d65/l6b 0 2024-04-18T21:07:00.064 INFO:tasks.workunit.client.0.smithi096.stdout:0/493: creat d1/d23/fa4 x:0 0 0 2024-04-18T21:07:00.064 INFO:tasks.workunit.client.0.smithi096.stdout:7/446: dread d0/d7/f5f [0,4194304] 0 2024-04-18T21:07:00.065 INFO:tasks.workunit.client.0.smithi096.stdout:1/539: truncate d0/df/d62/f83 158876 0 2024-04-18T21:07:00.065 INFO:tasks.workunit.client.0.smithi096.stdout:7/447: truncate d0/d20/f34 734136 0 2024-04-18T21:07:00.065 INFO:tasks.workunit.client.0.smithi096.stdout:1/540: write d0/d27/d5f/f51 [680132,88477] 0 2024-04-18T21:07:00.067 INFO:tasks.workunit.client.0.smithi096.stdout:1/541: symlink d0/d27/d5f/laf 0 2024-04-18T21:07:00.067 INFO:tasks.workunit.client.0.smithi096.stdout:2/673: dread d11/d13/d1a/d1e/d28/d4e/d5c/fa1 [0,4194304] 0 2024-04-18T21:07:00.072 INFO:tasks.workunit.client.0.smithi096.stdout:7/448: dwrite d0/d11/f43 [0,4194304] 0 2024-04-18T21:07:00.072 INFO:tasks.workunit.client.0.smithi096.stdout:4/450: dread d2/d1d/d3a/f52 [0,4194304] 0 2024-04-18T21:07:00.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/449: creat d0/d7/d2f/d53/f84 x:0 0 0 2024-04-18T21:07:00.074 INFO:tasks.workunit.client.0.smithi096.stdout:7/450: readlink d0/d20/d62/d7d/l80 0 2024-04-18T21:07:00.074 INFO:tasks.workunit.client.0.smithi096.stdout:0/494: write d1/db/d30/f5c [685271,10957] 0 2024-04-18T21:07:00.074 INFO:tasks.workunit.client.0.smithi096.stdout:1/542: dwrite d0/d27/d5f/d60/f92 [0,4194304] 0 2024-04-18T21:07:00.075 INFO:tasks.workunit.client.0.smithi096.stdout:0/495: rmdir d1 39 2024-04-18T21:07:00.075 INFO:tasks.workunit.client.0.smithi096.stdout:7/451: mknod d0/d7/d42/c85 0 2024-04-18T21:07:00.075 INFO:tasks.workunit.client.0.smithi096.stdout:7/452: chown d0/d7/d49 116742 1 2024-04-18T21:07:00.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/453: readlink d0/d11/d18/l75 0 2024-04-18T21:07:00.076 INFO:tasks.workunit.client.0.smithi096.stdout:0/496: readlink d1/db/d30/d31/d85/l90 0 2024-04-18T21:07:00.076 INFO:tasks.workunit.client.0.smithi096.stdout:0/497: mkdir d1/da5 0 2024-04-18T21:07:00.078 INFO:tasks.workunit.client.0.smithi096.stdout:0/498: mknod d1/db/d30/d4a/d67/ca6 0 2024-04-18T21:07:00.080 INFO:tasks.workunit.client.0.smithi096.stdout:0/499: creat d1/d23/d32/fa7 x:0 0 0 2024-04-18T21:07:00.081 INFO:tasks.workunit.client.0.smithi096.stdout:0/500: write d1/db/d30/f51 [2452231,17663] 0 2024-04-18T21:07:00.081 INFO:tasks.workunit.client.0.smithi096.stdout:1/543: dwrite d0/f17 [0,4194304] 0 2024-04-18T21:07:00.082 INFO:tasks.workunit.client.0.smithi096.stdout:4/451: read f1 [153919,117018] 0 2024-04-18T21:07:00.083 INFO:tasks.workunit.client.0.smithi096.stdout:0/501: dread - d1/d23/d32/d43/d6f/f8b zero size 2024-04-18T21:07:00.083 INFO:tasks.workunit.client.0.smithi096.stdout:4/452: chown d2/f9 116753959 1 2024-04-18T21:07:00.083 INFO:tasks.workunit.client.0.smithi096.stdout:7/454: dwrite d0/d7/d8/f16 [0,4194304] 0 2024-04-18T21:07:00.084 INFO:tasks.workunit.client.0.smithi096.stdout:4/453: chown d2/f18 13224 1 2024-04-18T21:07:00.085 INFO:tasks.workunit.client.0.smithi096.stdout:1/544: rename d0/df/d16/d24/d9c/c9f to d0/cb0 0 2024-04-18T21:07:00.086 INFO:tasks.workunit.client.0.smithi096.stdout:1/545: mkdir d0/df/d62/db1 0 2024-04-18T21:07:00.087 INFO:tasks.workunit.client.0.smithi096.stdout:1/546: symlink d0/df/d30/lb2 0 2024-04-18T21:07:00.088 INFO:tasks.workunit.client.0.smithi096.stdout:1/547: write d0/d27/d5f/d60/f99 [1121392,104314] 0 2024-04-18T21:07:00.093 INFO:tasks.workunit.client.0.smithi096.stdout:3/458: dread d4/d6/d1b/d1d/f28 [0,4194304] 0 2024-04-18T21:07:00.093 INFO:tasks.workunit.client.0.smithi096.stdout:1/548: dwrite d0/df/d30/f4e [0,4194304] 0 2024-04-18T21:07:00.094 INFO:tasks.workunit.client.0.smithi096.stdout:3/459: symlink d4/l87 0 2024-04-18T21:07:00.095 INFO:tasks.workunit.client.0.smithi096.stdout:3/460: chown d4/d6/d7/c14 212 1 2024-04-18T21:07:00.095 INFO:tasks.workunit.client.0.smithi096.stdout:0/502: getdents d1/d23/d32 0 2024-04-18T21:07:00.096 INFO:tasks.workunit.client.0.smithi096.stdout:1/549: rename d0/df/d62/l63 to d0/df/d16/lb3 0 2024-04-18T21:07:00.096 INFO:tasks.workunit.client.0.smithi096.stdout:0/503: write d1/db/d30/d31/d85/fd [8651417,86591] 0 2024-04-18T21:07:00.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/461: symlink d4/d6/d1b/d1d/d64/l88 0 2024-04-18T21:07:00.097 INFO:tasks.workunit.client.0.smithi096.stdout:1/550: stat d0/df/d16 0 2024-04-18T21:07:00.098 INFO:tasks.workunit.client.0.smithi096.stdout:3/462: chown d4/d6/d1b/d2c/d31/l33 264129 1 2024-04-18T21:07:00.099 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:00.099 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:00.099 INFO:tasks.workunit.client.0.smithi096.stdout:4/454: dread d2/d2a/d54/d71/f82 [4194304,4194304] 0 2024-04-18T21:07:00.100 INFO:tasks.workunit.client.0.smithi096.stdout:0/504: getdents d1/db/d25 0 2024-04-18T21:07:00.100 INFO:tasks.workunit.client.0.smithi096.stdout:3/463: fsync d4/d6/d1b/d2c/d31/f41 0 2024-04-18T21:07:00.100 INFO:tasks.workunit.client.0.smithi096.stdout:7/455: dwrite d0/d11/f29 [0,4194304] 0 2024-04-18T21:07:00.100 INFO:tasks.workunit.client.0.smithi096.stdout:1/551: mknod d0/df/d16/d24/dac/d6a/d8d/d9b/cb4 0 2024-04-18T21:07:00.100 INFO:tasks.workunit.client.0.smithi096.stdout:4/455: readlink d2/d2f/d39/l3c 0 2024-04-18T21:07:00.101 INFO:tasks.workunit.client.0.smithi096.stdout:0/505: symlink d1/db/d25/la8 0 2024-04-18T21:07:00.103 INFO:tasks.workunit.client.0.smithi096.stdout:0/506: write d1/db/d30/f87 [4051310,11377] 0 2024-04-18T21:07:00.103 INFO:tasks.workunit.client.0.smithi096.stdout:1/552: truncate d0/df/d16/d24/da8/fae 2098296 0 2024-04-18T21:07:00.105 INFO:tasks.workunit.client.0.smithi096.stdout:0/507: link d1/db/d30/d31/d39/f66 d1/d23/d32/d43/d6f/d8a/d96/fa9 0 2024-04-18T21:07:00.105 INFO:tasks.workunit.client.0.smithi096.stdout:7/456: dwrite d0/d11/f17 [0,4194304] 0 2024-04-18T21:07:00.106 INFO:tasks.workunit.client.0.smithi096.stdout:0/508: chown d1/db/d30/d31/d39/l56 0 1 2024-04-18T21:07:00.107 INFO:tasks.workunit.client.0.smithi096.stdout:0/509: mkdir d1/d23/d32/d43/daa 0 2024-04-18T21:07:00.107 INFO:tasks.workunit.client.0.smithi096.stdout:1/553: dread d0/df/d16/d6c/fa6 [0,4194304] 0 2024-04-18T21:07:00.112 INFO:tasks.workunit.client.0.smithi096.stdout:1/554: dwrite d0/df/d16/d24/f2b [0,4194304] 0 2024-04-18T21:07:00.113 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:00.113+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:00.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:00.126 INFO:tasks.workunit.client.0.smithi096.stdout:1/555: dread d0/df/f2e [0,4194304] 0 2024-04-18T21:07:00.126 INFO:tasks.workunit.client.0.smithi096.stdout:8/541: sync 2024-04-18T21:07:00.127 INFO:tasks.workunit.client.0.smithi096.stdout:1/556: getdents d0/d27/d5f/d60 0 2024-04-18T21:07:00.128 INFO:tasks.workunit.client.0.smithi096.stdout:8/542: creat d0/d3/d1d/d66/d68/d7f/dac/fb7 x:0 0 0 2024-04-18T21:07:00.130 INFO:tasks.workunit.client.0.smithi096.stdout:1/557: rename d0/df/d16/d6c/fa6 to d0/df/d16/d24/dac/d6a/d8d/d9b/fb5 0 2024-04-18T21:07:00.130 INFO:tasks.workunit.client.0.smithi096.stdout:4/456: dread d2/f9 [0,4194304] 0 2024-04-18T21:07:00.130 INFO:tasks.workunit.client.0.smithi096.stdout:1/558: creat d0/df/d16/d6c/fb6 x:0 0 0 2024-04-18T21:07:00.131 INFO:tasks.workunit.client.0.smithi096.stdout:0/510: dread d1/f2d [0,4194304] 0 2024-04-18T21:07:00.132 INFO:tasks.workunit.client.0.smithi096.stdout:0/511: creat d1/d23/d32/d43/d6f/fab x:0 0 0 2024-04-18T21:07:00.136 INFO:tasks.workunit.client.0.smithi096.stdout:8/543: rmdir d0/d3/d1d/d66/d68/d7f/dac/d56 39 2024-04-18T21:07:00.136 INFO:tasks.workunit.client.0.smithi096.stdout:1/559: dwrite d0/d27/d5f/f51 [0,4194304] 0 2024-04-18T21:07:00.138 INFO:tasks.workunit.client.0.smithi096.stdout:0/512: dwrite d1/db/d30/d31/f47 [0,4194304] 0 2024-04-18T21:07:00.139 INFO:tasks.workunit.client.0.smithi096.stdout:8/544: symlink d0/d3/d3a/lb8 0 2024-04-18T21:07:00.139 INFO:tasks.workunit.client.0.smithi096.stdout:0/513: chown d1/db/d30/d31/d39/f55 546 1 2024-04-18T21:07:00.140 INFO:tasks.workunit.client.0.smithi096.stdout:8/545: write d0/d3/d1d/d66/d68/d7f/dac/d33/f92 [4755224,93311] 0 2024-04-18T21:07:00.141 INFO:tasks.workunit.client.0.smithi096.stdout:8/546: write d0/d64/f52 [82527,18436] 0 2024-04-18T21:07:00.145 INFO:tasks.workunit.client.0.smithi096.stdout:1/560: write d0/df/d16/d24/da8/fae [2863674,55478] 0 2024-04-18T21:07:00.146 INFO:tasks.workunit.client.0.smithi096.stdout:0/514: dwrite d1/d23/d32/d43/f46 [0,4194304] 0 2024-04-18T21:07:00.146 INFO:tasks.workunit.client.0.smithi096.stdout:1/561: readlink d0/d27/l20 0 2024-04-18T21:07:00.146 INFO:tasks.workunit.client.0.smithi096.stdout:1/562: chown d0/df/d16/f68 0 1 2024-04-18T21:07:00.147 INFO:tasks.workunit.client.0.smithi096.stdout:0/515: mknod d1/db/d30/d31/d39/d77/cac 0 2024-04-18T21:07:00.147 INFO:tasks.workunit.client.0.smithi096.stdout:8/547: dwrite d0/d3/fb2 [0,4194304] 0 2024-04-18T21:07:00.148 INFO:tasks.workunit.client.0.smithi096.stdout:1/563: creat d0/df/d16/d24/da8/fb7 x:0 0 0 2024-04-18T21:07:00.148 INFO:tasks.workunit.client.0.smithi096.stdout:0/516: read - d1/d23/d32/fa7 zero size 2024-04-18T21:07:00.149 INFO:tasks.workunit.client.0.smithi096.stdout:1/564: write d0/df/d16/d24/dac/d6a/d8d/d95/f97 [992413,101288] 0 2024-04-18T21:07:00.150 INFO:tasks.workunit.client.0.smithi096.stdout:8/548: mknod d0/d3/d1d/d66/d68/d7f/dac/d33/cb9 0 2024-04-18T21:07:00.150 INFO:tasks.workunit.client.0.smithi096.stdout:0/517: rename d1/l2a to d1/db/d30/d31/d65/lad 0 2024-04-18T21:07:00.150 INFO:tasks.workunit.client.0.smithi096.stdout:1/565: rmdir d0/df/d16/d24/dac/d6a/d8d/d9b 39 2024-04-18T21:07:00.151 INFO:tasks.workunit.client.0.smithi096.stdout:0/518: dread - d1/db/d30/d31/d85/d58/f83 zero size 2024-04-18T21:07:00.152 INFO:tasks.workunit.client.0.smithi096.stdout:0/519: rmdir d1/d23/d32/d43/d6f/d8a 39 2024-04-18T21:07:00.152 INFO:tasks.workunit.client.0.smithi096.stdout:1/566: creat d0/df/d16/fb8 x:0 0 0 2024-04-18T21:07:00.153 INFO:tasks.workunit.client.0.smithi096.stdout:0/520: mkdir d1/db/d30/d4a/dae 0 2024-04-18T21:07:00.158 INFO:tasks.workunit.client.0.smithi096.stdout:0/521: dwrite d1/d23/d32/d7d/f8d [0,4194304] 0 2024-04-18T21:07:00.158 INFO:tasks.workunit.client.0.smithi096.stdout:8/549: dwrite d0/d3/d1d/d66/d68/fa0 [0,4194304] 0 2024-04-18T21:07:00.161 INFO:tasks.workunit.client.0.smithi096.stdout:5/530: sync 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi096.stdout:6/505: sync 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi096.stdout:3/464: sync 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi096.stdout:9/520: sync 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi096.stdout:7/457: sync 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi096.stdout:2/674: sync 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi096.stdout:0/522: unlink d1/db/d30/d31/d39/d5d/f84 0 2024-04-18T21:07:00.163 INFO:tasks.workunit.client.0.smithi096.stdout:4/457: dread d2/f4c [0,4194304] 0 2024-04-18T21:07:00.163 INFO:tasks.workunit.client.0.smithi096.stdout:5/531: write d2/d11/d28/d64/f6c [3938729,85914] 0 2024-04-18T21:07:00.163 INFO:tasks.workunit.client.0.smithi096.stdout:6/506: chown d1/d5/f15 1023958083 1 2024-04-18T21:07:00.163 INFO:tasks.workunit.client.0.smithi096.stdout:4/458: fsync d2/f18 0 2024-04-18T21:07:00.164 INFO:tasks.workunit.client.0.smithi096.stdout:0/523: mkdir d1/d23/d32/daf 0 2024-04-18T21:07:00.164 INFO:tasks.workunit.client.0.smithi096.stdout:2/675: rename d11/d50/f77 to d11/d13/d1a/d1e/dbf/fe6 0 2024-04-18T21:07:00.164 INFO:tasks.workunit.client.0.smithi096.stdout:8/550: getdents d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d5a 0 2024-04-18T21:07:00.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/532: creat d2/d18/fc5 x:0 0 0 2024-04-18T21:07:00.165 INFO:tasks.workunit.client.0.smithi096.stdout:7/458: rename d0/d7/d2f/d53/f6f to d0/d20/d4b/f86 0 2024-04-18T21:07:00.166 INFO:tasks.workunit.client.0.smithi096.stdout:0/524: write d1/d23/d32/d43/d6f/f8b [283014,15414] 0 2024-04-18T21:07:00.166 INFO:tasks.workunit.client.0.smithi096.stdout:8/551: dread - d0/d3/d3a/f75 zero size 2024-04-18T21:07:00.166 INFO:tasks.workunit.client.0.smithi096.stdout:5/533: dread - d2/d11/d28/d4a/d87/f90 zero size 2024-04-18T21:07:00.167 INFO:tasks.workunit.client.0.smithi096.stdout:3/465: rename d4/d6/d1b/d2c/d5c/c81 to d4/d6/d1b/d1d/c89 0 2024-04-18T21:07:00.167 INFO:tasks.workunit.client.0.smithi096.stdout:8/552: rmdir d0/d3/d1d 39 2024-04-18T21:07:00.167 INFO:tasks.workunit.client.0.smithi096.stdout:0/525: write d1/db/d30/d31/d39/d6d/f80 [832006,67337] 0 2024-04-18T21:07:00.168 INFO:tasks.workunit.client.0.smithi096.stdout:5/534: symlink d2/d38/d4c/lc6 0 2024-04-18T21:07:00.168 INFO:tasks.workunit.client.0.smithi096.stdout:8/553: fsync d0/f8e 0 2024-04-18T21:07:00.168 INFO:tasks.workunit.client.0.smithi096.stdout:9/521: dwrite d0/d8/f71 [0,4194304] 0 2024-04-18T21:07:00.169 INFO:tasks.workunit.client.0.smithi096.stdout:8/554: write d0/d3/db/f45 [1818793,127784] 0 2024-04-18T21:07:00.169 INFO:tasks.workunit.client.0.smithi096.stdout:5/535: chown d2/d11/c98 1818087 1 2024-04-18T21:07:00.170 INFO:tasks.workunit.client.0.smithi096.stdout:8/555: write d0/d64/f6d [1056010,25518] 0 2024-04-18T21:07:00.174 INFO:tasks.workunit.client.0.smithi096.stdout:8/556: truncate d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d5a/fa7 545381 0 2024-04-18T21:07:00.175 INFO:tasks.workunit.client.0.smithi096.stdout:3/466: dwrite d4/d6/d1b/d2c/d31/d11/f55 [0,4194304] 0 2024-04-18T21:07:00.175 INFO:tasks.workunit.client.0.smithi096.stdout:9/522: dwrite d0/d8/d9/d40/d43/f8e [0,4194304] 0 2024-04-18T21:07:00.176 INFO:tasks.workunit.client.0.smithi096.stdout:3/467: fdatasync d4/d6/d22/f3e 0 2024-04-18T21:07:00.177 INFO:tasks.workunit.client.0.smithi096.stdout:0/526: truncate d1/db/d25/f99 906094 0 2024-04-18T21:07:00.177 INFO:tasks.workunit.client.0.smithi096.stdout:9/523: creat d0/d28/fa4 x:0 0 0 2024-04-18T21:07:00.177 INFO:tasks.workunit.client.0.smithi096.stdout:0/527: chown d1/db/d30/d4a/d67 434096 1 2024-04-18T21:07:00.178 INFO:tasks.workunit.client.0.smithi096.stdout:3/468: link d4/d6/d1b/d2c/d5c/f80 d4/d6/f8a 0 2024-04-18T21:07:00.178 INFO:tasks.workunit.client.0.smithi096.stdout:0/528: creat d1/db/d25/fb0 x:0 0 0 2024-04-18T21:07:00.178 INFO:tasks.workunit.client.0.smithi096.stdout:9/524: rename d0/dc/f36 to d0/d8/fa5 0 2024-04-18T21:07:00.179 INFO:tasks.workunit.client.0.smithi096.stdout:8/557: truncate d0/d3/db/f6a 1843477 0 2024-04-18T21:07:00.180 INFO:tasks.workunit.client.0.smithi096.stdout:8/558: rmdir d0/d64/d43 39 2024-04-18T21:07:00.180 INFO:tasks.workunit.client.0.smithi096.stdout:9/525: readlink d0/d8/d11/l37 0 2024-04-18T21:07:00.180 INFO:tasks.workunit.client.0.smithi096.stdout:0/529: rename d1/db/d30/d31/d39/d77 to d1/db/d30/d31/d39/d6d/db1 0 2024-04-18T21:07:00.182 INFO:tasks.workunit.client.0.smithi096.stdout:9/526: mknod d0/d8/d11/d48/ca6 0 2024-04-18T21:07:00.182 INFO:tasks.workunit.client.0.smithi096.stdout:9/527: chown d0/d28/da1 244865 1 2024-04-18T21:07:00.183 INFO:tasks.workunit.client.0.smithi096.stdout:9/528: rename d0/d8/d9/d40 to d0/d8/d11/d1f/da7 0 2024-04-18T21:07:00.191 INFO:tasks.workunit.client.0.smithi096.stdout:8/559: dwrite d0/d3/d1d/d66/d68/d7f/dac/d33/f59 [0,4194304] 0 2024-04-18T21:07:00.192 INFO:tasks.workunit.client.0.smithi096.stdout:2/676: dread d11/fd5 [0,4194304] 0 2024-04-18T21:07:00.192 INFO:tasks.workunit.client.0.smithi096.stdout:8/560: mknod d0/d3/d3a/dab/d46/d78/cba 0 2024-04-18T21:07:00.193 INFO:tasks.workunit.client.0.smithi096.stdout:8/561: fdatasync d0/d3/d1d/f24 0 2024-04-18T21:07:00.193 INFO:tasks.workunit.client.0.smithi096.stdout:2/677: mkdir d11/d13/d1a/d1e/de7 0 2024-04-18T21:07:00.193 INFO:tasks.workunit.client.0.smithi096.stdout:2/678: stat d11/d50/d8e/f99 0 2024-04-18T21:07:00.193 INFO:tasks.workunit.client.0.smithi096.stdout:8/562: mknod d0/d3/db/cbb 0 2024-04-18T21:07:00.194 INFO:tasks.workunit.client.0.smithi096.stdout:8/563: chown d0/d3/d3a/dab/d61 126655 1 2024-04-18T21:07:00.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/679: truncate d11/d13/d1a/f35 4214502 0 2024-04-18T21:07:00.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/529: dread d0/d8/d11/d48/f67 [0,4194304] 0 2024-04-18T21:07:00.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/530: chown d0/d8/d11/f82 211291 1 2024-04-18T21:07:00.198 INFO:tasks.workunit.client.0.smithi096.stdout:6/507: dread d1/d5/da/f21 [0,4194304] 0 2024-04-18T21:07:00.199 INFO:tasks.workunit.client.0.smithi096.stdout:3/469: dread d4/d6/d1b/d1d/d64/f78 [0,4194304] 0 2024-04-18T21:07:00.199 INFO:tasks.workunit.client.0.smithi096.stdout:4/459: dread d2/d2a/d54/d71/f80 [0,4194304] 0 2024-04-18T21:07:00.199 INFO:tasks.workunit.client.0.smithi096.stdout:6/508: mknod d1/d5/da/d90/d94/ca1 0 2024-04-18T21:07:00.200 INFO:tasks.workunit.client.0.smithi096.stdout:4/460: creat d2/f97 x:0 0 0 2024-04-18T21:07:00.200 INFO:tasks.workunit.client.0.smithi096.stdout:3/470: symlink d4/d8/d7f/l8b 0 2024-04-18T21:07:00.200 INFO:tasks.workunit.client.0.smithi096.stdout:4/461: write d2/f31 [335413,70799] 0 2024-04-18T21:07:00.200 INFO:tasks.workunit.client.0.smithi096.stdout:3/471: chown d4/d6/f32 3070 1 2024-04-18T21:07:00.201 INFO:tasks.workunit.client.0.smithi096.stdout:4/462: mkdir d2/d2f/d39/d98 0 2024-04-18T21:07:00.202 INFO:tasks.workunit.client.0.smithi096.stdout:4/463: rmdir d2/d2f/d33/d55/d59 39 2024-04-18T21:07:00.202 INFO:tasks.workunit.client.0.smithi096.stdout:9/531: write d0/f5 [8690191,90875] 0 2024-04-18T21:07:00.202 INFO:tasks.workunit.client.0.smithi096.stdout:4/464: mkdir d2/d2a/d54/d71/d99 0 2024-04-18T21:07:00.203 INFO:tasks.workunit.client.0.smithi096.stdout:9/532: chown d0/d8/d11/d1f/da7/c87 12 1 2024-04-18T21:07:00.206 INFO:tasks.workunit.client.0.smithi096.stdout:9/533: mknod d0/d8/d11/d1f/da7/d43/d4b/da3/ca8 0 2024-04-18T21:07:00.206 INFO:tasks.workunit.client.0.smithi096.stdout:6/509: dwrite d1/d5/da/d44/f7d [4194304,4194304] 0 2024-04-18T21:07:00.207 INFO:tasks.workunit.client.0.smithi096.stdout:3/472: dwrite d4/f73 [0,4194304] 0 2024-04-18T21:07:00.207 INFO:tasks.workunit.client.0.smithi096.stdout:9/534: stat d0/d8/l50 0 2024-04-18T21:07:00.208 INFO:tasks.workunit.client.0.smithi096.stdout:6/510: truncate d1/f34 3800076 0 2024-04-18T21:07:00.209 INFO:tasks.workunit.client.0.smithi096.stdout:3/473: fsync d4/d6/d22/d20/d46/f56 0 2024-04-18T21:07:00.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/530: dread d1/db/d30/d31/d65/f94 [0,4194304] 0 2024-04-18T21:07:00.210 INFO:tasks.workunit.client.0.smithi096.stdout:0/531: chown d1/f8e 1 1 2024-04-18T21:07:00.211 INFO:tasks.workunit.client.0.smithi096.stdout:4/465: dwrite d2/d2f/d33/d55/d57/f5c [0,4194304] 0 2024-04-18T21:07:00.212 INFO:tasks.workunit.client.0.smithi096.stdout:3/474: dread d4/d6/d1b/d2c/d31/d11/f40 [0,4194304] 0 2024-04-18T21:07:00.212 INFO:tasks.workunit.client.0.smithi096.stdout:4/466: rename d2/d2a/f79 to d2/d2a/d54/d6d/d78/f9a 0 2024-04-18T21:07:00.213 INFO:tasks.workunit.client.0.smithi096.stdout:9/535: truncate d0/d8/d11/d1f/f52 354695 0 2024-04-18T21:07:00.214 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:00.213+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:00.214 INFO:tasks.workunit.client.0.smithi096.stdout:3/475: mkdir d4/d6/d1b/d2c/d31/d11/d8c 0 2024-04-18T21:07:00.214 INFO:tasks.workunit.client.0.smithi096.stdout:9/536: chown d0/dc/d5f/d76/f70 2824586 1 2024-04-18T21:07:00.214 INFO:tasks.workunit.client.0.smithi096.stdout:4/467: rename d2/d2f/d33/d55/d57/c66 to d2/c9b 0 2024-04-18T21:07:00.215 INFO:tasks.workunit.client.0.smithi096.stdout:4/468: symlink d2/d2a/d54/d5b/l9c 0 2024-04-18T21:07:00.215 INFO:tasks.workunit.client.0.smithi096.stdout:9/537: rmdir d0/d8/d11/d1f/da7/d43/d4b/da3 39 2024-04-18T21:07:00.215 INFO:tasks.workunit.client.0.smithi096.stdout:9/538: write d0/d8/d11/d48/f57 [906227,10978] 0 2024-04-18T21:07:00.216 INFO:tasks.workunit.client.0.smithi096.stdout:4/469: truncate d2/d1d/f7e 3527465 0 2024-04-18T21:07:00.216 INFO:tasks.workunit.client.0.smithi096.stdout:9/539: rename d0/dc/f88 to d0/d44/fa9 0 2024-04-18T21:07:00.217 INFO:tasks.workunit.client.0.smithi096.stdout:4/470: symlink d2/d2a/d54/d5b/l9d 0 2024-04-18T21:07:00.218 INFO:tasks.workunit.client.0.smithi096.stdout:4/471: mknod d2/d2f/d33/d55/d57/d88/c9e 0 2024-04-18T21:07:00.219 INFO:tasks.workunit.client.0.smithi096.stdout:4/472: write d2/d1d/f5e [294617,125883] 0 2024-04-18T21:07:00.219 INFO:tasks.workunit.client.0.smithi096.stdout:1/567: sync 2024-04-18T21:07:00.221 INFO:tasks.workunit.client.0.smithi096.stdout:4/473: creat d2/d2f/d33/d55/f9f x:0 0 0 2024-04-18T21:07:00.221 INFO:tasks.workunit.client.0.smithi096.stdout:1/568: creat d0/df/fb9 x:0 0 0 2024-04-18T21:07:00.223 INFO:tasks.workunit.client.0.smithi096.stdout:9/540: dwrite d0/d8/f71 [0,4194304] 0 2024-04-18T21:07:00.223 INFO:tasks.workunit.client.0.smithi096.stdout:4/474: rename d2/d2a/d54/d6d/d78/f9a to d2/d2f/d33/fa0 0 2024-04-18T21:07:00.223 INFO:tasks.workunit.client.0.smithi096.stdout:9/541: readlink d0/d28/l99 0 2024-04-18T21:07:00.223 INFO:tasks.workunit.client.0.smithi096.stdout:0/532: read d1/db/d30/f5b [856424,43484] 0 2024-04-18T21:07:00.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/511: dread d1/d17/f5c [0,4194304] 0 2024-04-18T21:07:00.226 INFO:tasks.workunit.client.0.smithi096.stdout:1/569: rename d0/d27/f38 to d0/df/d16/d24/dac/d6a/d8d/d95/fba 0 2024-04-18T21:07:00.226 INFO:tasks.workunit.client.0.smithi096.stdout:9/542: unlink d0/d28/da1/f27 0 2024-04-18T21:07:00.226 INFO:tasks.workunit.client.0.smithi096.stdout:9/543: stat d0/d28/d7a 0 2024-04-18T21:07:00.226 INFO:tasks.workunit.client.0.smithi096.stdout:0/533: getdents d1/db/d30/d4a 0 2024-04-18T21:07:00.226 INFO:tasks.workunit.client.0.smithi096.stdout:4/475: getdents d2/d2f/d33/d55/d59 0 2024-04-18T21:07:00.226 INFO:tasks.workunit.client.0.smithi096.stdout:9/544: stat d0/d8/d11/d1f/da7/d43/d4b/f69 0 2024-04-18T21:07:00.226 INFO:tasks.workunit.client.0.smithi096.stdout:4/476: creat d2/d2a/d54/fa1 x:0 0 0 2024-04-18T21:07:00.227 INFO:tasks.workunit.client.0.smithi096.stdout:0/534: write d1/db/d30/d31/d39/d5d/d60/f3c [4913488,29785] 0 2024-04-18T21:07:00.227 INFO:tasks.workunit.client.0.smithi096.stdout:4/477: mkdir d2/d2a/d84/da2 0 2024-04-18T21:07:00.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/570: link d0/df/d16/d24/dac/f93 d0/df/d16/d24/dac/d6a/d8d/d95/fbb 0 2024-04-18T21:07:00.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/478: getdents d2/d1d 0 2024-04-18T21:07:00.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/479: mkdir d2/d2f/d33/d55/da3 0 2024-04-18T21:07:00.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/480: write d2/d2f/d33/d55/d59/f96 [328380,109242] 0 2024-04-18T21:07:00.231 INFO:tasks.workunit.client.0.smithi096.stdout:4/481: mkdir d2/d2f/d33/d55/d57/d88/da4 0 2024-04-18T21:07:00.231 INFO:tasks.workunit.client.0.smithi096.stdout:9/545: rename d0/d8/d9/f92 to d0/d28/d7a/faa 0 2024-04-18T21:07:00.231 INFO:tasks.workunit.client.0.smithi096.stdout:9/546: mknod d0/d44/cab 0 2024-04-18T21:07:00.232 INFO:tasks.workunit.client.0.smithi096.stdout:4/482: mknod d2/d2f/d39/d98/ca5 0 2024-04-18T21:07:00.232 INFO:tasks.workunit.client.0.smithi096.stdout:1/571: rename d0/df/d16/d24/l67 to d0/d27/d5f/lbc 0 2024-04-18T21:07:00.234 INFO:tasks.workunit.client.0.smithi096.stdout:4/483: write d2/d2f/d33/d55/f6f [85534,125291] 0 2024-04-18T21:07:00.234 INFO:tasks.workunit.client.0.smithi096.stdout:2/680: dread d11/f7e [0,4194304] 0 2024-04-18T21:07:00.234 INFO:tasks.workunit.client.0.smithi096.stdout:9/547: link d0/d8/d11/d1f/da7/d43/d4b/l8d d0/d28/lac 0 2024-04-18T21:07:00.234 INFO:tasks.workunit.client.0.smithi096.stdout:2/681: mkdir d11/d13/d1d/de8 0 2024-04-18T21:07:00.235 INFO:tasks.workunit.client.0.smithi096.stdout:9/548: write d0/d8/d11/d1f/da7/d43/f8e [1052006,22193] 0 2024-04-18T21:07:00.237 INFO:tasks.workunit.client.0.smithi096.stdout:9/549: creat d0/d8/d11/d48/fad x:0 0 0 2024-04-18T21:07:00.238 INFO:tasks.workunit.client.0.smithi096.stdout:9/550: creat d0/d8/fae x:0 0 0 2024-04-18T21:07:00.238 INFO:tasks.workunit.client.0.smithi096.stdout:8/564: dread d0/d3/d1d/d66/d68/d7f/dac/f31 [0,4194304] 0 2024-04-18T21:07:00.239 INFO:tasks.workunit.client.0.smithi096.stdout:9/551: fsync d0/d8/fa5 0 2024-04-18T21:07:00.239 INFO:tasks.workunit.client.0.smithi096.stdout:1/572: dwrite d0/d27/f7c [0,4194304] 0 2024-04-18T21:07:00.240 INFO:tasks.workunit.client.0.smithi096.stdout:8/565: chown d0/d3/d1d/d66/d68/d7f/dac/d56/d2f/c34 27 1 2024-04-18T21:07:00.241 INFO:tasks.workunit.client.0.smithi096.stdout:8/566: chown d0/d3/db/c1a 0 1 2024-04-18T21:07:00.242 INFO:tasks.workunit.client.0.smithi096.stdout:1/573: write d0/df/d16/f54 [1125197,6074] 0 2024-04-18T21:07:00.243 INFO:tasks.workunit.client.0.smithi096.stdout:8/567: write d0/f94 [34879,85011] 0 2024-04-18T21:07:00.243 INFO:tasks.workunit.client.0.smithi096.stdout:1/574: dread - d0/df/d16/d24/dac/d6a/d8d/d95/fbb zero size 2024-04-18T21:07:00.243 INFO:tasks.workunit.client.0.smithi096.stdout:8/568: write d0/f8e [1114553,108983] 0 2024-04-18T21:07:00.245 INFO:tasks.workunit.client.0.smithi096.stdout:1/575: creat d0/df/d16/d24/dac/d6a/d8d/d95/fbd x:0 0 0 2024-04-18T21:07:00.245 INFO:tasks.workunit.client.0.smithi096.stdout:8/569: write d0/d3/d1d/d66/d68/d7f/dac/f31 [2863805,28305] 0 2024-04-18T21:07:00.245 INFO:tasks.workunit.client.0.smithi096.stdout:9/552: dwrite d0/d8/d11/f19 [4194304,4194304] 0 2024-04-18T21:07:00.246 INFO:tasks.workunit.client.0.smithi096.stdout:1/576: truncate d0/df/d16/f55 4946647 0 2024-04-18T21:07:00.246 INFO:tasks.workunit.client.0.smithi096.stdout:9/553: readlink d0/d8/d11/d1f/da7/l73 0 2024-04-18T21:07:00.247 INFO:tasks.workunit.client.0.smithi096.stdout:9/554: rename d0/dc/d5f/f6a to d0/d28/d3d/faf 0 2024-04-18T21:07:00.247 INFO:tasks.workunit.client.0.smithi096.stdout:1/577: creat d0/df/fbe x:0 0 0 2024-04-18T21:07:00.249 INFO:tasks.workunit.client.0.smithi096.stdout:9/555: creat d0/d8/d11/fb0 x:0 0 0 2024-04-18T21:07:00.249 INFO:tasks.workunit.client.0.smithi096.stdout:1/578: creat d0/df/d16/d24/dac/d65/fbf x:0 0 0 2024-04-18T21:07:00.249 INFO:tasks.workunit.client.0.smithi096.stdout:9/556: write d0/d8/d11/d48/f57 [1959417,62294] 0 2024-04-18T21:07:00.249 INFO:tasks.workunit.client.0.smithi096.stdout:1/579: rename d0/d27 to d0/df/d16/d24/dc0 0 2024-04-18T21:07:00.251 INFO:tasks.workunit.client.0.smithi096.stdout:1/580: truncate d0/df/d16/d24/dac/d6a/d8d/d95/fbd 763769 0 2024-04-18T21:07:00.252 INFO:tasks.workunit.client.0.smithi096.stdout:3/476: dread d4/d6/d1b/d2c/d31/f41 [0,4194304] 0 2024-04-18T21:07:00.252 INFO:tasks.workunit.client.0.smithi096.stdout:6/512: dread d1/d5/da/d44/d4e/d52/f54 [0,4194304] 0 2024-04-18T21:07:00.253 INFO:tasks.workunit.client.0.smithi096.stdout:1/581: fsync d0/df/d16/d24/dc0/d5f/d60/fa5 0 2024-04-18T21:07:00.253 INFO:tasks.workunit.client.0.smithi096.stdout:8/570: truncate d0/d3/db/f2d 1629814 0 2024-04-18T21:07:00.253 INFO:tasks.workunit.client.0.smithi096.stdout:7/459: sync 2024-04-18T21:07:00.253 INFO:tasks.workunit.client.0.smithi096.stdout:5/536: sync 2024-04-18T21:07:00.253 INFO:tasks.workunit.client.0.smithi096.stdout:0/535: sync 2024-04-18T21:07:00.254 INFO:tasks.workunit.client.0.smithi096.stdout:1/582: read - d0/df/fbe zero size 2024-04-18T21:07:00.254 INFO:tasks.workunit.client.0.smithi096.stdout:7/460: write d0/d7/f4d [1143056,63029] 0 2024-04-18T21:07:00.254 INFO:tasks.workunit.client.0.smithi096.stdout:5/537: creat d2/d18/d9d/da0/fc7 x:0 0 0 2024-04-18T21:07:00.255 INFO:tasks.workunit.client.0.smithi096.stdout:0/536: link d1/db/d30/f86 d1/db/d30/d4a/d67/fb2 0 2024-04-18T21:07:00.255 INFO:tasks.workunit.client.0.smithi096.stdout:1/583: symlink d0/df/d16/lc1 0 2024-04-18T21:07:00.255 INFO:tasks.workunit.client.0.smithi096.stdout:0/537: readlink d1/db/l4b 0 2024-04-18T21:07:00.256 INFO:tasks.workunit.client.0.smithi096.stdout:1/584: stat d0/df/d16/d24/dc0/f7f 0 2024-04-18T21:07:00.256 INFO:tasks.workunit.client.0.smithi096.stdout:5/538: mknod d2/d11/d28/d64/cc8 0 2024-04-18T21:07:00.256 INFO:tasks.workunit.client.0.smithi096.stdout:9/557: write d0/d8/d11/d1f/f96 [4220119,74059] 0 2024-04-18T21:07:00.258 INFO:tasks.workunit.client.0.smithi096.stdout:5/539: chown d2/d11/d28/d4a/c58 1818 1 2024-04-18T21:07:00.258 INFO:tasks.workunit.client.0.smithi096.stdout:9/558: rmdir d0/d28/d3d 39 2024-04-18T21:07:00.258 INFO:tasks.workunit.client.0.smithi096.stdout:1/585: rename d0/df/d16/l3f to d0/df/d16/d6c/dab/lc2 0 2024-04-18T21:07:00.258 INFO:tasks.workunit.client.0.smithi096.stdout:9/559: stat d0/d8/d11/d39/d63/f83 0 2024-04-18T21:07:00.259 INFO:tasks.workunit.client.0.smithi096.stdout:5/540: creat d2/d18/d9d/da0/dab/fc9 x:0 0 0 2024-04-18T21:07:00.260 INFO:tasks.workunit.client.0.smithi096.stdout:5/541: creat d2/d11/d28/d4a/fca x:0 0 0 2024-04-18T21:07:00.261 INFO:tasks.workunit.client.0.smithi096.stdout:9/560: read d0/d8/d11/f95 [639680,126423] 0 2024-04-18T21:07:00.262 INFO:tasks.workunit.client.0.smithi096.stdout:8/571: dwrite d0/d3/db/f6a [0,4194304] 0 2024-04-18T21:07:00.262 INFO:tasks.workunit.client.0.smithi096.stdout:5/542: mkdir d2/d18/d9d/da0/dcb 0 2024-04-18T21:07:00.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/538: dwrite d1/d23/d32/d7d/f8d [0,4194304] 0 2024-04-18T21:07:00.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/586: write d0/df/d16/d24/dac/d6a/fad [2330591,42320] 0 2024-04-18T21:07:00.269 INFO:tasks.workunit.client.0.smithi096.stdout:0/539: mkdir d1/db/d30/d31/d39/db3 0 2024-04-18T21:07:00.269 INFO:tasks.workunit.client.0.smithi096.stdout:5/543: link d2/d18/c6e d2/d9b/ccc 0 2024-04-18T21:07:00.269 INFO:tasks.workunit.client.0.smithi096.stdout:1/587: mknod d0/df/d16/d24/dac/d6a/d8d/cc3 0 2024-04-18T21:07:00.269 INFO:tasks.workunit.client.0.smithi096.stdout:9/561: getdents d0/d8/d11/d39 0 2024-04-18T21:07:00.269 INFO:tasks.workunit.client.0.smithi096.stdout:1/588: rmdir d0/df/d16/d24 39 2024-04-18T21:07:00.270 INFO:tasks.workunit.client.0.smithi096.stdout:9/562: mknod d0/dc/d5f/cb1 0 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:00.271 INFO:tasks.workunit.client.0.smithi096.stdout:9/563: rmdir d0/d28/d7a 39 2024-04-18T21:07:00.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/589: creat d0/df/d16/d24/dc0/d33/fc4 x:0 0 0 2024-04-18T21:07:00.273 INFO:tasks.workunit.client.0.smithi096.stdout:5/544: link d2/l48 d2/d8f/lcd 0 2024-04-18T21:07:00.273 INFO:tasks.workunit.client.0.smithi096.stdout:3/477: dread d4/d6/d1b/f38 [0,4194304] 0 2024-04-18T21:07:00.273 INFO:tasks.workunit.client.0.smithi096.stdout:5/545: fdatasync f0 0 2024-04-18T21:07:00.273 INFO:tasks.workunit.client.0.smithi096.stdout:9/564: mkdir d0/d28/d66/db2 0 2024-04-18T21:07:00.273 INFO:tasks.workunit.client.0.smithi096.stdout:7/461: dread d0/d7/d8/f1e [0,4194304] 0 2024-04-18T21:07:00.274 INFO:tasks.workunit.client.0.smithi096.stdout:1/590: mknod d0/df/d16/d24/dc0/d33/cc5 0 2024-04-18T21:07:00.274 INFO:tasks.workunit.client.0.smithi096.stdout:7/462: write d0/d7/f48 [838650,51116] 0 2024-04-18T21:07:00.274 INFO:tasks.workunit.client.0.smithi096.stdout:6/513: dread d1/d3a/d57/f9 [0,4194304] 0 2024-04-18T21:07:00.275 INFO:tasks.workunit.client.0.smithi096.stdout:5/546: truncate d2/d8f/fbd 969187 0 2024-04-18T21:07:00.275 INFO:tasks.workunit.client.0.smithi096.stdout:7/463: creat d0/d7/d42/f87 x:0 0 0 2024-04-18T21:07:00.275 INFO:tasks.workunit.client.0.smithi096.stdout:3/478: fsync d4/d6/d1b/d1d/f68 0 2024-04-18T21:07:00.276 INFO:tasks.workunit.client.0.smithi096.stdout:6/514: chown d1/d5/da/c2b 2047401 1 2024-04-18T21:07:00.277 INFO:tasks.workunit.client.0.smithi096.stdout:7/464: symlink d0/d20/d39/d59/l88 0 2024-04-18T21:07:00.278 INFO:tasks.workunit.client.0.smithi096.stdout:6/515: truncate d1/d5/f5d 539609 0 2024-04-18T21:07:00.278 INFO:tasks.workunit.client.0.smithi096.stdout:0/540: dwrite d1/db/d30/d31/d39/f52 [0,4194304] 0 2024-04-18T21:07:00.281 INFO:tasks.workunit.client.0.smithi096.stdout:4/484: sync 2024-04-18T21:07:00.281 INFO:tasks.workunit.client.0.smithi096.stdout:8/572: sync 2024-04-18T21:07:00.281 INFO:tasks.workunit.client.0.smithi096.stdout:6/516: symlink d1/d3a/d57/d26/la2 0 2024-04-18T21:07:00.281 INFO:tasks.workunit.client.0.smithi096.stdout:1/591: dwrite d0/df/f64 [0,4194304] 0 2024-04-18T21:07:00.282 INFO:tasks.workunit.client.0.smithi096.stdout:3/479: dread d4/d6/d1b/d1d/f28 [0,4194304] 0 2024-04-18T21:07:00.282 INFO:tasks.workunit.client.0.smithi096.stdout:8/573: fdatasync d0/d3/d3a/dab/f4b 0 2024-04-18T21:07:00.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/541: mkdir d1/d23/d32/d43/d6f/d8a/d96/db4 0 2024-04-18T21:07:00.283 INFO:tasks.workunit.client.0.smithi096.stdout:6/517: write d1/d3a/f3f [392220,120085] 0 2024-04-18T21:07:00.283 INFO:tasks.workunit.client.0.smithi096.stdout:4/485: mknod d2/d2a/d54/d6d/d78/ca6 0 2024-04-18T21:07:00.284 INFO:tasks.workunit.client.0.smithi096.stdout:0/542: write d1/db/d30/d31/d39/f52 [996302,43315] 0 2024-04-18T21:07:00.285 INFO:tasks.workunit.client.0.smithi096.stdout:4/486: dread - d2/d2f/d39/d43/f83 zero size 2024-04-18T21:07:00.285 INFO:tasks.workunit.client.0.smithi096.stdout:5/547: dwrite d2/d18/d9d/da0/dab/fae [0,4194304] 0 2024-04-18T21:07:00.285 INFO:tasks.workunit.client.0.smithi096.stdout:6/518: write d1/d3a/d57/d26/f29 [3773264,28593] 0 2024-04-18T21:07:00.285 INFO:tasks.workunit.client.0.smithi096.stdout:5/548: sync 2024-04-18T21:07:00.286 INFO:tasks.workunit.client.0.smithi096.stdout:4/487: chown d2/d2a/d54/d5b/c95 53 1 2024-04-18T21:07:00.286 INFO:tasks.workunit.client.0.smithi096.stdout:4/488: fsync d2/d1d/f7e 0 2024-04-18T21:07:00.287 INFO:tasks.workunit.client.0.smithi096.stdout:3/480: truncate d4/d6/d1b/d1d/f28 2074119 0 2024-04-18T21:07:00.288 INFO:tasks.workunit.client.0.smithi096.stdout:5/549: unlink d2/d11/d28/l37 0 2024-04-18T21:07:00.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/519: creat d1/d3a/d57/fa3 x:0 0 0 2024-04-18T21:07:00.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/550: stat d2/d11/d28/d4a/d55/lbc 0 2024-04-18T21:07:00.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/520: fdatasync d1/f4a 0 2024-04-18T21:07:00.291 INFO:tasks.workunit.client.0.smithi096.stdout:1/592: dwrite d0/df/d16/d24/da8/fae [0,4194304] 0 2024-04-18T21:07:00.291 INFO:tasks.workunit.client.0.smithi096.stdout:7/465: truncate d0/fc 2098927 0 2024-04-18T21:07:00.292 INFO:tasks.workunit.client.0.smithi096.stdout:2/682: dread d11/d13/d1a/d1e/d28/d4e/d63/f65 [0,4194304] 0 2024-04-18T21:07:00.293 INFO:tasks.workunit.client.0.smithi096.stdout:1/593: write d0/f49 [1597787,108956] 0 2024-04-18T21:07:00.294 INFO:tasks.workunit.client.0.smithi096.stdout:6/521: symlink d1/d3a/d57/d66/d9b/la4 0 2024-04-18T21:07:00.294 INFO:tasks.workunit.client.0.smithi096.stdout:0/543: dwrite d1/f15 [0,4194304] 0 2024-04-18T21:07:00.294 INFO:tasks.workunit.client.0.smithi096.stdout:1/594: write d0/df/d16/d24/f4a [625433,15661] 0 2024-04-18T21:07:00.296 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:00.297 INFO:tasks.workunit.client.0.smithi096.stdout:4/489: dwrite d2/d1d/d3a/f51 [0,4194304] 0 2024-04-18T21:07:00.297 INFO:tasks.workunit.client.0.smithi096.stdout:6/522: mknod d1/d3a/d57/d26/ca5 0 2024-04-18T21:07:00.298 INFO:tasks.workunit.client.0.smithi096.stdout:0/544: rename d1/db/d30/d4a/d67/f88 to d1/d23/d32/d43/fb5 0 2024-04-18T21:07:00.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/490: creat d2/d2f/d33/d55/da3/fa7 x:0 0 0 2024-04-18T21:07:00.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/491: readlink d2/d1d/l47 0 2024-04-18T21:07:00.299 INFO:tasks.workunit.client.0.smithi096.stdout:6/523: write d1/d5/f15 [4203967,82150] 0 2024-04-18T21:07:00.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/492: chown d2/d2f/d33/d55/d57/d88/da4 32542249 1 2024-04-18T21:07:00.300 INFO:tasks.workunit.client.0.smithi096.stdout:6/524: truncate d1/d5/f15 4399204 0 2024-04-18T21:07:00.301 INFO:tasks.workunit.client.0.smithi096.stdout:6/525: chown d1/d5/da/d44/d4e/f5e 2 1 2024-04-18T21:07:00.302 INFO:tasks.workunit.client.0.smithi096.stdout:2/683: write d11/f39 [773557,119718] 0 2024-04-18T21:07:00.303 INFO:tasks.workunit.client.0.smithi096.stdout:5/551: read d2/fd [536062,121296] 0 2024-04-18T21:07:00.304 INFO:tasks.workunit.client.0.smithi096.stdout:9/565: dread d0/dc/f32 [0,4194304] 0 2024-04-18T21:07:00.304 INFO:tasks.workunit.client.0.smithi096.stdout:2/684: write d11/f61 [178545,109774] 0 2024-04-18T21:07:00.305 INFO:tasks.workunit.client.0.smithi096.stdout:6/526: creat d1/d5/da/d44/d4e/fa6 x:0 0 0 2024-04-18T21:07:00.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/552: read - d2/d11/d28/d4a/d55/fc2 zero size 2024-04-18T21:07:00.305 INFO:tasks.workunit.client.0.smithi096.stdout:7/466: dread d0/d20/f34 [0,4194304] 0 2024-04-18T21:07:00.307 INFO:tasks.workunit.client.0.smithi096.stdout:5/553: creat d2/d8f/fce x:0 0 0 2024-04-18T21:07:00.307 INFO:tasks.workunit.client.0.smithi096.stdout:0/545: dwrite d1/f8e [0,4194304] 0 2024-04-18T21:07:00.307 INFO:tasks.workunit.client.0.smithi096.stdout:7/467: fsync d0/d7/d8/f55 0 2024-04-18T21:07:00.307 INFO:tasks.workunit.client.0.smithi096.stdout:6/527: write d1/d3a/d57/f65 [767851,72176] 0 2024-04-18T21:07:00.308 INFO:tasks.workunit.client.0.smithi096.stdout:4/493: dwrite d2/d2f/d33/f72 [0,4194304] 0 2024-04-18T21:07:00.308 INFO:tasks.workunit.client.0.smithi096.stdout:2/685: creat d11/d13/d1a/d1e/d28/d4e/d89/dc0/fe9 x:0 0 0 2024-04-18T21:07:00.309 INFO:tasks.workunit.client.0.smithi096.stdout:4/494: chown d2/c40 170 1 2024-04-18T21:07:00.310 INFO:tasks.workunit.client.0.smithi096.stdout:0/546: rename d1/db/d25/l53 to d1/da5/lb6 0 2024-04-18T21:07:00.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/528: symlink d1/d5/da/d44/d4e/la7 0 2024-04-18T21:07:00.310 INFO:tasks.workunit.client.0.smithi096.stdout:4/495: fdatasync d2/f31 0 2024-04-18T21:07:00.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/529: sync 2024-04-18T21:07:00.312 INFO:tasks.workunit.client.0.smithi096.stdout:5/554: rename d2/d11/d28/d4a/d55/f76 to d2/d11/d28/d4a/d87/fcf 0 2024-04-18T21:07:00.312 INFO:tasks.workunit.client.0.smithi096.stdout:1/595: truncate d0/df/d16/d24/dac/d6a/d8d/d9b/fb5 960818 0 2024-04-18T21:07:00.312 INFO:tasks.workunit.client.0.smithi096.stdout:2/686: creat d11/d13/d1a/d1e/d28/d4e/d40/dbe/fea x:0 0 0 2024-04-18T21:07:00.312 INFO:tasks.workunit.client.0.smithi096.stdout:6/530: symlink d1/d5/da/d46/d71/la8 0 2024-04-18T21:07:00.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/468: dread d0/d7/d8/f1e [0,4194304] 0 2024-04-18T21:07:00.313 INFO:tasks.workunit.client.0.smithi096.stdout:4/496: write d2/d2f/f5a [1196668,103121] 0 2024-04-18T21:07:00.313 INFO:tasks.workunit.client.0.smithi096.stdout:5/555: creat d2/d18/d9d/da0/fd0 x:0 0 0 2024-04-18T21:07:00.313 INFO:tasks.workunit.client.0.smithi096.stdout:9/566: dwrite d0/d8/d11/d1f/f96 [0,4194304] 0 2024-04-18T21:07:00.314 INFO:tasks.workunit.client.0.smithi096.stdout:1/596: creat d0/df/d16/d6c/dab/fc6 x:0 0 0 2024-04-18T21:07:00.314 INFO:tasks.workunit.client.0.smithi096.stdout:7/469: chown d0/d11/d18/l35 110786009 1 2024-04-18T21:07:00.314 INFO:tasks.workunit.client.0.smithi096.stdout:6/531: creat d1/d3a/d57/d26/fa9 x:0 0 0 2024-04-18T21:07:00.315 INFO:tasks.workunit.client.0.smithi096.stdout:2/687: chown d11/d13/d1a/d1e/d28/d4e/f93 3 1 2024-04-18T21:07:00.315 INFO:tasks.workunit.client.0.smithi096.stdout:4/497: creat d2/d2a/d54/d5b/fa8 x:0 0 0 2024-04-18T21:07:00.315 INFO:tasks.workunit.client.0.smithi096.stdout:9/567: symlink d0/d8/d11/lb3 0 2024-04-18T21:07:00.316 INFO:tasks.workunit.client.0.smithi096.stdout:6/532: rmdir d1/d5/da/d90 39 2024-04-18T21:07:00.316 INFO:tasks.workunit.client.0.smithi096.stdout:9/568: rmdir d0/d28 39 2024-04-18T21:07:00.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/470: getdents d0/d7/d42 0 2024-04-18T21:07:00.317 INFO:tasks.workunit.client.0.smithi096.stdout:6/533: unlink d1/d3a/d57/d26/f75 0 2024-04-18T21:07:00.318 INFO:tasks.workunit.client.0.smithi096.stdout:4/498: rename d2/d2a/d54/d5b/l62 to d2/d2f/d39/d98/la9 0 2024-04-18T21:07:00.318 INFO:tasks.workunit.client.0.smithi096.stdout:1/597: creat d0/df/d16/d24/dac/fc7 x:0 0 0 2024-04-18T21:07:00.318 INFO:tasks.workunit.client.0.smithi096.stdout:7/471: dread - d0/d11/d18/d2e/f79 zero size 2024-04-18T21:07:00.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/534: dread - d1/d5/da/d44/f93 zero size 2024-04-18T21:07:00.320 INFO:tasks.workunit.client.0.smithi096.stdout:9/569: mknod d0/d8/d11/cb4 0 2024-04-18T21:07:00.320 INFO:tasks.workunit.client.0.smithi096.stdout:7/472: rmdir d0/d20 39 2024-04-18T21:07:00.321 INFO:tasks.workunit.client.0.smithi096.stdout:4/499: creat d2/d2f/d33/d55/da3/faa x:0 0 0 2024-04-18T21:07:00.321 INFO:tasks.workunit.client.0.smithi096.stdout:6/535: chown d1/d3a/d57 409 1 2024-04-18T21:07:00.322 INFO:tasks.workunit.client.0.smithi096.stdout:0/547: dwrite d1/d23/d32/d43/fb5 [0,4194304] 0 2024-04-18T21:07:00.322 INFO:tasks.workunit.client.0.smithi096.stdout:5/556: dwrite d2/fd [0,4194304] 0 2024-04-18T21:07:00.322 INFO:tasks.workunit.client.0.smithi096.stdout:7/473: write d0/f1d [2245875,47213] 0 2024-04-18T21:07:00.322 INFO:tasks.workunit.client.0.smithi096.stdout:9/570: write d0/dc/f25 [4834317,17117] 0 2024-04-18T21:07:00.323 INFO:tasks.workunit.client.0.smithi096.stdout:4/500: write d2/d1d/f5e [672599,123812] 0 2024-04-18T21:07:00.324 INFO:tasks.workunit.client.0.smithi096.stdout:8/574: dread d0/d3/d3a/dab/d61/f70 [0,4194304] 0 2024-04-18T21:07:00.325 INFO:tasks.workunit.client.0.smithi096.stdout:2/688: dwrite d11/d13/d1a/d1e/d28/f86 [0,4194304] 0 2024-04-18T21:07:00.325 INFO:tasks.workunit.client.0.smithi096.stdout:2/689: fsync d11/d13/d1a/faf 0 2024-04-18T21:07:00.326 INFO:tasks.workunit.client.0.smithi096.stdout:7/474: creat d0/f89 x:0 0 0 2024-04-18T21:07:00.326 INFO:tasks.workunit.client.0.smithi096.stdout:4/501: symlink d2/d2a/lab 0 2024-04-18T21:07:00.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/475: sync 2024-04-18T21:07:00.327 INFO:tasks.workunit.client.0.smithi096.stdout:2/690: stat d11/d13/d1a/d1e/d28/d4e/d40/d51/f66 0 2024-04-18T21:07:00.327 INFO:tasks.workunit.client.0.smithi096.stdout:4/502: sync 2024-04-18T21:07:00.327 INFO:tasks.workunit.client.0.smithi096.stdout:4/503: sync 2024-04-18T21:07:00.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/476: stat d0/d7/f5f 0 2024-04-18T21:07:00.327 INFO:tasks.workunit.client.0.smithi096.stdout:6/536: symlink d1/d5/da/d44/d4e/laa 0 2024-04-18T21:07:00.328 INFO:tasks.workunit.client.0.smithi096.stdout:6/537: fsync d1/d3a/d36/f6f 0 2024-04-18T21:07:00.328 INFO:tasks.workunit.client.0.smithi096.stdout:4/504: write d2/d2f/d33/d55/d57/f5c [1820760,102517] 0 2024-04-18T21:07:00.328 INFO:tasks.workunit.client.0.smithi096.stdout:8/575: truncate d0/d3/db/d6f/f98 2526335 0 2024-04-18T21:07:00.328 INFO:tasks.workunit.client.0.smithi096.stdout:7/477: chown d0/d7 36835829 1 2024-04-18T21:07:00.328 INFO:tasks.workunit.client.0.smithi096.stdout:2/691: mkdir d11/d50/d5b/dcb/deb 0 2024-04-18T21:07:00.329 INFO:tasks.workunit.client.0.smithi096.stdout:6/538: symlink d1/d3a/d57/d66/d9b/d9f/lab 0 2024-04-18T21:07:00.329 INFO:tasks.workunit.client.0.smithi096.stdout:2/692: write d11/d13/d1a/d1e/d28/d4e/f93 [170690,20825] 0 2024-04-18T21:07:00.329 INFO:tasks.workunit.client.0.smithi096.stdout:4/505: link d2/f1f d2/d2f/fac 0 2024-04-18T21:07:00.330 INFO:tasks.workunit.client.0.smithi096.stdout:4/506: readlink d2/d1d/d3a/l6b 0 2024-04-18T21:07:00.331 INFO:tasks.workunit.client.0.smithi096.stdout:6/539: symlink d1/d17/lac 0 2024-04-18T21:07:00.332 INFO:tasks.workunit.client.0.smithi096.stdout:2/693: creat d11/d50/d5b/fec x:0 0 0 2024-04-18T21:07:00.332 INFO:tasks.workunit.client.0.smithi096.stdout:8/576: write d0/d3/d1d/d66/d68/d7f/dac/d33/f59 [990980,63573] 0 2024-04-18T21:07:00.332 INFO:tasks.workunit.client.0.smithi096.stdout:4/507: mkdir d2/d2a/d54/d71/d99/dad 0 2024-04-18T21:07:00.333 INFO:tasks.workunit.client.0.smithi096.stdout:4/508: creat d2/d1d/fae x:0 0 0 2024-04-18T21:07:00.333 INFO:tasks.workunit.client.0.smithi096.stdout:6/540: mknod d1/d3a/d57/d66/d9b/cad 0 2024-04-18T21:07:00.333 INFO:tasks.workunit.client.0.smithi096.stdout:2/694: rmdir d11/d13/d1a/d1e/d28/d4e/d40 39 2024-04-18T21:07:00.333 INFO:tasks.workunit.client.0.smithi096.stdout:8/577: creat d0/d3/d1d/d66/d68/d7f/dac/d33/db4/fbc x:0 0 0 2024-04-18T21:07:00.334 INFO:tasks.workunit.client.0.smithi096.stdout:8/578: fdatasync d0/d3/d3a/f75 0 2024-04-18T21:07:00.334 INFO:tasks.workunit.client.0.smithi096.stdout:6/541: unlink d1/d3a/d57/d26/f29 0 2024-04-18T21:07:00.334 INFO:tasks.workunit.client.0.smithi096.stdout:2/695: rename d11/d50/d5b/fa9 to d11/d50/d8e/fed 0 2024-04-18T21:07:00.335 INFO:tasks.workunit.client.0.smithi096.stdout:2/696: sync 2024-04-18T21:07:00.335 INFO:tasks.workunit.client.0.smithi096.stdout:8/579: write d0/d3/fb2 [4402800,97015] 0 2024-04-18T21:07:00.335 INFO:tasks.workunit.client.0.smithi096.stdout:2/697: dread - d11/d13/f32 zero size 2024-04-18T21:07:00.335 INFO:tasks.workunit.client.0.smithi096.stdout:2/698: rmdir d11/d50/d8e 39 2024-04-18T21:07:00.335 INFO:tasks.workunit.client.0.smithi096.stdout:8/580: write d0/d3/db/f45 [1523178,48040] 0 2024-04-18T21:07:00.337 INFO:tasks.workunit.client.0.smithi096.stdout:2/699: fdatasync d11/d13/d1a/d1e/d28/d4e/d40/f4c 0 2024-04-18T21:07:00.337 INFO:tasks.workunit.client.0.smithi096.stdout:5/557: write d2/f79 [199487,26266] 0 2024-04-18T21:07:00.338 INFO:tasks.workunit.client.0.smithi096.stdout:0/548: truncate d1/d23/d32/d43/fb5 468699 0 2024-04-18T21:07:00.340 INFO:tasks.workunit.client.0.smithi096.stdout:2/700: dread - d11/d13/d1a/d1e/d28/d4e/d5c/fb5 zero size 2024-04-18T21:07:00.340 INFO:tasks.workunit.client.0.smithi096.stdout:8/581: link d0/d3/d3a/d81/l79 d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d9d/lbd 0 2024-04-18T21:07:00.341 INFO:tasks.workunit.client.0.smithi096.stdout:4/509: dwrite d2/f38 [0,4194304] 0 2024-04-18T21:07:00.341 INFO:tasks.workunit.client.0.smithi096.stdout:5/558: getdents d2/d18/d61/d6f 0 2024-04-18T21:07:00.342 INFO:tasks.workunit.client.0.smithi096.stdout:4/510: creat d2/d1d/faf x:0 0 0 2024-04-18T21:07:00.342 INFO:tasks.workunit.client.0.smithi096.stdout:6/542: dwrite d1/d17/f2f [0,4194304] 0 2024-04-18T21:07:00.343 INFO:tasks.workunit.client.0.smithi096.stdout:5/559: fsync d2/d11/d28/d4a/d87/f90 0 2024-04-18T21:07:00.343 INFO:tasks.workunit.client.0.smithi096.stdout:9/571: dwrite d0/dc/f26 [0,4194304] 0 2024-04-18T21:07:00.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/511: stat d2/d2a/d54/d71/f76 0 2024-04-18T21:07:00.344 INFO:tasks.workunit.client.0.smithi096.stdout:5/560: truncate d2/f3a 4833412 0 2024-04-18T21:07:00.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/512: readlink d2/d2a/d54/d5b/l9d 0 2024-04-18T21:07:00.344 INFO:tasks.workunit.client.0.smithi096.stdout:7/478: truncate d0/d20/d39/f61 1499334 0 2024-04-18T21:07:00.345 INFO:tasks.workunit.client.0.smithi096.stdout:2/701: creat d11/d13/d1a/d1e/d28/d4e/d40/dbe/fee x:0 0 0 2024-04-18T21:07:00.346 INFO:tasks.workunit.client.0.smithi096.stdout:8/582: rename d0/d3/d3a/dab/d46/c85 to d0/d3/d1d/d83/cbe 0 2024-04-18T21:07:00.346 INFO:tasks.workunit.client.0.smithi096.stdout:6/543: rename d1/d3a/d36/f6a to d1/d3a/d36/fae 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi096.stdout:4/513: truncate d2/d1d/fb 1821534 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi096.stdout:7/479: mkdir d0/d20/d39/d8a 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi096.stdout:5/561: creat d2/d18/fd1 x:0 0 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi096.stdout:9/572: chown d0/d28/c35 2 1 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi096.stdout:2/702: fdatasync d11/d13/d1a/d1e/d28/d4e/d5c/fb5 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi096.stdout:6/544: dread - d1/d5/da/d55/f6c zero size 2024-04-18T21:07:00.348 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:00.347+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi096.stdout:8/583: mknod d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/cbf 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi096.stdout:4/514: write d2/d2f/d33/d55/f6f [616588,34717] 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi096.stdout:5/562: dread - d2/d18/d61/d6f/f95 zero size 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi096.stdout:0/549: truncate d1/d23/d32/d43/fb5 478050 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi096.stdout:7/480: symlink d0/d20/d39/d8a/l8b 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi096.stdout:4/515: chown d2/f50 908 1 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi096.stdout:5/563: stat d2/f7 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi096.stdout:0/550: creat d1/db/d79/d7e/fb7 x:0 0 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi096.stdout:8/584: mknod d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d9d/cc0 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi096.stdout:6/545: creat d1/d3a/d57/faf x:0 0 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi096.stdout:9/573: symlink d0/d8/d11/d1f/da7/d43/d4b/da3/lb5 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi096.stdout:2/703: truncate d11/d13/d1a/d1e/d28/fb1 681266 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi096.stdout:5/564: chown d2/lc3 27 1 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi096.stdout:8/585: sync 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi096.stdout:3/481: dread d4/d6/d1b/d1d/f2e [0,4194304] 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi096.stdout:0/551: mknod d1/db/d30/d31/d85/cb8 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi096.stdout:2/704: write d11/d13/d1a/d1e/d28/d4e/d40/dbe/fee [701998,94624] 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi096.stdout:3/482: symlink d4/d6/d1b/d1d/d64/l8d 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi096.stdout:4/516: mkdir d2/d2f/d39/d61/db0 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi096.stdout:8/586: stat d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/c58 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi096.stdout:6/546: rename d1/d17/f18 to d1/d3a/d57/d66/d9b/d9f/fb0 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi096.stdout:0/552: mknod d1/d23/d32/d7d/cb9 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi096.stdout:9/574: read d0/f34 [4260985,96406] 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi096.stdout:2/705: readlink d11/d13/d1a/d1e/d28/d4e/l58 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi096.stdout:6/547: creat d1/d61/d91/fb1 x:0 0 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi096.stdout:3/483: write d4/d6/d1b/d1d/f2e [959148,27135] 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi096.stdout:2/706: rmdir d11/d13 39 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi096.stdout:8/587: rmdir d0/d3/d1d/d66/d68/d7f/dac/d56/d2f 39 2024-04-18T21:07:00.356 INFO:tasks.workunit.client.0.smithi096.stdout:3/484: symlink d4/d6/d22/d20/l8e 0 2024-04-18T21:07:00.356 INFO:tasks.workunit.client.0.smithi096.stdout:2/707: creat d11/d13/d1a/d1e/d28/d4e/d80/fef x:0 0 0 2024-04-18T21:07:00.357 INFO:tasks.workunit.client.0.smithi096.stdout:7/481: dwrite d0/d20/d39/f4c [0,4194304] 0 2024-04-18T21:07:00.357 INFO:tasks.workunit.client.0.smithi096.stdout:9/575: read d0/d28/d3d/faf [3778322,128861] 0 2024-04-18T21:07:00.358 INFO:tasks.workunit.client.0.smithi096.stdout:3/485: symlink d4/d6/l8f 0 2024-04-18T21:07:00.359 INFO:tasks.workunit.client.0.smithi096.stdout:9/576: write d0/d8/d11/f82 [94055,99269] 0 2024-04-18T21:07:00.359 INFO:tasks.workunit.client.0.smithi096.stdout:7/482: creat d0/d7/d2f/f8c x:0 0 0 2024-04-18T21:07:00.359 INFO:tasks.workunit.client.0.smithi096.stdout:2/708: symlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/lf0 0 2024-04-18T21:07:00.359 INFO:tasks.workunit.client.0.smithi096.stdout:3/486: mkdir d4/d6/d7/d90 0 2024-04-18T21:07:00.359 INFO:tasks.workunit.client.0.smithi096.stdout:9/577: write d0/d8/d11/fb0 [430057,80751] 0 2024-04-18T21:07:00.360 INFO:tasks.workunit.client.0.smithi096.stdout:7/483: chown d0/d7/c33 44157 1 2024-04-18T21:07:00.360 INFO:tasks.workunit.client.0.smithi096.stdout:7/484: fdatasync d0/f52 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi096.stdout:7/485: symlink d0/d7/d2f/l8d 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi096.stdout:3/487: getdents d4/d6/d1b/d2c/d6b 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi096.stdout:0/553: rename d1/db/d79 to d1/d23/d32/d43/d6f/d8a/d91/dba 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi096.stdout:2/709: getdents d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d94 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi096.stdout:3/488: creat d4/d6/d1b/d2c/d5c/f91 x:0 0 0 2024-04-18T21:07:00.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:00.364 INFO:tasks.workunit.client.0.smithi096.stdout:7/486: link d0/d20/d4b/c70 d0/d20/d39/d8a/c8e 0 2024-04-18T21:07:00.364 INFO:tasks.workunit.client.0.smithi096.stdout:3/489: chown d4/d6/d1b/d2c/d31/d85 790839978 1 2024-04-18T21:07:00.365 INFO:tasks.workunit.client.0.smithi096.stdout:7/487: chown d0/d7/d8/c7c 1732101 1 2024-04-18T21:07:00.366 INFO:tasks.workunit.client.0.smithi096.stdout:0/554: creat d1/db/d30/d31/d39/fbb x:0 0 0 2024-04-18T21:07:00.366 INFO:tasks.workunit.client.0.smithi096.stdout:7/488: mkdir d0/d11/d18/d8f 0 2024-04-18T21:07:00.366 INFO:tasks.workunit.client.0.smithi096.stdout:3/490: write d4/d6/d1b/d2c/d31/f41 [7392328,45195] 0 2024-04-18T21:07:00.368 INFO:tasks.workunit.client.0.smithi096.stdout:9/578: dwrite d0/d28/d3d/f54 [0,4194304] 0 2024-04-18T21:07:00.368 INFO:tasks.workunit.client.0.smithi096.stdout:0/555: fsync d1/db/d30/f5c 0 2024-04-18T21:07:00.368 INFO:tasks.workunit.client.0.smithi096.stdout:8/588: dread d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi096.stdout:9/579: rename d0/d8/d11/cb4 to d0/d8/d9/cb6 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi096.stdout:2/710: dwrite d11/f39 [0,4194304] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi096.stdout:3/491: creat d4/d6/f92 x:0 0 0 2024-04-18T21:07:00.373 INFO:tasks.workunit.client.0.smithi096.stdout:0/556: mknod d1/d23/d32/d43/d6f/d8a/d96/cbc 0 2024-04-18T21:07:00.374 INFO:tasks.workunit.client.0.smithi096.stdout:9/580: creat d0/d8/d9/fb7 x:0 0 0 2024-04-18T21:07:00.375 INFO:tasks.workunit.client.0.smithi096.stdout:1/598: dread d0/f7 [0,4194304] 0 2024-04-18T21:07:00.375 INFO:tasks.workunit.client.0.smithi096.stdout:2/711: write d11/d13/d1a/d1e/d28/d4e/d63/f9b [466914,69091] 0 2024-04-18T21:07:00.376 INFO:tasks.workunit.client.0.smithi096.stdout:9/581: unlink d0/dc/f25 0 2024-04-18T21:07:00.377 INFO:tasks.workunit.client.0.smithi096.stdout:2/712: readlink d11/d13/d1a/le2 0 2024-04-18T21:07:00.378 INFO:tasks.workunit.client.0.smithi096.stdout:7/489: dwrite d0/fc [0,4194304] 0 2024-04-18T21:07:00.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/589: dwrite d0/d3/d1d/f24 [0,4194304] 0 2024-04-18T21:07:00.378 INFO:tasks.workunit.client.0.smithi096.stdout:9/582: chown d0/d8/d11/d1f/da7/c9f 0 1 2024-04-18T21:07:00.379 INFO:tasks.workunit.client.0.smithi096.stdout:7/490: chown d0/d20/d4b/f86 233 1 2024-04-18T21:07:00.381 INFO:tasks.workunit.client.0.smithi096.stdout:1/599: mkdir d0/df/d16/d6c/dc8 0 2024-04-18T21:07:00.381 INFO:tasks.workunit.client.0.smithi096.stdout:9/583: mknod d0/d8/d11/cb8 0 2024-04-18T21:07:00.381 INFO:tasks.workunit.client.0.smithi096.stdout:0/557: dwrite d1/db/d30/f5b [0,4194304] 0 2024-04-18T21:07:00.382 INFO:tasks.workunit.client.0.smithi096.stdout:7/491: creat d0/d7/f90 x:0 0 0 2024-04-18T21:07:00.382 INFO:tasks.workunit.client.0.smithi096.stdout:9/584: chown d0/d8/l50 37656 1 2024-04-18T21:07:00.383 INFO:tasks.workunit.client.0.smithi096.stdout:0/558: fdatasync d1/d23/d32/d43/d6f/d8a/d96/fa9 0 2024-04-18T21:07:00.383 INFO:tasks.workunit.client.0.smithi096.stdout:1/600: creat d0/df/d16/fc9 x:0 0 0 2024-04-18T21:07:00.383 INFO:tasks.workunit.client.0.smithi096.stdout:9/585: creat d0/d8/d9/fb9 x:0 0 0 2024-04-18T21:07:00.383 INFO:tasks.workunit.client.0.smithi096.stdout:1/601: fdatasync d0/f4 0 2024-04-18T21:07:00.384 INFO:tasks.workunit.client.0.smithi096.stdout:9/586: chown d0/dc/d5f/f94 765208 1 2024-04-18T21:07:00.385 INFO:tasks.workunit.client.0.smithi096.stdout:1/602: mkdir d0/df/d16/d24/dac/d6a/d8d/d9b/dca 0 2024-04-18T21:07:00.385 INFO:tasks.workunit.client.0.smithi096.stdout:9/587: creat d0/d8/d11/d39/d63/fba x:0 0 0 2024-04-18T21:07:00.385 INFO:tasks.workunit.client.0.smithi096.stdout:9/588: mknod d0/dc/cbb 0 2024-04-18T21:07:00.386 INFO:tasks.workunit.client.0.smithi096.stdout:1/603: unlink d0/df/d16/d24/dc0/d5f/d60/l7a 0 2024-04-18T21:07:00.386 INFO:tasks.workunit.client.0.smithi096.stdout:9/589: dread - d0/dc/d5f/f97 zero size 2024-04-18T21:07:00.387 INFO:tasks.workunit.client.0.smithi096.stdout:1/604: write d0/df/d16/d24/dac/d6a/fad [3182977,59173] 0 2024-04-18T21:07:00.388 INFO:tasks.workunit.client.0.smithi096.stdout:5/565: dread d2/f2b [0,4194304] 0 2024-04-18T21:07:00.388 INFO:tasks.workunit.client.0.smithi096.stdout:9/590: mknod d0/d8/d11/cbc 0 2024-04-18T21:07:00.390 INFO:tasks.workunit.client.0.smithi096.stdout:5/566: rename d2/d11/d28/d4a/d87/da7/lc1 to d2/d11/d28/d4a/d55/d81/dbe/ld2 0 2024-04-18T21:07:00.394 INFO:tasks.workunit.client.0.smithi096.stdout:9/591: dwrite d0/d8/d11/d48/f7e [0,4194304] 0 2024-04-18T21:07:00.396 INFO:tasks.workunit.client.0.smithi096.stdout:9/592: mknod d0/d28/cbd 0 2024-04-18T21:07:00.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/567: dwrite d2/d11/d28/d4a/fca [0,4194304] 0 2024-04-18T21:07:00.399 INFO:tasks.workunit.client.0.smithi096.stdout:9/593: creat d0/d8/d11/d1f/da7/d43/d4b/da3/fbe x:0 0 0 2024-04-18T21:07:00.400 INFO:tasks.workunit.client.0.smithi096.stdout:9/594: chown d0/d28/da1/f29 21 1 2024-04-18T21:07:00.400 INFO:tasks.workunit.client.0.smithi096.stdout:9/595: stat d0/d8/l50 0 2024-04-18T21:07:00.402 INFO:tasks.workunit.client.0.smithi096.stdout:9/596: symlink d0/d8/d11/d48/lbf 0 2024-04-18T21:07:00.402 INFO:tasks.workunit.client.0.smithi096.stdout:9/597: readlink d0/d8/l33 0 2024-04-18T21:07:00.402 INFO:tasks.workunit.client.0.smithi096.stdout:9/598: creat d0/fc0 x:0 0 0 2024-04-18T21:07:00.403 INFO:tasks.workunit.client.0.smithi096.stdout:9/599: read d0/d8/d11/d1f/f96 [299077,29266] 0 2024-04-18T21:07:00.404 INFO:tasks.workunit.client.0.smithi096.stdout:9/600: read - d0/d8/d11/d39/d63/f8c zero size 2024-04-18T21:07:00.404 INFO:tasks.workunit.client.0.smithi096.stdout:9/601: mkdir d0/dc/d5f/d76/dc1 0 2024-04-18T21:07:00.405 INFO:tasks.workunit.client.0.smithi096.stdout:9/602: dread d0/d8/d11/d48/f67 [0,4194304] 0 2024-04-18T21:07:00.406 INFO:tasks.workunit.client.0.smithi096.stdout:9/603: creat d0/d8/fc2 x:0 0 0 2024-04-18T21:07:00.407 INFO:tasks.workunit.client.0.smithi096.stdout:9/604: write d0/d8/d11/d48/f7e [4405787,19162] 0 2024-04-18T21:07:00.407 INFO:tasks.workunit.client.0.smithi096.stdout:9/605: readlink d0/d8/d11/l37 0 2024-04-18T21:07:00.410 INFO:tasks.workunit.client.0.smithi096.stdout:9/606: rename d0/d8/d11/d1f/da7 to d0/d28/d7a/dc3 0 2024-04-18T21:07:00.410 INFO:tasks.workunit.client.0.smithi096.stdout:1/605: dread d0/df/d62/f83 [0,4194304] 0 2024-04-18T21:07:00.410 INFO:tasks.workunit.client.0.smithi096.stdout:9/607: unlink d0/f5 0 2024-04-18T21:07:00.411 INFO:tasks.workunit.client.0.smithi096.stdout:9/608: chown d0/d28/d7a/f9c 43661 1 2024-04-18T21:07:00.412 INFO:tasks.workunit.client.0.smithi096.stdout:9/609: mknod d0/d44/cc4 0 2024-04-18T21:07:00.413 INFO:tasks.workunit.client.0.smithi096.stdout:9/610: write d0/d8/d11/f9d [182027,39559] 0 2024-04-18T21:07:00.413 INFO:tasks.workunit.client.0.smithi096.stdout:9/611: symlink d0/d8/d11/lc5 0 2024-04-18T21:07:00.414 INFO:tasks.workunit.client.0.smithi096.stdout:9/612: fdatasync d0/d8/d11/f38 0 2024-04-18T21:07:00.414 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:00.413+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:00.417 INFO:tasks.workunit.client.0.smithi096.stdout:1/606: dwrite d0/df/d16/d24/dac/d6a/fad [0,4194304] 0 2024-04-18T21:07:00.421 INFO:tasks.workunit.client.0.smithi096.stdout:4/517: dread d2/f31 [0,4194304] 0 2024-04-18T21:07:00.421 INFO:tasks.workunit.client.0.smithi096.stdout:2/713: dread d11/d50/f83 [0,4194304] 0 2024-04-18T21:07:00.422 INFO:tasks.workunit.client.0.smithi096.stdout:2/714: readlink d11/d13/d1a/l3c 0 2024-04-18T21:07:00.422 INFO:tasks.workunit.client.0.smithi096.stdout:4/518: readlink d2/d2f/d39/d98/la9 0 2024-04-18T21:07:00.423 INFO:tasks.workunit.client.0.smithi096.stdout:3/492: dread d4/d6/d1b/d1d/f68 [0,4194304] 0 2024-04-18T21:07:00.424 INFO:tasks.workunit.client.0.smithi096.stdout:4/519: creat d2/d2f/fb1 x:0 0 0 2024-04-18T21:07:00.425 INFO:tasks.workunit.client.0.smithi096.stdout:4/520: chown d2/d2a 5965729 1 2024-04-18T21:07:00.426 INFO:tasks.workunit.client.0.smithi096.stdout:8/590: dread d0/d3/d3a/dab/f44 [0,4194304] 0 2024-04-18T21:07:00.426 INFO:tasks.workunit.client.0.smithi096.stdout:1/607: dwrite d0/df/d16/d24/dac/d6a/d8d/d95/fbb [0,4194304] 0 2024-04-18T21:07:00.426 INFO:tasks.workunit.client.0.smithi096.stdout:3/493: mkdir d4/d6/d1b/d2c/d31/d93 0 2024-04-18T21:07:00.426 INFO:tasks.workunit.client.0.smithi096.stdout:4/521: dread - d2/d2f/d33/d55/da3/faa zero size 2024-04-18T21:07:00.427 INFO:tasks.workunit.client.0.smithi096.stdout:8/591: write d0/d3/fb2 [538641,35291] 0 2024-04-18T21:07:00.427 INFO:tasks.workunit.client.0.smithi096.stdout:1/608: readlink d0/df/d16/d24/dc0/d33/l5e 0 2024-04-18T21:07:00.427 INFO:tasks.workunit.client.0.smithi096.stdout:4/522: stat d2/d2f/d33/d55/d59/f96 0 2024-04-18T21:07:00.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/494: write d4/d6/d1b/d1d/f2e [3532856,124076] 0 2024-04-18T21:07:00.428 INFO:tasks.workunit.client.0.smithi096.stdout:2/715: write d11/d13/d1a/d1e/d28/d4e/f3d [3031787,97665] 0 2024-04-18T21:07:00.428 INFO:tasks.workunit.client.0.smithi096.stdout:8/592: mknod d0/d3/db/d6f/cc1 0 2024-04-18T21:07:00.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/495: chown d4/d6/c3c 0 1 2024-04-18T21:07:00.429 INFO:tasks.workunit.client.0.smithi096.stdout:8/593: chown d0/d3/d1d/c22 15764 1 2024-04-18T21:07:00.429 INFO:tasks.workunit.client.0.smithi096.stdout:3/496: truncate d4/d6/d1b/d1d/f7a 269750 0 2024-04-18T21:07:00.430 INFO:tasks.workunit.client.0.smithi096.stdout:4/523: link d2/l22 d2/d2f/d33/d55/lb2 0 2024-04-18T21:07:00.431 INFO:tasks.workunit.client.0.smithi096.stdout:3/497: fsync d4/d6/d1b/d1d/f7a 0 2024-04-18T21:07:00.433 INFO:tasks.workunit.client.0.smithi096.stdout:4/524: creat d2/d2f/d39/fb3 x:0 0 0 2024-04-18T21:07:00.435 INFO:tasks.workunit.client.0.smithi096.stdout:4/525: truncate d2/d2f/d39/fb3 1016607 0 2024-04-18T21:07:00.436 INFO:tasks.workunit.client.0.smithi096.stdout:1/609: dwrite d0/df/d16/d24/dc0/f7c [4194304,4194304] 0 2024-04-18T21:07:00.436 INFO:tasks.workunit.client.0.smithi096.stdout:4/526: chown d2/d1d/c23 423341 1 2024-04-18T21:07:00.437 INFO:tasks.workunit.client.0.smithi096.stdout:2/716: dwrite fe [0,4194304] 0 2024-04-18T21:07:00.438 INFO:tasks.workunit.client.0.smithi096.stdout:6/548: dread d1/d5/da/d44/d4e/f59 [0,4194304] 0 2024-04-18T21:07:00.439 INFO:tasks.workunit.client.0.smithi096.stdout:1/610: symlink d0/df/d16/d24/dac/d65/lcb 0 2024-04-18T21:07:00.439 INFO:tasks.workunit.client.0.smithi096.stdout:2/717: dread - d11/d13/d1a/d1e/d28/d4e/d40/dbe/fea zero size 2024-04-18T21:07:00.440 INFO:tasks.workunit.client.0.smithi096.stdout:4/527: write d2/d1d/d3a/f52 [992087,1297] 0 2024-04-18T21:07:00.440 INFO:tasks.workunit.client.0.smithi096.stdout:3/498: dwrite d4/d6/d1b/d2c/d31/d11/f55 [0,4194304] 0 2024-04-18T21:07:00.441 INFO:tasks.workunit.client.0.smithi096.stdout:4/528: write d2/d1d/d3a/f52 [3169640,65630] 0 2024-04-18T21:07:00.443 INFO:tasks.workunit.client.0.smithi096.stdout:1/611: chown d0/df/d16/d24/dac/d65/fbf 0 1 2024-04-18T21:07:00.444 INFO:tasks.workunit.client.0.smithi096.stdout:8/594: write d0/d3/db/d6f/f98 [2312061,101000] 0 2024-04-18T21:07:00.445 INFO:tasks.workunit.client.0.smithi096.stdout:3/499: fsync d4/d6/d1b/d2c/d5c/f80 0 2024-04-18T21:07:00.446 INFO:tasks.workunit.client.0.smithi096.stdout:8/595: chown d0/d3/d1d/d66/d68/d7f/dac/d33/db4 1 1 2024-04-18T21:07:00.446 INFO:tasks.workunit.client.0.smithi096.stdout:6/549: dwrite d1/d5/da/d46/d71/d7c/f8f [0,4194304] 0 2024-04-18T21:07:00.446 INFO:tasks.workunit.client.0.smithi096.stdout:3/500: write d4/d6/d22/d20/f76 [533751,84616] 0 2024-04-18T21:07:00.447 INFO:tasks.workunit.client.0.smithi096.stdout:7/492: dread d0/d7/d8/f16 [0,4194304] 0 2024-04-18T21:07:00.448 INFO:tasks.workunit.client.0.smithi096.stdout:7/493: creat d0/d20/d4b/f91 x:0 0 0 2024-04-18T21:07:00.448 INFO:tasks.workunit.client.0.smithi096.stdout:6/550: rename d1/d5/da/d44/f68 to d1/d3a/d36/d7a/fb2 0 2024-04-18T21:07:00.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/494: creat d0/d7/d2f/d53/f92 x:0 0 0 2024-04-18T21:07:00.449 INFO:tasks.workunit.client.0.smithi096.stdout:6/551: symlink d1/d5/da/d46/d71/d7c/d8b/lb3 0 2024-04-18T21:07:00.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/495: readlink d0/d7/d49/l83 0 2024-04-18T21:07:00.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/496: chown d0/d20/d62/d7d 210270580 1 2024-04-18T21:07:00.450 INFO:tasks.workunit.client.0.smithi096.stdout:7/497: rename d0/d20/l7a to d0/d7/d2f/l93 0 2024-04-18T21:07:00.451 INFO:tasks.workunit.client.0.smithi096.stdout:7/498: creat d0/d7/d8/f94 x:0 0 0 2024-04-18T21:07:00.452 INFO:tasks.workunit.client.0.smithi096.stdout:7/499: readlink d0/d7/d2f/d63/l78 0 2024-04-18T21:07:00.453 INFO:tasks.workunit.client.0.smithi096.stdout:7/500: creat d0/d20/d39/d8a/f95 x:0 0 0 2024-04-18T21:07:00.453 INFO:tasks.workunit.client.0.smithi096.stdout:7/501: stat d0/d7/d42/f74 0 2024-04-18T21:07:00.454 INFO:tasks.workunit.client.0.smithi096.stdout:7/502: write d0/d7/d8/f94 [605705,3662] 0 2024-04-18T21:07:00.455 INFO:tasks.workunit.client.0.smithi096.stdout:7/503: dread - d0/d20/d39/f64 zero size 2024-04-18T21:07:00.456 INFO:tasks.workunit.client.0.smithi096.stdout:7/504: getdents d0/d7/d2f/d63 0 2024-04-18T21:07:00.457 INFO:tasks.workunit.client.0.smithi096.stdout:0/559: dread d1/db/d30/d31/d85/f16 [4194304,4194304] 0 2024-04-18T21:07:00.457 INFO:tasks.workunit.client.0.smithi096.stdout:3/501: dread d4/d6/d1b/d2c/d31/d11/f5b [0,4194304] 0 2024-04-18T21:07:00.457 INFO:tasks.workunit.client.0.smithi096.stdout:2/718: read d11/d13/d1a/d1e/d28/d4e/d80/f95 [681769,86841] 0 2024-04-18T21:07:00.457 INFO:tasks.workunit.client.0.smithi096.stdout:7/505: chown d0/c3b 10063456 1 2024-04-18T21:07:00.458 INFO:tasks.workunit.client.0.smithi096.stdout:0/560: mkdir d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd 0 2024-04-18T21:07:00.458 INFO:tasks.workunit.client.0.smithi096.stdout:7/506: creat d0/d11/d18/d8f/f96 x:0 0 0 2024-04-18T21:07:00.458 INFO:tasks.workunit.client.0.smithi096.stdout:2/719: symlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/lf1 0 2024-04-18T21:07:00.459 INFO:tasks.workunit.client.0.smithi096.stdout:0/561: symlink d1/db/d30/d31/d65/lbe 0 2024-04-18T21:07:00.459 INFO:tasks.workunit.client.0.smithi096.stdout:7/507: rmdir d0/d20 39 2024-04-18T21:07:00.459 INFO:tasks.workunit.client.0.smithi096.stdout:7/508: truncate d0/d11/f72 977452 0 2024-04-18T21:07:00.460 INFO:tasks.workunit.client.0.smithi096.stdout:2/720: truncate d11/d13/d1a/d1e/d28/d4e/d40/d51/f66 277310 0 2024-04-18T21:07:00.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/721: creat d11/d13/d1a/d1e/d28/d4e/d80/ff2 x:0 0 0 2024-04-18T21:07:00.465 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:00.465 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:00.465 INFO:tasks.workunit.client.0.smithi096.stdout:8/596: truncate d0/d3/d1d/d66/d68/fa0 2115082 0 2024-04-18T21:07:00.467 INFO:tasks.workunit.client.0.smithi096.stdout:2/722: dread d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f78 [0,4194304] 0 2024-04-18T21:07:00.468 INFO:tasks.workunit.client.0.smithi096.stdout:2/723: creat d11/d13/d1a/d1e/ff3 x:0 0 0 2024-04-18T21:07:00.469 INFO:tasks.workunit.client.0.smithi096.stdout:6/552: truncate d1/d17/f5c 338386 0 2024-04-18T21:07:00.469 INFO:tasks.workunit.client.0.smithi096.stdout:8/597: dread d0/d3/d3a/dab/f44 [0,4194304] 0 2024-04-18T21:07:00.471 INFO:tasks.workunit.client.0.smithi096.stdout:6/553: creat d1/d5/da/d44/d4e/d52/fb4 x:0 0 0 2024-04-18T21:07:00.473 INFO:tasks.workunit.client.0.smithi096.stdout:0/562: dread d1/db/d30/d31/d65/f94 [0,4194304] 0 2024-04-18T21:07:00.475 INFO:tasks.workunit.client.0.smithi096.stdout:7/509: dwrite d0/d7/d8/f26 [0,4194304] 0 2024-04-18T21:07:00.476 INFO:tasks.workunit.client.0.smithi096.stdout:7/510: chown d0/d7/l6e 27665 1 2024-04-18T21:07:00.476 INFO:tasks.workunit.client.0.smithi096.stdout:4/529: dread d2/f2c [0,4194304] 0 2024-04-18T21:07:00.476 INFO:tasks.workunit.client.0.smithi096.stdout:4/530: fdatasync d2/f21 0 2024-04-18T21:07:00.478 INFO:tasks.workunit.client.0.smithi096.stdout:6/554: mkdir d1/d5/da/d90/db5 0 2024-04-18T21:07:00.479 INFO:tasks.workunit.client.0.smithi096.stdout:6/555: chown d1/d61 807512749 1 2024-04-18T21:07:00.479 INFO:tasks.workunit.client.0.smithi096.stdout:2/724: rename d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/f78 to d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/ff4 0 2024-04-18T21:07:00.479 INFO:tasks.workunit.client.0.smithi096.stdout:7/511: mkdir d0/d20/d62/d97 0 2024-04-18T21:07:00.481 INFO:tasks.workunit.client.0.smithi096.stdout:2/725: chown d11/d13/d1a/d1e/d28/d4e/d40/f4c 223511997 1 2024-04-18T21:07:00.481 INFO:tasks.workunit.client.0.smithi096.stdout:1/612: dread d0/df/d16/f19 [0,4194304] 0 2024-04-18T21:07:00.481 INFO:tasks.workunit.client.0.smithi096.stdout:6/556: mknod d1/d5/da/d44/cb6 0 2024-04-18T21:07:00.483 INFO:tasks.workunit.client.0.smithi096.stdout:6/557: symlink d1/d17/lb7 0 2024-04-18T21:07:00.483 INFO:tasks.workunit.client.0.smithi096.stdout:8/598: dwrite d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:07:00.483 INFO:tasks.workunit.client.0.smithi096.stdout:6/558: stat d1/l8 0 2024-04-18T21:07:00.484 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:00.484 INFO:tasks.workunit.client.0.smithi096.stdout:6/559: stat d1/d5/da/d55/f6c 0 2024-04-18T21:07:00.487 INFO:tasks.workunit.client.0.smithi096.stdout:8/599: mkdir d0/d3/d1d/d66/d68/d7f/dac/d1b/dc2 0 2024-04-18T21:07:00.487 INFO:tasks.workunit.client.0.smithi096.stdout:5/568: sync 2024-04-18T21:07:00.487 INFO:tasks.workunit.client.0.smithi096.stdout:3/502: sync 2024-04-18T21:07:00.487 INFO:tasks.workunit.client.0.smithi096.stdout:2/726: dread d11/d13/d1a/d1e/d28/d4e/d63/f65 [0,4194304] 0 2024-04-18T21:07:00.487 INFO:tasks.workunit.client.0.smithi096.stdout:3/503: mkdir d4/d8/d7f/d94 0 2024-04-18T21:07:00.488 INFO:tasks.workunit.client.0.smithi096.stdout:5/569: getdents d2/d11 0 2024-04-18T21:07:00.488 INFO:tasks.workunit.client.0.smithi096.stdout:8/600: mkdir d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d86/dc3 0 2024-04-18T21:07:00.489 INFO:tasks.workunit.client.0.smithi096.stdout:2/727: mknod d11/d13/d1a/d1e/d28/d4e/d89/d8b/cf5 0 2024-04-18T21:07:00.489 INFO:tasks.workunit.client.0.smithi096.stdout:1/613: dwrite d0/df/d16/d24/dac/f93 [0,4194304] 0 2024-04-18T21:07:00.490 INFO:tasks.workunit.client.0.smithi096.stdout:1/614: stat d0/df/d16/d24/dac/d6a/d8d/d9b/dca 0 2024-04-18T21:07:00.491 INFO:tasks.workunit.client.0.smithi096.stdout:3/504: rename d4/d6/d1b/d1d/c7e to d4/d6/d1b/d1d/d64/c95 0 2024-04-18T21:07:00.491 INFO:tasks.workunit.client.0.smithi096.stdout:2/728: chown f1 0 1 2024-04-18T21:07:00.492 INFO:tasks.workunit.client.0.smithi096.stdout:6/560: truncate d1/d3a/d57/d66/d9b/d9f/fb0 4173438 0 2024-04-18T21:07:00.492 INFO:tasks.workunit.client.0.smithi096.stdout:1/615: mknod d0/df/d16/d24/dc0/d33/ccc 0 2024-04-18T21:07:00.492 INFO:tasks.workunit.client.0.smithi096.stdout:3/505: fsync d4/d6/d1b/d2c/f53 0 2024-04-18T21:07:00.492 INFO:tasks.workunit.client.0.smithi096.stdout:2/729: unlink d11/d13/d1a/f1c 0 2024-04-18T21:07:00.493 INFO:tasks.workunit.client.0.smithi096.stdout:6/561: dread - d1/d5/da/d46/d71/f7f zero size 2024-04-18T21:07:00.493 INFO:tasks.workunit.client.0.smithi096.stdout:2/730: chown d11/d13/d1a/fe3 161136 1 2024-04-18T21:07:00.493 INFO:tasks.workunit.client.0.smithi096.stdout:1/616: fdatasync d0/df/d16/d24/dc0/f73 0 2024-04-18T21:07:00.495 INFO:tasks.workunit.client.0.smithi096.stdout:2/731: creat d11/d13/d1d/d5d/ff6 x:0 0 0 2024-04-18T21:07:00.496 INFO:tasks.workunit.client.0.smithi096.stdout:1/617: creat d0/df/d16/d24/dc0/d5f/fcd x:0 0 0 2024-04-18T21:07:00.497 INFO:tasks.workunit.client.0.smithi096.stdout:4/531: sync 2024-04-18T21:07:00.497 INFO:tasks.workunit.client.0.smithi096.stdout:9/613: sync 2024-04-18T21:07:00.497 INFO:tasks.workunit.client.0.smithi096.stdout:8/601: sync 2024-04-18T21:07:00.498 INFO:tasks.workunit.client.0.smithi096.stdout:9/614: stat d0/dc/f26 0 2024-04-18T21:07:00.498 INFO:tasks.workunit.client.0.smithi096.stdout:0/563: dread d1/db/d30/f5c [0,4194304] 0 2024-04-18T21:07:00.499 INFO:tasks.workunit.client.0.smithi096.stdout:1/618: rmdir d0/df/d16/d24/dc0/d5f 39 2024-04-18T21:07:00.499 INFO:tasks.workunit.client.0.smithi096.stdout:6/562: dwrite d1/d5/ff [0,4194304] 0 2024-04-18T21:07:00.500 INFO:tasks.workunit.client.0.smithi096.stdout:2/732: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/ff4 [691634,31444] 0 2024-04-18T21:07:00.500 INFO:tasks.workunit.client.0.smithi096.stdout:8/602: rename d0/d3/lf to d0/d3/d1d/d66/d68/d7f/dac/d1b/db3/lc4 0 2024-04-18T21:07:00.502 INFO:tasks.workunit.client.0.smithi096.stdout:1/619: unlink d0/cb0 0 2024-04-18T21:07:00.503 INFO:tasks.workunit.client.0.smithi096.stdout:1/620: chown d0/df/d16/d24/dc0/l47 492 1 2024-04-18T21:07:00.503 INFO:tasks.workunit.client.0.smithi096.stdout:9/615: rename d0/d28/d7a/dc3/d43/d4b to d0/d28/d7a/dc3/dc6 0 2024-04-18T21:07:00.503 INFO:tasks.workunit.client.0.smithi096.stdout:6/563: symlink d1/d61/d91/lb8 0 2024-04-18T21:07:00.504 INFO:tasks.workunit.client.0.smithi096.stdout:9/616: readlink d0/d8/l3f 0 2024-04-18T21:07:00.504 INFO:tasks.workunit.client.0.smithi096.stdout:8/603: rename d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d5a to d0/d3/d3a/dab/d46/dc5 0 2024-04-18T21:07:00.505 INFO:tasks.workunit.client.0.smithi096.stdout:6/564: unlink d1/d5/f1a 0 2024-04-18T21:07:00.505 INFO:tasks.workunit.client.0.smithi096.stdout:8/604: chown d0/d3/db/d6f/fa9 20959721 1 2024-04-18T21:07:00.506 INFO:tasks.workunit.client.0.smithi096.stdout:2/733: read d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f56 [83795,100440] 0 2024-04-18T21:07:00.506 INFO:tasks.workunit.client.0.smithi096.stdout:2/734: sync 2024-04-18T21:07:00.507 INFO:tasks.workunit.client.0.smithi096.stdout:6/565: chown d1/d5/da/d46/d71/d7c/l9e 5370 1 2024-04-18T21:07:00.507 INFO:tasks.workunit.client.0.smithi096.stdout:4/532: dwrite d2/d2f/f36 [0,4194304] 0 2024-04-18T21:07:00.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/564: dwrite d1/db/d25/f28 [0,4194304] 0 2024-04-18T21:07:00.512 INFO:tasks.workunit.client.0.smithi096.stdout:9/617: dread d0/d8/d11/f38 [0,4194304] 0 2024-04-18T21:07:00.512 INFO:tasks.workunit.client.0.smithi096.stdout:4/533: rmdir d2/d2a/d54 39 2024-04-18T21:07:00.513 INFO:tasks.workunit.client.0.smithi096.stdout:2/735: mkdir d11/d13/d1a/d1e/de7/df7 0 2024-04-18T21:07:00.513 INFO:tasks.workunit.client.0.smithi096.stdout:1/621: dwrite d0/df/d16/f55 [4194304,4194304] 0 2024-04-18T21:07:00.514 INFO:tasks.workunit.client.0.smithi096.stdout:5/570: dread d2/d38/d4c/f85 [0,4194304] 0 2024-04-18T21:07:00.515 INFO:tasks.workunit.client.0.smithi096.stdout:2/736: fsync d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/fca 0 2024-04-18T21:07:00.516 INFO:tasks.workunit.client.0.smithi096.stdout:6/566: link d1/d61/d91/lb8 d1/d5/da/d44/d4e/d52/lb9 0 2024-04-18T21:07:00.516 INFO:tasks.workunit.client.0.smithi096.stdout:0/565: truncate d1/d23/d32/d43/f46 4097721 0 2024-04-18T21:07:00.517 INFO:tasks.workunit.client.0.smithi096.stdout:0/566: dread - d1/d23/d32/f76 zero size 2024-04-18T21:07:00.517 INFO:tasks.workunit.client.0.smithi096.stdout:1/622: rmdir d0/df 39 2024-04-18T21:07:00.517 INFO:tasks.workunit.client.0.smithi096.stdout:5/571: mknod d2/d11/d28/d4a/d55/d81/cd3 0 2024-04-18T21:07:00.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/567: fsync d1/f3 0 2024-04-18T21:07:00.518 INFO:tasks.workunit.client.0.smithi096.stdout:5/572: write d2/fd [283131,73897] 0 2024-04-18T21:07:00.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/534: creat d2/d2f/d33/d55/d57/d7d/fb4 x:0 0 0 2024-04-18T21:07:00.520 INFO:tasks.workunit.client.0.smithi096.stdout:6/568: creat d1/d5/da/d46/d71/d7c/d8b/fba x:0 0 0 2024-04-18T21:07:00.520 INFO:tasks.workunit.client.0.smithi096.stdout:0/567: mknod d1/da5/cbf 0 2024-04-18T21:07:00.522 INFO:tasks.workunit.client.0.smithi096.stdout:5/573: rename d2/d18/d61/d6f/d7a/fb1 to d2/d38/fd4 0 2024-04-18T21:07:00.522 INFO:tasks.workunit.client.0.smithi096.stdout:4/535: getdents d2/d2f/d33/d55/d57/d88/da4 0 2024-04-18T21:07:00.524 INFO:tasks.workunit.client.0.smithi096.stdout:8/605: dwrite d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/f5f [0,4194304] 0 2024-04-18T21:07:00.525 INFO:tasks.workunit.client.0.smithi096.stdout:4/536: stat d2/d2f/d33/d55/d57/c6e 0 2024-04-18T21:07:00.526 INFO:tasks.workunit.client.0.smithi096.stdout:2/737: dwrite d11/d13/d1a/d1e/d28/f3e [0,4194304] 0 2024-04-18T21:07:00.526 INFO:tasks.workunit.client.0.smithi096.stdout:9/618: dwrite d0/d8/d11/d48/f67 [0,4194304] 0 2024-04-18T21:07:00.527 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:00.527+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:00.528 INFO:tasks.workunit.client.0.smithi096.stdout:6/569: dwrite d1/d3a/d57/faf [0,4194304] 0 2024-04-18T21:07:00.534 INFO:tasks.workunit.client.0.smithi096.stdout:4/537: unlink d2/c40 0 2024-04-18T21:07:00.534 INFO:tasks.workunit.client.0.smithi096.stdout:0/568: fsync d1/db/d30/d31/d39/f66 0 2024-04-18T21:07:00.535 INFO:tasks.workunit.client.0.smithi096.stdout:3/506: dread d4/d6/d22/d20/f44 [0,4194304] 0 2024-04-18T21:07:00.537 INFO:tasks.workunit.client.0.smithi096.stdout:6/570: mkdir d1/d5/da/d90/dbb 0 2024-04-18T21:07:00.538 INFO:tasks.workunit.client.0.smithi096.stdout:4/538: creat d2/d1d/fb5 x:0 0 0 2024-04-18T21:07:00.538 INFO:tasks.workunit.client.0.smithi096.stdout:5/574: rename d2/d18/d61/d6f/d88/ca1 to d2/d11/d28/d4a/cd5 0 2024-04-18T21:07:00.538 INFO:tasks.workunit.client.0.smithi096.stdout:6/571: chown d1/l16 1854 1 2024-04-18T21:07:00.538 INFO:tasks.workunit.client.0.smithi096.stdout:2/738: getdents d11/d13/d1d/de8 0 2024-04-18T21:07:00.539 INFO:tasks.workunit.client.0.smithi096.stdout:0/569: symlink d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/lc0 0 2024-04-18T21:07:00.540 INFO:tasks.workunit.client.0.smithi096.stdout:7/512: dread d0/f1d [0,4194304] 0 2024-04-18T21:07:00.541 INFO:tasks.workunit.client.0.smithi096.stdout:6/572: mkdir d1/d5/da/d46/d71/dbc 0 2024-04-18T21:07:00.542 INFO:tasks.workunit.client.0.smithi096.stdout:4/539: rename d2/d2a/d54/d6d/f92 to d2/d2f/d33/d55/d59/d5f/fb6 0 2024-04-18T21:07:00.544 INFO:tasks.workunit.client.0.smithi096.stdout:3/507: dwrite d4/d6/d22/d20/f3f [0,4194304] 0 2024-04-18T21:07:00.545 INFO:tasks.workunit.client.0.smithi096.stdout:5/575: dwrite d2/d38/f4b [0,4194304] 0 2024-04-18T21:07:00.547 INFO:tasks.workunit.client.0.smithi096.stdout:4/540: link d2/c24 d2/d2f/d33/d55/d57/d88/cb7 0 2024-04-18T21:07:00.547 INFO:tasks.workunit.client.0.smithi096.stdout:6/573: write d1/d3a/d36/f8e [617736,42490] 0 2024-04-18T21:07:00.548 INFO:tasks.workunit.client.0.smithi096.stdout:5/576: creat d2/d11/d28/d4a/fd6 x:0 0 0 2024-04-18T21:07:00.548 INFO:tasks.workunit.client.0.smithi096.stdout:6/574: stat d1/d3a/d57/d26/c1e 0 2024-04-18T21:07:00.548 INFO:tasks.workunit.client.0.smithi096.stdout:4/541: write d2/f18 [4328912,122958] 0 2024-04-18T21:07:00.549 INFO:tasks.workunit.client.0.smithi096.stdout:2/739: dwrite d11/d13/d1a/d1e/d28/d4e/d63/f65 [0,4194304] 0 2024-04-18T21:07:00.550 INFO:tasks.workunit.client.0.smithi096.stdout:5/577: truncate d2/d11/d28/d64/d7e/f99 1099153 0 2024-04-18T21:07:00.550 INFO:tasks.workunit.client.0.smithi096.stdout:4/542: rmdir d2/d2a/d84/da2 0 2024-04-18T21:07:00.551 INFO:tasks.workunit.client.0.smithi096.stdout:5/578: read - d2/d11/d28/d4a/f80 zero size 2024-04-18T21:07:00.551 INFO:tasks.workunit.client.0.smithi096.stdout:4/543: unlink d2/c9b 0 2024-04-18T21:07:00.552 INFO:tasks.workunit.client.0.smithi096.stdout:2/740: link d11/l67 d11/d13/d1d/de8/lf8 0 2024-04-18T21:07:00.554 INFO:tasks.workunit.client.0.smithi096.stdout:2/741: creat d11/d13/d1a/d1e/d28/d4e/d89/ff9 x:0 0 0 2024-04-18T21:07:00.554 INFO:tasks.workunit.client.0.smithi096.stdout:6/575: dwrite d1/d3a/d36/f51 [4194304,4194304] 0 2024-04-18T21:07:00.555 INFO:tasks.workunit.client.0.smithi096.stdout:6/576: readlink d1/d3a/d57/d26/la2 0 2024-04-18T21:07:00.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/579: dread d2/d18/d61/d6f/d7a/f8d [0,4194304] 0 2024-04-18T21:07:00.559 INFO:tasks.workunit.client.0.smithi096.stdout:1/623: dread d0/df/d16/f54 [0,4194304] 0 2024-04-18T21:07:00.559 INFO:tasks.workunit.client.0.smithi096.stdout:3/508: read d4/d6/d1b/d1d/f2b [1062704,67908] 0 2024-04-18T21:07:00.562 INFO:tasks.workunit.client.0.smithi096.stdout:5/580: symlink d2/d11/d28/d4a/ld7 0 2024-04-18T21:07:00.562 INFO:tasks.workunit.client.0.smithi096.stdout:9/619: sync 2024-04-18T21:07:00.564 INFO:tasks.workunit.client.0.smithi096.stdout:4/544: dread d2/d2a/d54/d71/f76 [0,4194304] 0 2024-04-18T21:07:00.564 INFO:tasks.workunit.client.0.smithi096.stdout:1/624: dwrite d0/df/d16/d6c/dab/fc6 [0,4194304] 0 2024-04-18T21:07:00.565 INFO:tasks.workunit.client.0.smithi096.stdout:4/545: creat d2/d2a/d54/d71/d99/fb8 x:0 0 0 2024-04-18T21:07:00.566 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:00.566 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:00.567 INFO:tasks.workunit.client.0.smithi096.stdout:4/546: mkdir d2/d2f/d33/d55/d59/db9 0 2024-04-18T21:07:00.567 INFO:tasks.workunit.client.0.smithi096.stdout:4/547: fdatasync d2/f31 0 2024-04-18T21:07:00.569 INFO:tasks.workunit.client.0.smithi096.stdout:3/509: write d4/d6/d1b/d2c/d31/d11/f5b [1377018,93339] 0 2024-04-18T21:07:00.569 INFO:tasks.workunit.client.0.smithi096.stdout:4/548: creat d2/d2f/d33/d55/d59/db9/fba x:0 0 0 2024-04-18T21:07:00.569 INFO:tasks.workunit.client.0.smithi096.stdout:9/620: dwrite d0/d8/fa5 [4194304,4194304] 0 2024-04-18T21:07:00.570 INFO:tasks.workunit.client.0.smithi096.stdout:3/510: fsync d4/f73 0 2024-04-18T21:07:00.571 INFO:tasks.workunit.client.0.smithi096.stdout:9/621: write d0/d8/d9/fb9 [339154,27994] 0 2024-04-18T21:07:00.572 INFO:tasks.workunit.client.0.smithi096.stdout:4/549: rename d2/d2f/d39/d61 to d2/dbb 0 2024-04-18T21:07:00.573 INFO:tasks.workunit.client.0.smithi096.stdout:3/511: creat d4/d6/f96 x:0 0 0 2024-04-18T21:07:00.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/622: rename d0/d28/d7a/f9c to d0/d28/d2f/fc7 0 2024-04-18T21:07:00.574 INFO:tasks.workunit.client.0.smithi096.stdout:6/577: dwrite d1/d17/f5c [0,4194304] 0 2024-04-18T21:07:00.574 INFO:tasks.workunit.client.0.smithi096.stdout:1/625: dwrite d0/df/d16/d6c/f9a [0,4194304] 0 2024-04-18T21:07:00.577 INFO:tasks.workunit.client.0.smithi096.stdout:9/623: creat d0/d28/d7a/fc8 x:0 0 0 2024-04-18T21:07:00.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/624: dread - d0/dc/d5f/d76/f84 zero size 2024-04-18T21:07:00.578 INFO:tasks.workunit.client.0.smithi096.stdout:1/626: getdents d0/df/d30 0 2024-04-18T21:07:00.579 INFO:tasks.workunit.client.0.smithi096.stdout:6/578: creat d1/d5/fbd x:0 0 0 2024-04-18T21:07:00.579 INFO:tasks.workunit.client.0.smithi096.stdout:4/550: dwrite d2/f18 [4194304,4194304] 0 2024-04-18T21:07:00.580 INFO:tasks.workunit.client.0.smithi096.stdout:1/627: symlink d0/df/d16/d24/da8/lce 0 2024-04-18T21:07:00.580 INFO:tasks.workunit.client.0.smithi096.stdout:1/628: symlink d0/df/d16/d24/d9c/lcf 0 2024-04-18T21:07:00.581 INFO:tasks.workunit.client.0.smithi096.stdout:4/551: truncate d2/d2f/d33/d55/d57/d7d/fb4 1001901 0 2024-04-18T21:07:00.581 INFO:tasks.workunit.client.0.smithi096.stdout:1/629: mkdir d0/dd0 0 2024-04-18T21:07:00.582 INFO:tasks.workunit.client.0.smithi096.stdout:4/552: truncate d2/d2f/d33/d55/d57/d7d/fb4 1669434 0 2024-04-18T21:07:00.584 INFO:tasks.workunit.client.0.smithi096.stdout:4/553: creat d2/d1d/d3a/fbc x:0 0 0 2024-04-18T21:07:00.585 INFO:tasks.workunit.client.0.smithi096.stdout:9/625: dwrite d0/dc/f32 [4194304,4194304] 0 2024-04-18T21:07:00.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/630: dwrite d0/f17 [0,4194304] 0 2024-04-18T21:07:00.588 INFO:tasks.workunit.client.0.smithi096.stdout:9/626: mknod d0/d28/d7a/dc3/cc9 0 2024-04-18T21:07:00.592 INFO:tasks.workunit.client.0.smithi096.stdout:4/554: dwrite d2/d2f/d33/f8a [8388608,4194304] 0 2024-04-18T21:07:00.596 INFO:tasks.workunit.client.0.smithi096.stdout:7/513: dread d0/d20/d39/f61 [0,4194304] 0 2024-04-18T21:07:00.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/514: dwrite d0/f89 [0,4194304] 0 2024-04-18T21:07:00.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/515: stat d0/d20/d39/d8a/l8b 0 2024-04-18T21:07:00.603 INFO:tasks.workunit.client.0.smithi096.stdout:9/627: truncate d0/d28/d7a/dc3/f55 873415 0 2024-04-18T21:07:00.603 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:00.604 INFO:tasks.workunit.client.0.smithi096.stdout:9/628: truncate d0/d28/d7a/dc3/d43/fa2 326037 0 2024-04-18T21:07:00.605 INFO:tasks.workunit.client.0.smithi096.stdout:8/606: dread d0/d3/db/d6f/f98 [0,4194304] 0 2024-04-18T21:07:00.605 INFO:tasks.workunit.client.0.smithi096.stdout:8/607: chown d0/d64/l51 255283825 1 2024-04-18T21:07:00.606 INFO:tasks.workunit.client.0.smithi096.stdout:8/608: mkdir d0/d3/d1d/d66/d68/dc6 0 2024-04-18T21:07:00.606 INFO:tasks.workunit.client.0.smithi096.stdout:1/631: read d0/df/f64 [168962,25145] 0 2024-04-18T21:07:00.606 INFO:tasks.workunit.client.0.smithi096.stdout:7/516: dread d0/d7/d8/f26 [0,4194304] 0 2024-04-18T21:07:00.607 INFO:tasks.workunit.client.0.smithi096.stdout:8/609: chown d0/d3/fb2 7536504 1 2024-04-18T21:07:00.607 INFO:tasks.workunit.client.0.smithi096.stdout:4/555: write d2/f1f [3456763,73020] 0 2024-04-18T21:07:00.608 INFO:tasks.workunit.client.0.smithi096.stdout:7/517: write d0/d7/d8/f55 [3089359,97716] 0 2024-04-18T21:07:00.609 INFO:tasks.workunit.client.0.smithi096.stdout:4/556: symlink d2/d2a/d84/lbd 0 2024-04-18T21:07:00.610 INFO:tasks.workunit.client.0.smithi096.stdout:4/557: creat d2/d1d/fbe x:0 0 0 2024-04-18T21:07:00.610 INFO:tasks.workunit.client.0.smithi096.stdout:7/518: rename d0/d7/d49/l83 to d0/d20/d6c/l98 0 2024-04-18T21:07:00.610 INFO:tasks.workunit.client.0.smithi096.stdout:4/558: readlink d2/l41 0 2024-04-18T21:07:00.610 INFO:tasks.workunit.client.0.smithi096.stdout:9/629: dwrite d0/d8/f71 [0,4194304] 0 2024-04-18T21:07:00.611 INFO:tasks.workunit.client.0.smithi096.stdout:4/559: dread - d2/d2a/d54/d71/d99/fb8 zero size 2024-04-18T21:07:00.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/630: stat d0/dc/l2d 0 2024-04-18T21:07:00.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/560: readlink d2/d2a/d54/l65 0 2024-04-18T21:07:00.613 INFO:tasks.workunit.client.0.smithi096.stdout:0/570: dread d1/db/d30/d31/d85/fa [0,4194304] 0 2024-04-18T21:07:00.614 INFO:tasks.workunit.client.0.smithi096.stdout:9/631: rename d0/d28/d7a/dc3/f78 to d0/d8/d11/d39/fca 0 2024-04-18T21:07:00.614 INFO:tasks.workunit.client.0.smithi096.stdout:9/632: chown d0/dc/d5f/d76 2279009 1 2024-04-18T21:07:00.615 INFO:tasks.workunit.client.0.smithi096.stdout:0/571: fsync d1/db/d30/d31/d39/f40 0 2024-04-18T21:07:00.615 INFO:tasks.workunit.client.0.smithi096.stdout:7/519: getdents d0/d20/d62/d7d 0 2024-04-18T21:07:00.615 INFO:tasks.workunit.client.0.smithi096.stdout:9/633: creat d0/d44/fcb x:0 0 0 2024-04-18T21:07:00.615 INFO:tasks.workunit.client.0.smithi096.stdout:1/632: read d0/df/d16/d24/da8/fae [2125835,26895] 0 2024-04-18T21:07:00.615 INFO:tasks.workunit.client.0.smithi096.stdout:8/610: dwrite d0/d3/db/f45 [0,4194304] 0 2024-04-18T21:07:00.616 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:00.614+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:00.616 INFO:tasks.workunit.client.0.smithi096.stdout:0/572: chown d1/db/d25/f28 127 1 2024-04-18T21:07:00.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/611: chown d0/d3/fb2 321856 1 2024-04-18T21:07:00.617 INFO:tasks.workunit.client.0.smithi096.stdout:9/634: creat d0/d28/d3d/fcc x:0 0 0 2024-04-18T21:07:00.617 INFO:tasks.workunit.client.0.smithi096.stdout:1/633: creat d0/df/d16/d24/da8/fd1 x:0 0 0 2024-04-18T21:07:00.618 INFO:tasks.workunit.client.0.smithi096.stdout:8/612: fdatasync d0/f8e 0 2024-04-18T21:07:00.618 INFO:tasks.workunit.client.0.smithi096.stdout:9/635: dread - d0/d28/fa4 zero size 2024-04-18T21:07:00.618 INFO:tasks.workunit.client.0.smithi096.stdout:7/520: link d0/d20/d62/l6d d0/d7/d8/l99 0 2024-04-18T21:07:00.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/573: read - d1/db/d30/d4a/d67/fb2 zero size 2024-04-18T21:07:00.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/634: mkdir d0/df/d16/d24/dac/dd2 0 2024-04-18T21:07:00.619 INFO:tasks.workunit.client.0.smithi096.stdout:7/521: write d0/d7/f90 [541653,68641] 0 2024-04-18T21:07:00.620 INFO:tasks.workunit.client.0.smithi096.stdout:9/636: readlink d0/d28/d7a/dc3/l73 0 2024-04-18T21:07:00.620 INFO:tasks.workunit.client.0.smithi096.stdout:0/574: chown d1/d23/c5a 2 1 2024-04-18T21:07:00.620 INFO:tasks.workunit.client.0.smithi096.stdout:8/613: mknod d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d86/cc7 0 2024-04-18T21:07:00.621 INFO:tasks.workunit.client.0.smithi096.stdout:4/561: dwrite d2/d2f/d33/f34 [0,4194304] 0 2024-04-18T21:07:00.621 INFO:tasks.workunit.client.0.smithi096.stdout:9/637: creat d0/d28/d3d/fcd x:0 0 0 2024-04-18T21:07:00.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/522: truncate d0/fc 5133533 0 2024-04-18T21:07:00.621 INFO:tasks.workunit.client.0.smithi096.stdout:1/635: creat d0/df/d16/d24/dc0/d5f/d60/d90/fd3 x:0 0 0 2024-04-18T21:07:00.622 INFO:tasks.workunit.client.0.smithi096.stdout:0/575: creat d1/db/fc1 x:0 0 0 2024-04-18T21:07:00.622 INFO:tasks.workunit.client.0.smithi096.stdout:9/638: dread - d0/d28/d7a/fc8 zero size 2024-04-18T21:07:00.622 INFO:tasks.workunit.client.0.smithi096.stdout:7/523: fdatasync d0/d7/d42/f74 0 2024-04-18T21:07:00.622 INFO:tasks.workunit.client.0.smithi096.stdout:4/562: truncate d2/fc 8948588 0 2024-04-18T21:07:00.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/639: fsync d0/d28/d7a/dc3/dc6/f69 0 2024-04-18T21:07:00.623 INFO:tasks.workunit.client.0.smithi096.stdout:4/563: fsync d2/d1d/d3a/f45 0 2024-04-18T21:07:00.623 INFO:tasks.workunit.client.0.smithi096.stdout:8/614: chown d0/d3/d1d/d66/d68/d7f/dac/d33/db4/fbc 1539 1 2024-04-18T21:07:00.624 INFO:tasks.workunit.client.0.smithi096.stdout:7/524: unlink d0/d7/d2f/f8c 0 2024-04-18T21:07:00.624 INFO:tasks.workunit.client.0.smithi096.stdout:0/576: creat d1/d23/d32/d43/d6f/d8a/d91/fc2 x:0 0 0 2024-04-18T21:07:00.624 INFO:tasks.workunit.client.0.smithi096.stdout:1/636: write d0/df/d16/d24/dc0/d5f/d60/f99 [792139,67995] 0 2024-04-18T21:07:00.624 INFO:tasks.workunit.client.0.smithi096.stdout:0/577: fsync d1/d23/fa4 0 2024-04-18T21:07:00.624 INFO:tasks.workunit.client.0.smithi096.stdout:7/525: creat d0/d7/d2f/d63/f9a x:0 0 0 2024-04-18T21:07:00.624 INFO:tasks.workunit.client.0.smithi096.stdout:1/637: rmdir d0/df 39 2024-04-18T21:07:00.625 INFO:tasks.workunit.client.0.smithi096.stdout:8/615: creat d0/d3/d1d/d66/d68/dc6/fc8 x:0 0 0 2024-04-18T21:07:00.625 INFO:tasks.workunit.client.0.smithi096.stdout:0/578: symlink d1/db/d30/d4a/lc3 0 2024-04-18T21:07:00.625 INFO:tasks.workunit.client.0.smithi096.stdout:7/526: fsync d0/d7/f48 0 2024-04-18T21:07:00.626 INFO:tasks.workunit.client.0.smithi096.stdout:1/638: creat d0/df/d16/d24/dc0/d5f/d60/d8f/fd4 x:0 0 0 2024-04-18T21:07:00.627 INFO:tasks.workunit.client.0.smithi096.stdout:7/527: write d0/d7/d8/f16 [4121046,105166] 0 2024-04-18T21:07:00.627 INFO:tasks.workunit.client.0.smithi096.stdout:1/639: chown d0/c1d 137 1 2024-04-18T21:07:00.628 INFO:tasks.workunit.client.0.smithi096.stdout:7/528: mkdir d0/d20/d4b/d7f/d9b 0 2024-04-18T21:07:00.629 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:00.629 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:00.629 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:00.630 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:00.631 INFO:tasks.workunit.client.0.smithi096.stdout:0/579: dread d1/d23/d32/f78 [0,4194304] 0 2024-04-18T21:07:00.632 INFO:tasks.workunit.client.0.smithi096.stdout:9/640: dwrite d0/d8/d11/d39/d63/fba [0,4194304] 0 2024-04-18T21:07:00.632 INFO:tasks.workunit.client.0.smithi096.stdout:1/640: link d0/df/d16/d24/dc0/d33/l57 d0/df/d16/d24/dac/dd2/ld5 0 2024-04-18T21:07:00.633 INFO:tasks.workunit.client.0.smithi096.stdout:1/641: fsync d0/df/d30/f94 0 2024-04-18T21:07:00.633 INFO:tasks.workunit.client.0.smithi096.stdout:8/616: dwrite d0/d3/f23 [0,4194304] 0 2024-04-18T21:07:00.634 INFO:tasks.workunit.client.0.smithi096.stdout:9/641: creat d0/dc/d5f/d76/fce x:0 0 0 2024-04-18T21:07:00.634 INFO:tasks.workunit.client.0.smithi096.stdout:9/642: fdatasync d0/d8/d11/f19 0 2024-04-18T21:07:00.635 INFO:tasks.workunit.client.0.smithi096.stdout:9/643: rmdir d0 39 2024-04-18T21:07:00.636 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:00.637 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:00.637 INFO:tasks.workunit.client.0.smithi096.stdout:5/581: sync 2024-04-18T21:07:00.637 INFO:tasks.workunit.client.0.smithi096.stdout:2/742: sync 2024-04-18T21:07:00.637 INFO:tasks.workunit.client.0.smithi096.stdout:3/512: sync 2024-04-18T21:07:00.638 INFO:tasks.workunit.client.0.smithi096.stdout:5/582: unlink d2/d18/d61/d6f/c73 0 2024-04-18T21:07:00.639 INFO:tasks.workunit.client.0.smithi096.stdout:3/513: fsync d4/d6/d1b/d2c/f57 0 2024-04-18T21:07:00.639 INFO:tasks.workunit.client.0.smithi096.stdout:2/743: symlink d11/d13/d1a/d1e/d28/lfa 0 2024-04-18T21:07:00.640 INFO:tasks.workunit.client.0.smithi096.stdout:3/514: fsync d4/d6/d1b/d1d/f7a 0 2024-04-18T21:07:00.640 INFO:tasks.workunit.client.0.smithi096.stdout:5/583: creat d2/d11/d28/d4a/d55/fd8 x:0 0 0 2024-04-18T21:07:00.641 INFO:tasks.workunit.client.0.smithi096.stdout:2/744: readlink d11/d13/d1a/d1e/laa 0 2024-04-18T21:07:00.642 INFO:tasks.workunit.client.0.smithi096.stdout:8/617: dwrite d0/d3/d1d/d66/d68/d7f/dac/fb7 [0,4194304] 0 2024-04-18T21:07:00.643 INFO:tasks.workunit.client.0.smithi096.stdout:9/644: dwrite d0/dc/d5f/f61 [0,4194304] 0 2024-04-18T21:07:00.644 INFO:tasks.workunit.client.0.smithi096.stdout:8/618: dread - d0/d3/d3a/dab/d46/d78/f80 zero size 2024-04-18T21:07:00.645 INFO:tasks.workunit.client.0.smithi096.stdout:2/745: mkdir d11/d13/d1d/d5d/d97/dfb 0 2024-04-18T21:07:00.646 INFO:tasks.workunit.client.0.smithi096.stdout:8/619: dread - d0/d3/d3a/f75 zero size 2024-04-18T21:07:00.647 INFO:tasks.workunit.client.0.smithi096.stdout:2/746: truncate d11/d50/d8e/fed 581695 0 2024-04-18T21:07:00.647 INFO:tasks.workunit.client.0.smithi096.stdout:8/620: truncate d0/f94 925347 0 2024-04-18T21:07:00.648 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:00.649 INFO:tasks.workunit.client.0.smithi096.stdout:3/515: dwrite d4/fe [0,4194304] 0 2024-04-18T21:07:00.649 INFO:tasks.workunit.client.0.smithi096.stdout:2/747: mkdir d11/d13/d1a/d1e/d28/d4e/d80/dfc 0 2024-04-18T21:07:00.649 INFO:tasks.workunit.client.0.smithi096.stdout:1/642: write d0/df/f2e [1392669,6604] 0 2024-04-18T21:07:00.650 INFO:tasks.workunit.client.0.smithi096.stdout:2/748: write d11/d13/d1a/f35 [4669047,56233] 0 2024-04-18T21:07:00.650 INFO:tasks.workunit.client.0.smithi096.stdout:8/621: creat d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d9d/fc9 x:0 0 0 2024-04-18T21:07:00.651 INFO:tasks.workunit.client.0.smithi096.stdout:3/516: getdents d4/d6/d1b/d2c/d5c 0 2024-04-18T21:07:00.651 INFO:tasks.workunit.client.0.smithi096.stdout:6/579: dread d1/d5/f15 [0,4194304] 0 2024-04-18T21:07:00.652 INFO:tasks.workunit.client.0.smithi096.stdout:3/517: fsync d4/d8/f9 0 2024-04-18T21:07:00.654 INFO:tasks.workunit.client.0.smithi096.stdout:6/580: mknod d1/d5/da/d90/dbb/cbe 0 2024-04-18T21:07:00.654 INFO:tasks.workunit.client.0.smithi096.stdout:8/622: unlink d0/d3/d1d/d66/d68/d7f/dac/d56/d2f/l88 0 2024-04-18T21:07:00.655 INFO:tasks.workunit.client.0.smithi096.stdout:3/518: creat d4/d6/d1b/d2c/d31/d4e/f97 x:0 0 0 2024-04-18T21:07:00.656 INFO:tasks.workunit.client.0.smithi096.stdout:8/623: mkdir d0/d3/d1d/dca 0 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi096.stdout:5/584: dwrite d2/f7 [0,4194304] 0 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi096.stdout:6/581: creat d1/d3a/d57/d66/d80/fbf x:0 0 0 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi096.stdout:9/645: dwrite d0/d28/d7a/dc3/f55 [0,4194304] 0 2024-04-18T21:07:00.658 INFO:tasks.workunit.client.0.smithi096.stdout:9/646: write d0/dc/d5f/d76/f70 [2374364,71301] 0 2024-04-18T21:07:00.660 INFO:tasks.workunit.client.0.smithi096.stdout:8/624: symlink d0/d3/lcb 0 2024-04-18T21:07:00.660 INFO:tasks.workunit.client.0.smithi096.stdout:6/582: rename d1/d5/da/d44/l73 to d1/d5/da/d90/d94/lc0 0 2024-04-18T21:07:00.660 INFO:tasks.workunit.client.0.smithi096.stdout:9/647: truncate d0/d28/d2f/f17 734955 0 2024-04-18T21:07:00.661 INFO:tasks.workunit.client.0.smithi096.stdout:5/585: creat d2/d11/d28/fd9 x:0 0 0 2024-04-18T21:07:00.661 INFO:tasks.workunit.client.0.smithi096.stdout:5/586: chown d2/d11/d28/d4a/d69/ca6 3836143 1 2024-04-18T21:07:00.662 INFO:tasks.workunit.client.0.smithi096.stdout:9/648: creat d0/dc/d5f/d76/dc1/fcf x:0 0 0 2024-04-18T21:07:00.663 INFO:tasks.workunit.client.0.smithi096.stdout:6/583: link d1/l49 d1/d3a/d36/lc1 0 2024-04-18T21:07:00.663 INFO:tasks.workunit.client.0.smithi096.stdout:5/587: mknod d2/d11/d28/d64/d7e/cda 0 2024-04-18T21:07:00.663 INFO:tasks.workunit.client.0.smithi096.stdout:9/649: symlink d0/d28/ld0 0 2024-04-18T21:07:00.664 INFO:tasks.workunit.client.0.smithi096.stdout:6/584: dread - d1/d3a/d57/fa3 zero size 2024-04-18T21:07:00.665 INFO:tasks.workunit.client.0.smithi096.stdout:5/588: rename d2/d11/f71 to d2/d18/d9d/da0/dcb/fdb 0 2024-04-18T21:07:00.666 INFO:tasks.workunit.client.0.smithi096.stdout:5/589: creat d2/d11/d28/d64/dba/fdc x:0 0 0 2024-04-18T21:07:00.667 INFO:tasks.workunit.client.0.smithi096.stdout:4/564: dread d2/d2a/f73 [0,4194304] 0 2024-04-18T21:07:00.667 INFO:tasks.workunit.client.0.smithi096.stdout:9/650: read d0/dc/d5f/f94 [1054060,39363] 0 2024-04-18T21:07:00.669 INFO:tasks.workunit.client.0.smithi096.stdout:8/625: read d0/d64/f52 [20064,62222] 0 2024-04-18T21:07:00.670 INFO:tasks.workunit.client.0.smithi096.stdout:3/519: dread d4/d6/d1b/d1d/d64/f78 [0,4194304] 0 2024-04-18T21:07:00.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/626: symlink d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d86/lcc 0 2024-04-18T21:07:00.671 INFO:tasks.workunit.client.0.smithi096.stdout:8/627: unlink d0/d3/d1d/d66/d68/d7f/dac/d56/d4d/d86/lcc 0 2024-04-18T21:07:00.677 INFO:tasks.workunit.client.0.smithi096.stdout:8/628: read d0/d3/d3a/dab/d46/dc5/fa7 [59147,69909] 0 2024-04-18T21:07:00.677 INFO:tasks.workunit.client.0.smithi096.stdout:8/629: stat d0/d3/f49 0 2024-04-18T21:07:00.678 INFO:tasks.workunit.client.0.smithi096.stdout:7/529: dread d0/d20/f5d [0,4194304] 0 2024-04-18T21:07:00.679 INFO:tasks.workunit.client.0.smithi096.stdout:6/585: truncate d1/d5/da/d44/d4e/f59 2793124 0 2024-04-18T21:07:00.680 INFO:tasks.workunit.client.0.smithi096.stdout:6/586: write d1/d5/da/d44/d4e/f5e [13144,85016] 0 2024-04-18T21:07:00.682 INFO:tasks.workunit.client.0.smithi096.stdout:6/587: mknod d1/d5/da/d46/cc2 0 2024-04-18T21:07:00.683 INFO:tasks.workunit.client.0.smithi096.stdout:5/590: dwrite d2/d11/f3d [0,4194304] 0 2024-04-18T21:07:00.683 INFO:tasks.workunit.client.0.smithi096.stdout:0/580: dread d1/f15 [0,4194304] 0 2024-04-18T21:07:00.685 INFO:tasks.workunit.client.0.smithi096.stdout:0/581: creat d1/d23/d32/d43/d6f/d8a/d96/db4/fc4 x:0 0 0 2024-04-18T21:07:00.686 INFO:tasks.workunit.client.0.smithi096.stdout:2/749: dread d11/d50/d8e/f99 [0,4194304] 0 2024-04-18T21:07:00.686 INFO:tasks.workunit.client.0.smithi096.stdout:0/582: creat d1/da3/fc5 x:0 0 0 2024-04-18T21:07:00.687 INFO:tasks.workunit.client.0.smithi096.stdout:2/750: read - d11/d13/d1a/d1e/d28/d4e/d40/dbe/fe5 zero size 2024-04-18T21:07:00.688 INFO:tasks.workunit.client.0.smithi096.stdout:2/751: chown d11/l20 165990 1 2024-04-18T21:07:00.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/565: dread d2/f50 [0,4194304] 0 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi096.stdout:8/630: rename d0/d3/d1d/d66/d68 to d0/d3/d1d/d83/dcd 0 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi096.stdout:2/752: rmdir d11/d13/d1d/d5d 39 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/566: rmdir d2/d2f/d33/d55/d57 39 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi096.stdout:6/588: dwrite d1/d3a/d36/f6f [0,4194304] 0 2024-04-18T21:07:00.690 INFO:tasks.workunit.client.0.smithi096.stdout:8/631: dread - d0/d3/d1d/d83/fa3 zero size 2024-04-18T21:07:00.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/567: truncate d2/d1d/fbe 90815 0 2024-04-18T21:07:00.691 INFO:tasks.workunit.client.0.smithi096.stdout:6/589: write d1/d5/da/f2a [269178,108164] 0 2024-04-18T21:07:00.692 INFO:tasks.workunit.client.0.smithi096.stdout:6/590: mknod d1/d5/cc3 0 2024-04-18T21:07:00.694 INFO:tasks.workunit.client.0.smithi096.stdout:0/583: dwrite d1/db/d30/d31/f71 [0,4194304] 0 2024-04-18T21:07:00.695 INFO:tasks.workunit.client.0.smithi096.stdout:8/632: dread d0/d3/f23 [0,4194304] 0 2024-04-18T21:07:00.697 INFO:tasks.workunit.client.0.smithi096.stdout:0/584: creat d1/db/d30/d4a/fc6 x:0 0 0 2024-04-18T21:07:00.697 INFO:tasks.workunit.client.0.smithi096.stdout:0/585: creat d1/d23/fc7 x:0 0 0 2024-04-18T21:07:00.698 INFO:tasks.workunit.client.0.smithi096.stdout:8/633: write d0/d3/d3a/dab/d61/f70 [2116619,76975] 0 2024-04-18T21:07:00.700 INFO:tasks.workunit.client.0.smithi096.stdout:0/586: rename d1/db/d30/d31/d39/f66 to d1/db/d30/d31/d39/d6d/db1/fc8 0 2024-04-18T21:07:00.700 INFO:tasks.workunit.client.0.smithi096.stdout:8/634: creat d0/d3/d1d/fce x:0 0 0 2024-04-18T21:07:00.701 INFO:tasks.workunit.client.0.smithi096.stdout:6/591: dread d1/d5/da/d44/d4e/f5e [0,4194304] 0 2024-04-18T21:07:00.701 INFO:tasks.workunit.client.0.smithi096.stdout:6/592: fdatasync d1/d3a/d36/f42 0 2024-04-18T21:07:00.701 INFO:tasks.workunit.client.0.smithi096.stdout:8/635: rename d0/f8 to d0/d3/d1d/d83/dcd/fcf 0 2024-04-18T21:07:00.702 INFO:tasks.workunit.client.0.smithi096.stdout:6/593: stat d1/d5/da/d44/d4e/d52/l74 0 2024-04-18T21:07:00.703 INFO:tasks.workunit.client.0.smithi096.stdout:6/594: readlink d1/d5/da/d44/d4e/d52/lb9 0 2024-04-18T21:07:00.707 INFO:tasks.workunit.client.0.smithi096.stdout:8/636: truncate d0/d3/d3a/dab/f44 2922453 0 2024-04-18T21:07:00.707 INFO:tasks.workunit.client.0.smithi096.stdout:8/637: fdatasync d0/d3/fb2 0 2024-04-18T21:07:00.708 INFO:tasks.workunit.client.0.smithi096.stdout:8/638: creat d0/d3/d1d/d66/fd0 x:0 0 0 2024-04-18T21:07:00.710 INFO:tasks.workunit.client.0.smithi096.stdout:5/591: dread d2/d18/f5c [0,4194304] 0 2024-04-18T21:07:00.711 INFO:tasks.workunit.client.0.smithi096.stdout:2/753: dread d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/ff4 [0,4194304] 0 2024-04-18T21:07:00.711 INFO:tasks.workunit.client.0.smithi096.stdout:5/592: creat d2/d18/d61/fdd x:0 0 0 2024-04-18T21:07:00.712 INFO:tasks.workunit.client.0.smithi096.stdout:3/520: dread d4/f73 [0,4194304] 0 2024-04-18T21:07:00.714 INFO:tasks.workunit.client.0.smithi096.stdout:3/521: getdents d4/d6/d1b/d2c/d31/d85 0 2024-04-18T21:07:00.715 INFO:tasks.workunit.client.0.smithi096.stdout:9/651: dread d0/d28/d3d/f6b [0,4194304] 0 2024-04-18T21:07:00.715 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:00.715+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:00.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/652: readlink d0/l6 0 2024-04-18T21:07:00.717 INFO:tasks.workunit.client.0.smithi096.stdout:3/522: rmdir d4/d6/d1b/d2c/d5c/d84 0 2024-04-18T21:07:00.717 INFO:tasks.workunit.client.0.smithi096.stdout:8/639: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/f5f [0,4194304] 0 2024-04-18T21:07:00.717 INFO:tasks.workunit.client.0.smithi096.stdout:9/653: symlink d0/d28/d7a/ld1 0 2024-04-18T21:07:00.719 INFO:tasks.workunit.client.0.smithi096.stdout:6/595: dread d1/d5/da/d44/d4e/f59 [0,4194304] 0 2024-04-18T21:07:00.719 INFO:tasks.workunit.client.0.smithi096.stdout:3/523: symlink d4/d6/d1b/d2c/d31/d85/l98 0 2024-04-18T21:07:00.719 INFO:tasks.workunit.client.0.smithi096.stdout:9/654: write d0/d8/d9/fb9 [704869,114729] 0 2024-04-18T21:07:00.720 INFO:tasks.workunit.client.0.smithi096.stdout:6/596: symlink d1/d5/da/d46/d71/lc4 0 2024-04-18T21:07:00.720 INFO:tasks.workunit.client.0.smithi096.stdout:2/754: dwrite d11/d13/d1d/d5d/d97/fad [0,4194304] 0 2024-04-18T21:07:00.720 INFO:tasks.workunit.client.0.smithi096.stdout:9/655: write d0/d8/d9/fb7 [624321,73277] 0 2024-04-18T21:07:00.721 INFO:tasks.workunit.client.0.smithi096.stdout:2/755: chown d11/d13/f2f 16 1 2024-04-18T21:07:00.721 INFO:tasks.workunit.client.0.smithi096.stdout:3/524: mkdir d4/d6/d1b/d2c/d6b/d99 0 2024-04-18T21:07:00.721 INFO:tasks.workunit.client.0.smithi096.stdout:6/597: creat d1/d61/fc5 x:0 0 0 2024-04-18T21:07:00.722 INFO:tasks.workunit.client.0.smithi096.stdout:9/656: creat d0/d8/d11/d1f/fd2 x:0 0 0 2024-04-18T21:07:00.722 INFO:tasks.workunit.client.0.smithi096.stdout:2/756: write d11/d13/f2d [392948,87139] 0 2024-04-18T21:07:00.722 INFO:tasks.workunit.client.0.smithi096.stdout:8/640: getdents d0/d3/d1d/d83/dcd/d7f/dac/d33/db4 0 2024-04-18T21:07:00.723 INFO:tasks.workunit.client.0.smithi096.stdout:9/657: dread - d0/d28/d7a/fc8 zero size 2024-04-18T21:07:00.723 INFO:tasks.workunit.client.0.smithi096.stdout:3/525: mknod d4/d6/d1b/c9a 0 2024-04-18T21:07:00.723 INFO:tasks.workunit.client.0.smithi096.stdout:6/598: write d1/d5/da/d44/d4e/fa6 [908615,80126] 0 2024-04-18T21:07:00.723 INFO:tasks.workunit.client.0.smithi096.stdout:8/641: mkdir d0/d3/d1d/d83/dcd/dd1 0 2024-04-18T21:07:00.723 INFO:tasks.workunit.client.0.smithi096.stdout:5/593: truncate d2/f7 331491 0 2024-04-18T21:07:00.724 INFO:tasks.workunit.client.0.smithi096.stdout:2/757: rename fb to d11/d13/d1a/d1e/d28/d4e/d80/dd2/ffd 0 2024-04-18T21:07:00.724 INFO:tasks.workunit.client.0.smithi096.stdout:5/594: dread - d2/d18/fc5 zero size 2024-04-18T21:07:00.724 INFO:tasks.workunit.client.0.smithi096.stdout:3/526: creat d4/d6/d1b/d2c/d31/f9b x:0 0 0 2024-04-18T21:07:00.725 INFO:tasks.workunit.client.0.smithi096.stdout:8/642: mknod d0/cd2 0 2024-04-18T21:07:00.725 INFO:tasks.workunit.client.0.smithi096.stdout:6/599: getdents d1/d3a 0 2024-04-18T21:07:00.725 INFO:tasks.workunit.client.0.smithi096.stdout:5/595: creat d2/d18/d9d/da0/dcb/fde x:0 0 0 2024-04-18T21:07:00.725 INFO:tasks.workunit.client.0.smithi096.stdout:2/758: link d11/d13/d1d/d5d/ca6 d11/d13/cfe 0 2024-04-18T21:07:00.726 INFO:tasks.workunit.client.0.smithi096.stdout:5/596: fdatasync d2/d11/d28/d64/dba/fdc 0 2024-04-18T21:07:00.727 INFO:tasks.workunit.client.0.smithi096.stdout:5/597: chown d2/d8f/lcd 14 1 2024-04-18T21:07:00.727 INFO:tasks.workunit.client.0.smithi096.stdout:9/658: dread d0/d8/fa5 [4194304,4194304] 0 2024-04-18T21:07:00.728 INFO:tasks.workunit.client.0.smithi096.stdout:5/598: mkdir d2/d11/d28/d4a/d55/d81/ddf 0 2024-04-18T21:07:00.728 INFO:tasks.workunit.client.0.smithi096.stdout:9/659: readlink d0/d8/d11/l37 0 2024-04-18T21:07:00.729 INFO:tasks.workunit.client.0.smithi096.stdout:9/660: unlink d0/d28/l99 0 2024-04-18T21:07:00.729 INFO:tasks.workunit.client.0.smithi096.stdout:5/599: chown d2/d11/d28/d4a/d55/f7c 1243188 1 2024-04-18T21:07:00.730 INFO:tasks.workunit.client.0.smithi096.stdout:9/661: unlink d0/d8/d9/c45 0 2024-04-18T21:07:00.730 INFO:tasks.workunit.client.0.smithi096.stdout:5/600: write d2/d11/d28/d4a/d55/fc2 [387141,111059] 0 2024-04-18T21:07:00.732 INFO:tasks.workunit.client.0.smithi096.stdout:3/527: truncate d4/d8/f3d 1047092 0 2024-04-18T21:07:00.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/600: dwrite d1/d5/da/d46/d71/d7c/f8f [0,4194304] 0 2024-04-18T21:07:00.732 INFO:tasks.workunit.client.0.smithi096.stdout:8/643: write d0/d3/d3a/dab/d46/dc5/fa7 [1509550,14609] 0 2024-04-18T21:07:00.733 INFO:tasks.workunit.client.0.smithi096.stdout:4/568: dread d2/d2f/d39/d43/f48 [0,4194304] 0 2024-04-18T21:07:00.733 INFO:tasks.workunit.client.0.smithi096.stdout:5/601: write d2/d11/d28/d4a/d55/d81/f9c [1172602,97350] 0 2024-04-18T21:07:00.733 INFO:tasks.workunit.client.0.smithi096.stdout:6/601: mknod d1/d5/da/d46/cc6 0 2024-04-18T21:07:00.733 INFO:tasks.workunit.client.0.smithi096.stdout:8/644: mknod d0/d3/db/d6f/cd3 0 2024-04-18T21:07:00.734 INFO:tasks.workunit.client.0.smithi096.stdout:4/569: symlink d2/d2f/d39/lbf 0 2024-04-18T21:07:00.734 INFO:tasks.workunit.client.0.smithi096.stdout:5/602: write d2/d18/d61/fdd [123685,109081] 0 2024-04-18T21:07:00.735 INFO:tasks.workunit.client.0.smithi096.stdout:6/602: creat d1/d3a/d57/d66/d9b/d9f/fc7 x:0 0 0 2024-04-18T21:07:00.737 INFO:tasks.workunit.client.0.smithi096.stdout:6/603: write d1/d3a/f3f [2393262,76986] 0 2024-04-18T21:07:00.737 INFO:tasks.workunit.client.0.smithi096.stdout:4/570: creat d2/d2f/d33/d55/d57/d88/da4/fc0 x:0 0 0 2024-04-18T21:07:00.737 INFO:tasks.workunit.client.0.smithi096.stdout:2/759: dread ff [0,4194304] 0 2024-04-18T21:07:00.738 INFO:tasks.workunit.client.0.smithi096.stdout:4/571: rmdir d2/d2a/d54/d71/d99 39 2024-04-18T21:07:00.738 INFO:tasks.workunit.client.0.smithi096.stdout:9/662: dwrite d0/d28/d2f/fc7 [0,4194304] 0 2024-04-18T21:07:00.739 INFO:tasks.workunit.client.0.smithi096.stdout:6/604: truncate d1/d3a/d57/d26/fa9 690708 0 2024-04-18T21:07:00.739 INFO:tasks.workunit.client.0.smithi096.stdout:2/760: unlink d11/d13/f2f 0 2024-04-18T21:07:00.739 INFO:tasks.workunit.client.0.smithi096.stdout:6/605: fdatasync d1/d5/da/fc 0 2024-04-18T21:07:00.739 INFO:tasks.workunit.client.0.smithi096.stdout:4/572: creat d2/d2f/d39/d43/fc1 x:0 0 0 2024-04-18T21:07:00.739 INFO:tasks.workunit.client.0.smithi096.stdout:9/663: creat d0/d28/d3d/fd3 x:0 0 0 2024-04-18T21:07:00.740 INFO:tasks.workunit.client.0.smithi096.stdout:4/573: stat d2/d2f/d33/d55/d57/c6e 0 2024-04-18T21:07:00.740 INFO:tasks.workunit.client.0.smithi096.stdout:2/761: creat d11/d13/d1a/d1e/d28/d4e/d63/fff x:0 0 0 2024-04-18T21:07:00.744 INFO:tasks.workunit.client.0.smithi096.stdout:6/606: dread d1/d3a/d57/faf [0,4194304] 0 2024-04-18T21:07:00.744 INFO:tasks.workunit.client.0.smithi096.stdout:1/643: sync 2024-04-18T21:07:00.744 INFO:tasks.workunit.client.0.smithi096.stdout:8/645: dwrite d0/d3/d1d/d83/dcd/d7f/dac/f2a [0,4194304] 0 2024-04-18T21:07:00.746 INFO:tasks.workunit.client.0.smithi096.stdout:6/607: symlink d1/d3a/d57/lc8 0 2024-04-18T21:07:00.746 INFO:tasks.workunit.client.0.smithi096.stdout:1/644: creat d0/dd0/fd6 x:0 0 0 2024-04-18T21:07:00.746 INFO:tasks.workunit.client.0.smithi096.stdout:8/646: readlink d0/d3/d1d/d83/dcd/d7f/dac/d33/l71 0 2024-04-18T21:07:00.747 INFO:tasks.workunit.client.0.smithi096.stdout:4/574: dwrite d2/f4c [4194304,4194304] 0 2024-04-18T21:07:00.747 INFO:tasks.workunit.client.0.smithi096.stdout:8/647: mknod d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/cd4 0 2024-04-18T21:07:00.748 INFO:tasks.workunit.client.0.smithi096.stdout:6/608: link d1/d5/da/f21 d1/d3a/d57/d66/d67/fc9 0 2024-04-18T21:07:00.749 INFO:tasks.workunit.client.0.smithi096.stdout:8/648: fdatasync d0/d3/d3a/dab/d46/d78/f80 0 2024-04-18T21:07:00.749 INFO:tasks.workunit.client.0.smithi096.stdout:6/609: symlink d1/d5/da/d44/d97/da0/lca 0 2024-04-18T21:07:00.750 INFO:tasks.workunit.client.0.smithi096.stdout:6/610: chown d1/d5/c31 1304122432 1 2024-04-18T21:07:00.750 INFO:tasks.workunit.client.0.smithi096.stdout:2/762: truncate d11/d13/d1a/d1e/d28/d4e/f53 2991477 0 2024-04-18T21:07:00.750 INFO:tasks.workunit.client.0.smithi096.stdout:8/649: symlink d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/ld5 0 2024-04-18T21:07:00.751 INFO:tasks.workunit.client.0.smithi096.stdout:9/664: rename d0/d44/cab to d0/d28/d7a/cd4 0 2024-04-18T21:07:00.751 INFO:tasks.workunit.client.0.smithi096.stdout:1/645: write d0/df/d16/d24/dc0/d33/f42 [2891716,129011] 0 2024-04-18T21:07:00.751 INFO:tasks.workunit.client.0.smithi096.stdout:8/650: chown d0/f27 59451332 1 2024-04-18T21:07:00.751 INFO:tasks.workunit.client.0.smithi096.stdout:6/611: mknod d1/d5/da/d44/d4e/d52/ccb 0 2024-04-18T21:07:00.752 INFO:tasks.workunit.client.0.smithi096.stdout:1/646: unlink d0/df/d16/d6c/dab/fc6 0 2024-04-18T21:07:00.752 INFO:tasks.workunit.client.0.smithi096.stdout:9/665: write d0/d28/d7a/dc3/d43/fa2 [699139,72604] 0 2024-04-18T21:07:00.753 INFO:tasks.workunit.client.0.smithi096.stdout:8/651: creat d0/d3/d1d/d83/dcd/d7f/dac/d1b/db3/fd6 x:0 0 0 2024-04-18T21:07:00.753 INFO:tasks.workunit.client.0.smithi096.stdout:6/612: rename d1/d3a/d57/d66/f6e to d1/d3a/d36/fcc 0 2024-04-18T21:07:00.756 INFO:tasks.workunit.client.0.smithi096.stdout:6/613: write d1/d3a/d36/d7a/fb2 [855906,44012] 0 2024-04-18T21:07:00.757 INFO:tasks.workunit.client.0.smithi096.stdout:4/575: dwrite d2/f2c [0,4194304] 0 2024-04-18T21:07:00.759 INFO:tasks.workunit.client.0.smithi096.stdout:2/763: dwrite d11/d13/d1a/d1e/d28/d4e/d40/f4c [0,4194304] 0 2024-04-18T21:07:00.760 INFO:tasks.workunit.client.0.smithi096.stdout:6/614: rename d1/d5/da/d55/l5b to d1/d5/da/d90/dbb/lcd 0 2024-04-18T21:07:00.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/576: truncate d2/d2f/d33/d55/f9f 18316 0 2024-04-18T21:07:00.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/666: dwrite d0/d8/fae [0,4194304] 0 2024-04-18T21:07:00.762 INFO:tasks.workunit.client.0.smithi096.stdout:2/764: dread - d11/d13/d1a/d1e/d28/d4e/d40/dbe/fe5 zero size 2024-04-18T21:07:00.763 INFO:tasks.workunit.client.0.smithi096.stdout:4/577: write d2/d2f/d33/d55/f6f [1022412,16922] 0 2024-04-18T21:07:00.763 INFO:tasks.workunit.client.0.smithi096.stdout:1/647: dwrite d0/df/d16/d24/dc0/d5f/d60/fa5 [0,4194304] 0 2024-04-18T21:07:00.763 INFO:tasks.workunit.client.0.smithi096.stdout:9/667: write d0/dc/d5f/f61 [1834958,123227] 0 2024-04-18T21:07:00.764 INFO:tasks.workunit.client.0.smithi096.stdout:9/668: read - d0/d8/fc2 zero size 2024-04-18T21:07:00.765 INFO:tasks.workunit.client.0.smithi096.stdout:9/669: getdents d0/d8/d11/d39 0 2024-04-18T21:07:00.767 INFO:tasks.workunit.client.0.smithi096.stdout:9/670: truncate d0/d8/d9/f3a 682573 0 2024-04-18T21:07:00.767 INFO:tasks.workunit.client.0.smithi096.stdout:2/765: readlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/lf1 0 2024-04-18T21:07:00.767 INFO:tasks.workunit.client.0.smithi096.stdout:1/648: write d0/f44 [562296,127562] 0 2024-04-18T21:07:00.767 INFO:tasks.workunit.client.0.smithi096.stdout:9/671: dread - d0/dc/d5f/d76/dc1/fcf zero size 2024-04-18T21:07:00.769 INFO:tasks.workunit.client.0.smithi096.stdout:6/615: read d1/f34 [2588773,102187] 0 2024-04-18T21:07:00.769 INFO:tasks.workunit.client.0.smithi096.stdout:1/649: symlink d0/df/d30/d53/da2/ld7 0 2024-04-18T21:07:00.769 INFO:tasks.workunit.client.0.smithi096.stdout:3/528: dread d4/d6/d1b/d1d/f2b [0,4194304] 0 2024-04-18T21:07:00.769 INFO:tasks.workunit.client.0.smithi096.stdout:3/529: chown d4/d6/d1b/d1d/f2e 47118738 1 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi096.stdout:1/650: unlink d0/df/d16/d24/dac/d6a/d8d/cc3 0 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi096.stdout:3/530: chown d4/d8/f74 100747 1 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi096.stdout:1/651: readlink d0/df/d30/lb2 0 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi096.stdout:3/531: write d4/d6/f96 [213112,128961] 0 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi096.stdout:1/652: symlink d0/df/d30/d53/da2/ld8 0 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi096.stdout:3/532: creat d4/f9c x:0 0 0 2024-04-18T21:07:00.772 INFO:tasks.workunit.client.0.smithi096.stdout:1/653: mknod d0/dd0/cd9 0 2024-04-18T21:07:00.772 INFO:tasks.workunit.client.0.smithi096.stdout:3/533: truncate d4/f73 3017319 0 2024-04-18T21:07:00.773 INFO:tasks.workunit.client.0.smithi096.stdout:9/672: dwrite d0/d44/fa9 [0,4194304] 0 2024-04-18T21:07:00.775 INFO:tasks.workunit.client.0.smithi096.stdout:6/616: read d1/d17/f2f [956997,71974] 0 2024-04-18T21:07:00.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/617: chown d1/d3a/d57/d66/l76 26 1 2024-04-18T21:07:00.778 INFO:tasks.workunit.client.0.smithi096.stdout:1/654: dwrite d0/df/d16/d24/dc0/d5f/d60/f99 [4194304,4194304] 0 2024-04-18T21:07:00.780 INFO:tasks.workunit.client.0.smithi096.stdout:1/655: creat d0/df/d16/fda x:0 0 0 2024-04-18T21:07:00.780 INFO:tasks.workunit.client.0.smithi096.stdout:6/618: dread d1/d3a/d36/f6f [0,4194304] 0 2024-04-18T21:07:00.781 INFO:tasks.workunit.client.0.smithi096.stdout:1/656: dread - d0/df/d16/d24/dc0/d33/fc4 zero size 2024-04-18T21:07:00.782 INFO:tasks.workunit.client.0.smithi096.stdout:9/673: dwrite d0/d28/d3d/fd3 [0,4194304] 0 2024-04-18T21:07:00.782 INFO:tasks.workunit.client.0.smithi096.stdout:8/652: truncate d0/d3/d1d/d83/dcd/d7f/dac/f2a 1641187 0 2024-04-18T21:07:00.782 INFO:tasks.workunit.client.0.smithi096.stdout:6/619: creat d1/d3a/d57/d66/d80/fce x:0 0 0 2024-04-18T21:07:00.782 INFO:tasks.workunit.client.0.smithi096.stdout:1/657: mkdir d0/dd0/ddb 0 2024-04-18T21:07:00.783 INFO:tasks.workunit.client.0.smithi096.stdout:9/674: write d0/dc/d5f/f61 [4136062,120079] 0 2024-04-18T21:07:00.783 INFO:tasks.workunit.client.0.smithi096.stdout:1/658: mkdir d0/df/ddc 0 2024-04-18T21:07:00.783 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:00.783 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:00.784 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:00.784 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:00.784 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:00.784 INFO:tasks.workunit.client.0.smithi096.stdout:8/653: link d0/d3/l1e d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/ld7 0 2024-04-18T21:07:00.789 INFO:tasks.workunit.client.0.smithi096.stdout:9/675: dwrite d0/d8/d11/d39/fca [0,4194304] 0 2024-04-18T21:07:00.791 INFO:tasks.workunit.client.0.smithi096.stdout:9/676: mkdir d0/dc/d5f/d76/dd5 0 2024-04-18T21:07:00.791 INFO:tasks.workunit.client.0.smithi096.stdout:8/654: dwrite d0/d3/db/d6f/f98 [0,4194304] 0 2024-04-18T21:07:00.793 INFO:tasks.workunit.client.0.smithi096.stdout:9/677: symlink d0/d44/ld6 0 2024-04-18T21:07:00.793 INFO:tasks.workunit.client.0.smithi096.stdout:8/655: rename d0/d3/d1d/d83/dcd/d7f/dac/d33/l71 to d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/ld8 0 2024-04-18T21:07:00.794 INFO:tasks.workunit.client.0.smithi096.stdout:9/678: readlink d0/d28/d7a/dc3/l4c 0 2024-04-18T21:07:00.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/679: getdents d0 0 2024-04-18T21:07:00.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/680: creat d0/d28/d7a/dc3/dc6/da3/fd7 x:0 0 0 2024-04-18T21:07:00.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/681: stat d0/dc/c4d 0 2024-04-18T21:07:00.797 INFO:tasks.workunit.client.0.smithi096.stdout:9/682: mkdir d0/d28/d66/dd8 0 2024-04-18T21:07:00.798 INFO:tasks.workunit.client.0.smithi096.stdout:9/683: creat d0/d8/d89/fd9 x:0 0 0 2024-04-18T21:07:00.799 INFO:tasks.workunit.client.0.smithi096.stdout:9/684: write d0/d8/d9/f3a [814326,111610] 0 2024-04-18T21:07:00.801 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/685: truncate d0/d28/d7a/f9b 3379205 0 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi096.stdout:8/656: dwrite d0/d3/d1d/d83/dcd/d7f/dac/f31 [0,4194304] 0 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/686: mknod d0/dc/d5f/d76/cda 0 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi096.stdout:8/657: write d0/d3/d1d/f24 [4251065,123146] 0 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/687: stat d0/fa0 0 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/688: chown d0/d28/da1/f29 733600 1 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi096.stdout:8/658: chown d0/d3/d3a/dab/d61/l72 13 1 2024-04-18T21:07:00.804 INFO:tasks.workunit.client.0.smithi096.stdout:9/689: write d0/f4 [1551966,38832] 0 2024-04-18T21:07:00.804 INFO:tasks.workunit.client.0.smithi096.stdout:8/659: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/dd9 0 2024-04-18T21:07:00.804 INFO:tasks.workunit.client.0.smithi096.stdout:9/690: mkdir d0/d8/d11/d1f/ddb 0 2024-04-18T21:07:00.806 INFO:tasks.workunit.client.0.smithi096.stdout:9/691: mknod d0/d8/d11/cdc 0 2024-04-18T21:07:00.806 INFO:tasks.workunit.client.0.smithi096.stdout:8/660: mkdir d0/d3/d1d/d83/dcd/dd1/dda 0 2024-04-18T21:07:00.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/530: sync 2024-04-18T21:07:00.806 INFO:tasks.workunit.client.0.smithi096.stdout:9/692: mkdir d0/d8/d11/ddd 0 2024-04-18T21:07:00.807 INFO:tasks.workunit.client.0.smithi096.stdout:6/620: read d1/d3a/d57/d26/f3c [1333130,67077] 0 2024-04-18T21:07:00.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/621: chown d1/d5/da/d44/d4e/f59 0 1 2024-04-18T21:07:00.808 INFO:tasks.workunit.client.0.smithi096.stdout:8/661: dread d0/d3/d3a/dab/f44 [0,4194304] 0 2024-04-18T21:07:00.809 INFO:tasks.workunit.client.0.smithi096.stdout:6/622: dread - d1/d5/da/d46/d71/f7f zero size 2024-04-18T21:07:00.809 INFO:tasks.workunit.client.0.smithi096.stdout:9/693: fsync d0/f4 0 2024-04-18T21:07:00.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/662: read - d0/d3/f4c zero size 2024-04-18T21:07:00.810 INFO:tasks.workunit.client.0.smithi096.stdout:9/694: readlink d0/d28/d66/l72 0 2024-04-18T21:07:00.810 INFO:tasks.workunit.client.0.smithi096.stdout:9/695: mknod d0/cde 0 2024-04-18T21:07:00.811 INFO:tasks.workunit.client.0.smithi096.stdout:7/531: dwrite d0/d7/d8/f56 [0,4194304] 0 2024-04-18T21:07:00.814 INFO:tasks.workunit.client.0.smithi096.stdout:6/623: dwrite d1/d3a/d57/d66/d80/fbf [0,4194304] 0 2024-04-18T21:07:00.817 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:00.815+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:00.818 INFO:tasks.workunit.client.0.smithi096.stdout:8/663: truncate d0/d3/db/f6a 4060245 0 2024-04-18T21:07:00.819 INFO:tasks.workunit.client.0.smithi096.stdout:8/664: dread - d0/d3/d1d/d66/fd0 zero size 2024-04-18T21:07:00.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/665: symlink d0/d3/db/ldb 0 2024-04-18T21:07:00.821 INFO:tasks.workunit.client.0.smithi096.stdout:6/624: dwrite d1/d5/da/f2a [0,4194304] 0 2024-04-18T21:07:00.822 INFO:tasks.workunit.client.0.smithi096.stdout:9/696: dwrite d0/dc/d5f/d76/f84 [0,4194304] 0 2024-04-18T21:07:00.823 INFO:tasks.workunit.client.0.smithi096.stdout:9/697: readlink d0/d8/l33 0 2024-04-18T21:07:00.824 INFO:tasks.workunit.client.0.smithi096.stdout:9/698: link d0/d44/cc4 d0/d8/d89/cdf 0 2024-04-18T21:07:00.826 INFO:tasks.workunit.client.0.smithi096.stdout:9/699: link d0/d8/d11/d1f/fd2 d0/d28/d7a/dc3/dc6/fe0 0 2024-04-18T21:07:00.827 INFO:tasks.workunit.client.0.smithi096.stdout:6/625: dwrite d1/d3a/f3f [0,4194304] 0 2024-04-18T21:07:00.827 INFO:tasks.workunit.client.0.smithi096.stdout:9/700: write d0/d28/d7a/dc3/d43/fa2 [1678568,119019] 0 2024-04-18T21:07:00.828 INFO:tasks.workunit.client.0.smithi096.stdout:9/701: readlink d0/d8/d11/d39/l7f 0 2024-04-18T21:07:00.828 INFO:tasks.workunit.client.0.smithi096.stdout:9/702: stat d0/d8/d11/ddd 0 2024-04-18T21:07:00.829 INFO:tasks.workunit.client.0.smithi096.stdout:6/626: creat d1/d61/fcf x:0 0 0 2024-04-18T21:07:00.829 INFO:tasks.workunit.client.0.smithi096.stdout:9/703: mknod d0/d8/d11/ddd/ce1 0 2024-04-18T21:07:00.830 INFO:tasks.workunit.client.0.smithi096.stdout:9/704: chown d0/d8/d11/f82 26971736 1 2024-04-18T21:07:00.830 INFO:tasks.workunit.client.0.smithi096.stdout:6/627: rename d1/d3a/d36/l4d to d1/d5/da/d55/ld0 0 2024-04-18T21:07:00.830 INFO:tasks.workunit.client.0.smithi096.stdout:9/705: chown d0/d28/d66 8523 1 2024-04-18T21:07:00.830 INFO:tasks.workunit.client.0.smithi096.stdout:6/628: dread - d1/d5/da/d46/d71/f7f zero size 2024-04-18T21:07:00.831 INFO:tasks.workunit.client.0.smithi096.stdout:9/706: dread - d0/d28/d7a/dc3/dc6/da3/fd7 zero size 2024-04-18T21:07:00.831 INFO:tasks.workunit.client.0.smithi096.stdout:9/707: mknod d0/dc/d5f/d76/ce2 0 2024-04-18T21:07:00.834 INFO:tasks.workunit.client.0.smithi096.stdout:4/578: dread d2/f4c [0,4194304] 0 2024-04-18T21:07:00.834 INFO:tasks.workunit.client.0.smithi096.stdout:4/579: stat d2/d2f/d33/d55/f9f 0 2024-04-18T21:07:00.835 INFO:tasks.workunit.client.0.smithi096.stdout:4/580: fdatasync d2/d2f/d33/f35 0 2024-04-18T21:07:00.836 INFO:tasks.workunit.client.0.smithi096.stdout:4/581: creat d2/d2f/d33/d55/d59/db9/fc2 x:0 0 0 2024-04-18T21:07:00.836 INFO:tasks.workunit.client.0.smithi096.stdout:4/582: dread - d2/d2f/d33/d55/d59/db9/fba zero size 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi096.stdout:4/583: chown d2/d2f/d33/d55/d57 52 1 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi096.stdout:4/584: fsync d2/d1d/faf 0 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi096.stdout:4/585: rmdir d2 39 2024-04-18T21:07:00.839 INFO:tasks.workunit.client.0.smithi096.stdout:4/586: getdents d2/d2f/d33/d55/d57/d88 0 2024-04-18T21:07:00.839 INFO:tasks.workunit.client.0.smithi096.stdout:4/587: dread - d2/d2a/d54/d5b/fa8 zero size 2024-04-18T21:07:00.839 INFO:tasks.workunit.client.0.smithi096.stdout:8/666: read d0/d64/d43/f4a [864734,7207] 0 2024-04-18T21:07:00.840 INFO:tasks.workunit.client.0.smithi096.stdout:4/588: write d2/d1d/f5e [1655691,49289] 0 2024-04-18T21:07:00.840 INFO:tasks.workunit.client.0.smithi096.stdout:8/667: getdents d0/d3/d1d/d83/dcd/dd1/dda 0 2024-04-18T21:07:00.840 INFO:tasks.workunit.client.0.smithi096.stdout:4/589: fdatasync d2/d2a/f93 0 2024-04-18T21:07:00.841 INFO:tasks.workunit.client.0.smithi096.stdout:4/590: readlink d2/d1d/l47 0 2024-04-18T21:07:00.841 INFO:tasks.workunit.client.0.smithi096.stdout:4/591: mkdir d2/dc3 0 2024-04-18T21:07:00.841 INFO:tasks.workunit.client.0.smithi096.stdout:9/708: write d0/d8/d11/f38 [4031065,28742] 0 2024-04-18T21:07:00.842 INFO:tasks.workunit.client.0.smithi096.stdout:4/592: dread - d2/d2f/d33/d55/d59/db9/fba zero size 2024-04-18T21:07:00.843 INFO:tasks.workunit.client.0.smithi096.stdout:4/593: readlink d2/d1d/d3a/l6b 0 2024-04-18T21:07:00.843 INFO:tasks.workunit.client.0.smithi096.stdout:9/709: truncate d0/d8/d11/f90 750473 0 2024-04-18T21:07:00.843 INFO:tasks.workunit.client.0.smithi096.stdout:9/710: dread - d0/d8/d11/d1f/fd2 zero size 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi096.stdout:4/594: fsync d2/d2f/d33/d55/d57/f5c 0 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi096.stdout:6/629: dwrite d1/d3a/d57/d66/d9b/d9f/fb0 [0,4194304] 0 2024-04-18T21:07:00.847 INFO:tasks.workunit.client.0.smithi096.stdout:9/711: write d0/dc/d5f/f68 [1189158,65191] 0 2024-04-18T21:07:00.847 INFO:tasks.workunit.client.0.smithi096.stdout:6/630: mkdir d1/d61/d91/dd1 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:4/595: rename d2/c27 to d2/d2f/d39/cc4 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:9/712: fdatasync d0/d8/d11/d48/fad 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:6/631: stat d1/d3a/d57/d26/c78 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:4/596: stat d2/d2a/d54/d6d/d78/ca6 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:6/632: symlink d1/d5/ld2 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:4/597: chown d2/d2f/d39/f4b 505236 1 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:6/633: write d1/d3a/d57/f8a [1702210,25953] 0 2024-04-18T21:07:00.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/598: chown d2/d2a/d54/fa1 81 1 2024-04-18T21:07:00.852 INFO:tasks.workunit.client.0.smithi096.stdout:6/634: read d1/d5/da/d44/d4e/f5e [25325,11680] 0 2024-04-18T21:07:00.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/599: creat d2/d2a/d54/d5b/fc5 x:0 0 0 2024-04-18T21:07:00.853 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:07:00.853 INFO:tasks.workunit.client.0.smithi096.stdout:8/668: write d0/d3/db/f2d [2376259,85366] 0 2024-04-18T21:07:00.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/600: chown d2/d2f/f36 4591582 1 2024-04-18T21:07:00.854 INFO:tasks.workunit.client.0.smithi096.stdout:6/635: write d1/d3a/d36/f51 [6651638,103570] 0 2024-04-18T21:07:00.854 INFO:tasks.workunit.client.0.smithi096.stdout:4/601: mknod d2/d2f/d33/d55/d57/cc6 0 2024-04-18T21:07:00.854 INFO:tasks.workunit.client.0.smithi096.stdout:8/669: read d0/d3/f57 [3716944,103464] 0 2024-04-18T21:07:00.856 INFO:tasks.workunit.client.0.smithi096.stdout:9/713: write d0/d28/d7a/dc3/dc6/fe0 [192155,95754] 0 2024-04-18T21:07:00.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/602: dread d2/d2f/d33/d55/d59/d5f/fb6 [0,4194304] 0 2024-04-18T21:07:00.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/603: fsync d2/f31 0 2024-04-18T21:07:00.858 INFO:tasks.workunit.client.0.smithi096.stdout:8/670: rename d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d86 to d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc 0 2024-04-18T21:07:00.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/714: symlink d0/d28/d66/db2/le3 0 2024-04-18T21:07:00.858 INFO:tasks.workunit.client.0.smithi096.stdout:6/636: dwrite d1/d61/d91/fb1 [0,4194304] 0 2024-04-18T21:07:00.858 INFO:tasks.workunit.client.0.smithi096.stdout:4/604: creat d2/d2a/d84/fc7 x:0 0 0 2024-04-18T21:07:00.860 INFO:tasks.workunit.client.0.smithi096.stdout:4/605: chown d2/d2f/d33/d55/d59/d5f/fb6 49 1 2024-04-18T21:07:00.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/637: mknod d1/d5/da/d46/d71/d7c/cd3 0 2024-04-18T21:07:00.860 INFO:tasks.workunit.client.0.smithi096.stdout:4/606: creat d2/d2a/d54/d6d/fc8 x:0 0 0 2024-04-18T21:07:00.860 INFO:tasks.workunit.client.0.smithi096.stdout:6/638: creat d1/d61/d91/dd1/fd4 x:0 0 0 2024-04-18T21:07:00.861 INFO:tasks.workunit.client.0.smithi096.stdout:3/534: sync 2024-04-18T21:07:00.862 INFO:tasks.workunit.client.0.smithi096.stdout:1/659: sync 2024-04-18T21:07:00.862 INFO:tasks.workunit.client.0.smithi096.stdout:0/587: sync 2024-04-18T21:07:00.862 INFO:tasks.workunit.client.0.smithi096.stdout:5/603: sync 2024-04-18T21:07:00.862 INFO:tasks.workunit.client.0.smithi096.stdout:2/766: sync 2024-04-18T21:07:00.863 INFO:tasks.workunit.client.0.smithi096.stdout:4/607: write d2/d1d/f7e [1451512,122954] 0 2024-04-18T21:07:00.863 INFO:tasks.workunit.client.0.smithi096.stdout:3/535: symlink d4/l9d 0 2024-04-18T21:07:00.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/604: symlink d2/d11/d28/d64/le0 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi096.stdout:0/588: symlink d1/d23/d32/d43/lc9 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi096.stdout:3/536: mkdir d4/d8/d49/d9e 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi096.stdout:2/767: symlink d11/d13/d1a/d1e/dbf/l100 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi096.stdout:6/639: link d1/d5/da/d44/d4e/c4c d1/d61/d91/cd5 0 2024-04-18T21:07:00.866 INFO:tasks.workunit.client.0.smithi096.stdout:5/605: rename d2/d11/f2d to d2/d18/d61/d6f/d88/fe1 0 2024-04-18T21:07:00.866 INFO:tasks.workunit.client.0.smithi096.stdout:4/608: rmdir d2/d2a/d54/d71/d99 39 2024-04-18T21:07:00.867 INFO:tasks.workunit.client.0.smithi096.stdout:8/671: dwrite d0/d3/d1d/d66/fd0 [0,4194304] 0 2024-04-18T21:07:00.867 INFO:tasks.workunit.client.0.smithi096.stdout:1/660: link d0/df/d16/d24/dc0/d5f/d60/c88 d0/df/d16/d24/dac/dd2/cdd 0 2024-04-18T21:07:00.868 INFO:tasks.workunit.client.0.smithi096.stdout:8/672: write d0/f27 [3137186,80462] 0 2024-04-18T21:07:00.868 INFO:tasks.workunit.client.0.smithi096.stdout:1/661: chown d0/df/d16/d24/dac/d6a/l84 41705 1 2024-04-18T21:07:00.868 INFO:tasks.workunit.client.0.smithi096.stdout:2/768: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d94/d101 0 2024-04-18T21:07:00.869 INFO:tasks.workunit.client.0.smithi096.stdout:0/589: rename d1/d23/d32/d43/d6f/d8a/d91/dba/f7a to d1/fca 0 2024-04-18T21:07:00.870 INFO:tasks.workunit.client.0.smithi096.stdout:5/606: creat d2/d11/d28/d4a/fe2 x:0 0 0 2024-04-18T21:07:00.870 INFO:tasks.workunit.client.0.smithi096.stdout:2/769: write d11/d13/d1a/d1e/d28/d4e/fb4 [4129056,115710] 0 2024-04-18T21:07:00.871 INFO:tasks.workunit.client.0.smithi096.stdout:8/673: symlink d0/d3/d1d/d83/dcd/dd1/ldd 0 2024-04-18T21:07:00.871 INFO:tasks.workunit.client.0.smithi096.stdout:5/607: write d2/d38/d4c/f9f [4908427,91580] 0 2024-04-18T21:07:00.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/770: readlink d11/d13/d1a/d1e/d28/d4e/d40/l90 0 2024-04-18T21:07:00.872 INFO:tasks.workunit.client.0.smithi096.stdout:1/662: getdents d0/df/d16/d24/dc0/d5f/d60/d90 0 2024-04-18T21:07:00.874 INFO:tasks.workunit.client.0.smithi096.stdout:5/608: write d2/d18/f5c [105248,113941] 0 2024-04-18T21:07:00.874 INFO:tasks.workunit.client.0.smithi096.stdout:4/609: rename d2/d2a/d84 to d2/d1d/d3a/dc9 0 2024-04-18T21:07:00.875 INFO:tasks.workunit.client.0.smithi096.stdout:2/771: read d11/f61 [246403,121545] 0 2024-04-18T21:07:00.875 INFO:tasks.workunit.client.0.smithi096.stdout:6/640: dwrite d1/d5/da/d44/f93 [0,4194304] 0 2024-04-18T21:07:00.875 INFO:tasks.workunit.client.0.smithi096.stdout:3/537: read d4/d6/d22/d20/f76 [3568724,130352] 0 2024-04-18T21:07:00.875 INFO:tasks.workunit.client.0.smithi096.stdout:5/609: symlink d2/d6a/le3 0 2024-04-18T21:07:00.877 INFO:tasks.workunit.client.0.smithi096.stdout:2/772: write d11/d50/d5b/fec [234004,37687] 0 2024-04-18T21:07:00.878 INFO:tasks.workunit.client.0.smithi096.stdout:6/641: creat d1/d61/d91/fd6 x:0 0 0 2024-04-18T21:07:00.878 INFO:tasks.workunit.client.0.smithi096.stdout:5/610: creat d2/d11/d28/d64/dba/fe4 x:0 0 0 2024-04-18T21:07:00.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/538: creat d4/d6/d1b/d1d/d64/f9f x:0 0 0 2024-04-18T21:07:00.879 INFO:tasks.workunit.client.0.smithi096.stdout:4/610: getdents d2/d2a/d54/d71 0 2024-04-18T21:07:00.880 INFO:tasks.workunit.client.0.smithi096.stdout:1/663: dwrite d0/df/d16/d24/dac/fc7 [0,4194304] 0 2024-04-18T21:07:00.880 INFO:tasks.workunit.client.0.smithi096.stdout:4/611: stat d2/c4 0 2024-04-18T21:07:00.881 INFO:tasks.workunit.client.0.smithi096.stdout:5/611: mkdir d2/d11/d28/d4a/d55/d81/ddf/de5 0 2024-04-18T21:07:00.882 INFO:tasks.workunit.client.0.smithi096.stdout:5/612: mkdir d2/d11/d28/d4a/de6 0 2024-04-18T21:07:00.883 INFO:tasks.workunit.client.0.smithi096.stdout:5/613: readlink d2/d18/l9a 0 2024-04-18T21:07:00.886 INFO:tasks.workunit.client.0.smithi096.stdout:5/614: creat d2/fe7 x:0 0 0 2024-04-18T21:07:00.888 INFO:tasks.workunit.client.0.smithi096.stdout:3/539: dwrite d4/d8/f48 [4194304,4194304] 0 2024-04-18T21:07:00.888 INFO:tasks.workunit.client.0.smithi096.stdout:6/642: dwrite d1/d5/da/d44/d4e/f5e [0,4194304] 0 2024-04-18T21:07:00.889 INFO:tasks.workunit.client.0.smithi096.stdout:1/664: dwrite d0/df/d16/f54 [0,4194304] 0 2024-04-18T21:07:00.890 INFO:tasks.workunit.client.0.smithi096.stdout:3/540: write d4/d8/f9 [169486,59331] 0 2024-04-18T21:07:00.890 INFO:tasks.workunit.client.0.smithi096.stdout:5/615: rename d2/d18/d61/d6f/d88/d96 to d2/d18/d9d/de8 0 2024-04-18T21:07:00.891 INFO:tasks.workunit.client.0.smithi096.stdout:5/616: chown d2/d11/d28/d4a/d55/d81/ddf 331 1 2024-04-18T21:07:00.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/541: dread d4/d6/d1b/d1d/d64/f78 [0,4194304] 0 2024-04-18T21:07:00.892 INFO:tasks.workunit.client.0.smithi096.stdout:5/617: mkdir d2/d8f/de9 0 2024-04-18T21:07:00.892 INFO:tasks.workunit.client.0.smithi096.stdout:3/542: mknod d4/d6/d1b/d63/ca0 0 2024-04-18T21:07:00.892 INFO:tasks.workunit.client.0.smithi096.stdout:2/773: read d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/fca [2770346,15606] 0 2024-04-18T21:07:00.893 INFO:tasks.workunit.client.0.smithi096.stdout:2/774: fsync d11/d13/d1a/d1e/d9f/fa8 0 2024-04-18T21:07:00.894 INFO:tasks.workunit.client.0.smithi096.stdout:2/775: mknod d11/d13/d1d/c102 0 2024-04-18T21:07:00.894 INFO:tasks.workunit.client.0.smithi096.stdout:3/543: link d4/d6/d1b/d1d/d64/l8d d4/d6/d1b/d2c/d6b/la1 0 2024-04-18T21:07:00.895 INFO:tasks.workunit.client.0.smithi096.stdout:2/776: unlink d11/c44 0 2024-04-18T21:07:00.895 INFO:tasks.workunit.client.0.smithi096.stdout:3/544: truncate d4/d8/f3d 1615808 0 2024-04-18T21:07:00.896 INFO:tasks.workunit.client.0.smithi096.stdout:2/777: write d11/d13/d1a/d1e/d28/d4e/d89/fb2 [842769,49302] 0 2024-04-18T21:07:00.901 INFO:tasks.workunit.client.0.smithi096.stdout:2/778: dwrite d11/f16 [4194304,4194304] 0 2024-04-18T21:07:00.902 INFO:tasks.workunit.client.0.smithi096.stdout:7/532: sync 2024-04-18T21:07:00.903 INFO:tasks.workunit.client.0.smithi096.stdout:7/533: rename d0/d11/f43 to d0/d7/d8/f9c 0 2024-04-18T21:07:00.903 INFO:tasks.workunit.client.0.smithi096.stdout:2/779: link d11/d13/f15 d11/d13/d1a/d1e/d28/f103 0 2024-04-18T21:07:00.905 INFO:tasks.workunit.client.0.smithi096.stdout:2/780: fsync d11/d13/d1a/d1e/d28/d4e/d40/dbe/fe5 0 2024-04-18T21:07:00.905 INFO:tasks.workunit.client.0.smithi096.stdout:7/534: mknod d0/d20/d4b/d7f/d9b/c9d 0 2024-04-18T21:07:00.906 INFO:tasks.workunit.client.0.smithi096.stdout:8/674: dread d0/d3/db/f36 [0,4194304] 0 2024-04-18T21:07:00.907 INFO:tasks.workunit.client.0.smithi096.stdout:2/781: getdents d11/d13/d1a/d1e/d28/d4e/d80 0 2024-04-18T21:07:00.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/545: write d4/d6/d1b/d1d/f28 [420656,72518] 0 2024-04-18T21:07:00.909 INFO:tasks.workunit.client.0.smithi096.stdout:2/782: mkdir d11/d50/d5b/dcb/d104 0 2024-04-18T21:07:00.910 INFO:tasks.workunit.client.0.smithi096.stdout:3/546: symlink d4/d6/d1b/d1d/d64/la2 0 2024-04-18T21:07:00.910 INFO:tasks.workunit.client.0.smithi096.stdout:2/783: creat d11/d50/d5b/d8a/f105 x:0 0 0 2024-04-18T21:07:00.911 INFO:tasks.workunit.client.0.smithi096.stdout:2/784: fdatasync d11/d13/d1a/d1e/d28/d4e/d89/fb2 0 2024-04-18T21:07:00.911 INFO:tasks.workunit.client.0.smithi096.stdout:5/618: read d2/d38/d4c/f5e [37933,18830] 0 2024-04-18T21:07:00.912 INFO:tasks.workunit.client.0.smithi096.stdout:7/535: dwrite d0/d7/d8/f55 [4194304,4194304] 0 2024-04-18T21:07:00.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/785: write d11/d13/d1d/d5d/ff6 [911541,52775] 0 2024-04-18T21:07:00.913 INFO:tasks.workunit.client.0.smithi096.stdout:7/536: write d0/d7/f5c [571558,71602] 0 2024-04-18T21:07:00.914 INFO:tasks.workunit.client.0.smithi096.stdout:2/786: truncate ff 2486570 0 2024-04-18T21:07:00.914 INFO:tasks.workunit.client.0.smithi096.stdout:7/537: symlink d0/d20/d39/l9e 0 2024-04-18T21:07:00.916 INFO:tasks.workunit.client.0.smithi096.stdout:2/787: mknod d11/d13/d1d/d5d/d97/dfb/c106 0 2024-04-18T21:07:00.917 INFO:tasks.workunit.client.0.smithi096.stdout:2/788: write d11/d13/f2d [89818,95112] 0 2024-04-18T21:07:00.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:00.914+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:00.919 INFO:tasks.workunit.client.0.smithi096.stdout:7/538: write d0/d7/d8/f1e [3245357,79955] 0 2024-04-18T21:07:00.920 INFO:tasks.workunit.client.0.smithi096.stdout:3/547: dwrite d4/d6/d1b/d2c/f43 [0,4194304] 0 2024-04-18T21:07:00.921 INFO:tasks.workunit.client.0.smithi096.stdout:7/539: write d0/d7/f90 [172007,106390] 0 2024-04-18T21:07:00.921 INFO:tasks.workunit.client.0.smithi096.stdout:9/715: sync 2024-04-18T21:07:00.921 INFO:tasks.workunit.client.0.smithi096.stdout:4/612: dread d2/f26 [0,4194304] 0 2024-04-18T21:07:00.922 INFO:tasks.workunit.client.0.smithi096.stdout:5/619: dwrite d2/d11/d28/d4a/d87/fcf [4194304,4194304] 0 2024-04-18T21:07:00.922 INFO:tasks.workunit.client.0.smithi096.stdout:7/540: truncate d0/d7/d42/f87 401726 0 2024-04-18T21:07:00.923 INFO:tasks.workunit.client.0.smithi096.stdout:9/716: creat d0/dc/d5f/d76/fe4 x:0 0 0 2024-04-18T21:07:00.923 INFO:tasks.workunit.client.0.smithi096.stdout:5/620: rmdir d2/d18/d9d 39 2024-04-18T21:07:00.924 INFO:tasks.workunit.client.0.smithi096.stdout:7/541: rename d0/d20/d39/d8a/f95 to d0/d7/d49/f9f 0 2024-04-18T21:07:00.925 INFO:tasks.workunit.client.0.smithi096.stdout:7/542: symlink d0/d20/d4b/d7f/la0 0 2024-04-18T21:07:00.926 INFO:tasks.workunit.client.0.smithi096.stdout:7/543: mkdir d0/d20/d4b/d7f/da1 0 2024-04-18T21:07:00.927 INFO:tasks.workunit.client.0.smithi096.stdout:7/544: mkdir d0/d20/d39/da2 0 2024-04-18T21:07:00.928 INFO:tasks.workunit.client.0.smithi096.stdout:4/613: dwrite d2/f1f [0,4194304] 0 2024-04-18T21:07:00.930 INFO:tasks.workunit.client.0.smithi096.stdout:4/614: write d2/f31 [3492488,32792] 0 2024-04-18T21:07:00.930 INFO:tasks.workunit.client.0.smithi096.stdout:4/615: chown d2/d2a/f73 41858 1 2024-04-18T21:07:00.930 INFO:tasks.workunit.client.0.smithi096.stdout:6/643: dread d1/d3a/d57/d26/fb [0,4194304] 0 2024-04-18T21:07:00.932 INFO:tasks.workunit.client.0.smithi096.stdout:2/789: truncate d11/d13/d1a/d1e/d28/d4e/d40/dbe/fee 248453 0 2024-04-18T21:07:00.933 INFO:tasks.workunit.client.0.smithi096.stdout:6/644: symlink d1/d5/da/d46/d71/dbc/ld7 0 2024-04-18T21:07:00.933 INFO:tasks.workunit.client.0.smithi096.stdout:7/545: dwrite d0/d7/d49/f4e [0,4194304] 0 2024-04-18T21:07:00.934 INFO:tasks.workunit.client.0.smithi096.stdout:7/546: dread - d0/d7/d2f/d53/f92 zero size 2024-04-18T21:07:00.935 INFO:tasks.workunit.client.0.smithi096.stdout:0/590: dread d1/f2d [4194304,4194304] 0 2024-04-18T21:07:00.935 INFO:tasks.workunit.client.0.smithi096.stdout:0/591: stat d1/f6a 0 2024-04-18T21:07:00.940 INFO:tasks.workunit.client.0.smithi096.stdout:2/790: dwrite d11/d13/d1a/d1e/d28/d4e/d40/f64 [0,4194304] 0 2024-04-18T21:07:00.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/645: dwrite d1/d5/da/d44/f7d [8388608,4194304] 0 2024-04-18T21:07:00.941 INFO:tasks.workunit.client.0.smithi096.stdout:2/791: chown d11/d13/d1a/d1e/f96 288138826 1 2024-04-18T21:07:00.941 INFO:tasks.workunit.client.0.smithi096.stdout:6/646: symlink d1/d5/da/d90/ld8 0 2024-04-18T21:07:00.942 INFO:tasks.workunit.client.0.smithi096.stdout:6/647: write d1/d5/f1b [988200,107945] 0 2024-04-18T21:07:00.944 INFO:tasks.workunit.client.0.smithi096.stdout:4/616: dwrite d2/f2e [0,4194304] 0 2024-04-18T21:07:00.945 INFO:tasks.workunit.client.0.smithi096.stdout:4/617: fsync d2/d2f/d33/f34 0 2024-04-18T21:07:00.947 INFO:tasks.workunit.client.0.smithi096.stdout:4/618: creat d2/d2f/d33/d55/d59/db9/fca x:0 0 0 2024-04-18T21:07:00.947 INFO:tasks.workunit.client.0.smithi096.stdout:4/619: write f0 [3965245,14349] 0 2024-04-18T21:07:00.948 INFO:tasks.workunit.client.0.smithi096.stdout:4/620: stat d2/f21 0 2024-04-18T21:07:00.948 INFO:tasks.workunit.client.0.smithi096.stdout:2/792: dwrite d11/d13/d1d/d5d/f8d [0,4194304] 0 2024-04-18T21:07:00.949 INFO:tasks.workunit.client.0.smithi096.stdout:4/621: readlink d2/d1d/l4d 0 2024-04-18T21:07:00.949 INFO:tasks.workunit.client.0.smithi096.stdout:0/592: write d1/db/d30/d31/f4c [226933,11916] 0 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4173.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 122.81724315700001, 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024075172999999998, 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.950 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4173", 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.96:0/2987142766", 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 189 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129293+0000", 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129294+0000", 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129300+0000", 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4e-06 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129309+0000", 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0389999999999993e-06 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.129316+0000", 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.294e-06 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150603+0000", 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021287245 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150760+0000", 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000156453 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.150974+0000", 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021451099999999999 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.152406+0000", 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014316629999999999 2024-04-18T21:07:00.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153110+0000", 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070375600000000004 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153259+0000", 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014937199999999999 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:04:58.153369+0000", 2024-04-18T21:07:00.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010963699999999999 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.349809232, 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026140824999999999, 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596727+0000", 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596730+0000", 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9100000000000001e-06 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596745+0000", 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4379000000000001e-05 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596770+0000", 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5089999999999999e-05 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596793+0000", 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3493e-05 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597372+0000", 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057908799999999996 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597688+0000", 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031536599999999998 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597987+0000", 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029974100000000002 2024-04-18T21:07:00.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618382+0000", 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020394237999999999 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622633+0000", 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042509310000000003 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622764+0000", 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013159099999999999 2024-04-18T21:07:00.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622868+0000", 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103998 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.349696108, 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026453397, 2024-04-18T21:07:00.961 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596840+0000", 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596842+0000", 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596851+0000", 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6459999999999999e-06 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596876+0000", 2024-04-18T21:07:00.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4882999999999999e-05 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596892+0000", 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6133e-05 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598652+0000", 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017597100000000001 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600541+0000", 2024-04-18T21:07:00.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018888780000000001 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600883+0000", 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034223599999999999 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618391+0000", 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017507666000000002 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623054+0000", 2024-04-18T21:07:00.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046637529999999996 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623196+0000", 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000141929 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623294+0000", 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7503000000000005e-05 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.349617026, 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:07:00.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:07:00.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.34951382200001, 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:07:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:07:00.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:07:00.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.34942405, 2024-04-18T21:07:00.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:00.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.349338012, 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:00.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:00.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:00.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:00.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.349273927, 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:00.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.349188329, 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:00.993 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.998 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.34912213600001, 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025339891, 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:00.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597414+0000", 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597416+0000", 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597423+0000", 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597443+0000", 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9979e-05 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597459+0000", 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5869999999999999e-05 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.599872+0000", 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024131140000000001 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600273+0000", 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040127099999999997 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.600619+0000", 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00034560299999999999 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614599+0000", 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013980464 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622530+0000", 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079303020000000002 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622669+0000", 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013891399999999999 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622754+0000", 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5618000000000006e-05 2024-04-18T21:07:01.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.349052758, 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025480604, 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597484+0000", 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597485+0000", 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597492+0000", 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2570000000000001e-06 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597511+0000", 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9207000000000001e-05 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597528+0000", 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7068999999999999e-05 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.601315+0000", 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037864420000000001 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602344+0000", 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001028698 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.602748+0000", 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040477500000000001 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614612+0000", 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011863574 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622842+0000", 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082303250000000001 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622915+0000", 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3201000000000006e-05 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622964+0000", 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8909999999999998e-05 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.348739091, 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025547374000000001, 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.009 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597797+0000", 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597799+0000", 2024-04-18T21:07:01.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3170000000000001e-06 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597808+0000", 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5990000000000008e-06 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597825+0000", 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6762999999999999e-05 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597834+0000", 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6000000000000007e-06 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603523+0000", 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056889189999999997 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.603792+0000", 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000269308 2024-04-18T21:07:01.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.604170+0000", 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037814499999999998 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618203+0000", 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014032849 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623114+0000", 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004911065 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623239+0000", 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012495799999999999 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623345+0000", 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105851 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:01.014 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.34868958200001, 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024827951000000001, 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597847+0000", 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597848+0000", 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597852+0000", 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4360000000000004e-06 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597864+0000", 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.216e-05 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597880+0000", 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5616000000000001e-05 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598004+0000", 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124451 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598315+0000", 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031105400000000001 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598641+0000", 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325979 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613884+0000", 2024-04-18T21:07:01.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015242652000000001 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622453+0000", 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008569452 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622580+0000", 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012686899999999999 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.622675+0000", 2024-04-18T21:07:01.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4551999999999999e-05 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.34862432, 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025749535, 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597912+0000", 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597914+0000", 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.356e-06 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597932+0000", 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8692999999999999e-05 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597952+0000", 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0129999999999999e-05 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597968+0000", 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5342999999999999e-05 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614990+0000", 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017021864000000001 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615308+0000", 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031803000000000002 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615623+0000", 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031574400000000002 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618799+0000", 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003175607 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623464+0000", 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046650830000000004 2024-04-18T21:07:01.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623577+0000", 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112475 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623662+0000", 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5210000000000006e-05 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.025 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.34849014, 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025430197000000002, 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598046+0000", 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598048+0000", 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1400000000000001e-06 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598056+0000", 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0600000000000008e-06 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598077+0000", 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1529999999999999e-05 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598091+0000", 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.431e-05 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612761+0000", 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014669499000000001 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613787+0000", 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001026192 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614106+0000", 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00031879 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618093+0000", 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039870169999999998 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623313+0000", 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052199020000000002 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623387+0000", 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4505999999999994e-05 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623477+0000", 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9251000000000003e-05 2024-04-18T21:07:01.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 112.348386675, 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025700833999999999, 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598150+0000", 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598151+0000", 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.393e-06 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598170+0000", 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8960000000000001e-05 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598192+0000", 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1435999999999999e-05 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.598208+0000", 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6059e-05 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617064+0000", 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018855894000000002 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617608+0000", 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054409800000000002 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623851+0000", 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006242994 2024-04-18T21:07:01.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.509346876999999, 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.035 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:01.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.040 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:10923 4.32 e61/53 4:4f258d88:::100000031eb.00000000:head v 61'183, mlcod=58'181)", 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:57.616649+0000", 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.3298871719999998, 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024037500999999999, 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.616649+0000", 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.616649+0000", 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.616650+0000", 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.63e-07 2024-04-18T21:07:01.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.621066+0000", 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044157440000000001 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.621092+0000", 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6820000000000001e-05 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.621108+0000", 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5982999999999999e-05 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.621243+0000", 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013432900000000001 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.621275+0000", 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2270000000000001e-05 2024-04-18T21:07:01.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.640641+0000", 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019365562999999999 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:57.640687+0000", 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6329000000000003e-05 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:11182 4.2a e62/16 4:55063679:::1000000327f.00000000:head v 62'179, mlcod=62'177)", 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:58.041053+0000", 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.9054835880000001, 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023302109000000001, 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.041053+0000", 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.041053+0000", 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.041054+0000", 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2359999999999999e-06 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.049055+0000", 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008000844 2024-04-18T21:07:01.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.049176+0000", 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121141 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.049195+0000", 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8992e-05 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.049307+0000", 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011174499999999999 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.049364+0000", 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7256999999999997e-05 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.064306+0000", 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014941764 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:58.064355+0000", 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9129999999999999e-05 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13409 4.24 e63/16 4:26c08ea6:::100000030ca.00000000:head v 63'184, mlcod=63'182)", 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.804737+0000", 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.14179951900000001, 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025905378999999999, 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.050 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.804737+0000", 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.804737+0000", 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.804738+0000", 2024-04-18T21:07:01.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4200000000000004e-07 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.819883+0000", 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015145156 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:01.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.819896+0000", 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.329e-05 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.819904+0000", 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8520000000000004e-06 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.820039+0000", 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000135172 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.820083+0000", 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3241000000000002e-05 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.830550+0000", 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010467762 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.830642+0000", 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1964000000000002e-05 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.055 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:01.056 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:01.056 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:01.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:01.062 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:01.055+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi096.stdout:0/593: creat d1/da3/fcb x:0 0 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi096.stdout:4/622: getdents d2/d2f/d33/d55/d59/d5f 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi096.stdout:0/594: fsync d1/d23/d32/d43/d6f/d8a/d91/fc2 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi096.stdout:1/665: dread d0/f17 [0,4194304] 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi096.stdout:8/675: dread d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi096.stdout:8/676: write d0/d64/d43/f7d [638078,48525] 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi096.stdout:1/666: rename d0/df/d16/d24/dc0/d33 to d0/df/d16/d24/dac/d6a/d8d/d9b/dca/dde 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:0/595: write d1/db/d25/f99 [1043697,54714] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:4/623: truncate d2/d2f/d33/f72 2713340 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/793: dwrite d11/d50/f71 [4194304,4194304] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:1/667: write d0/df/d16/d24/dc0/d5f/d60/f99 [3841854,123173] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/794: write d11/d13/d1d/d5d/f8d [4431267,121982] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:0/596: symlink d1/db/d30/d31/d39/d5d/d60/lcc 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:1/668: rmdir d0/df/d16/d24/dac/d6a/d8d/d9b/dca 39 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/795: write d11/d50/f71 [3522091,82220] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/796: dread - d11/d13/d1a/fe3 zero size 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:1/669: write d0/df/d16/d24/dc0/d5f/f6f [498895,119680] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:8/677: dwrite d0/d64/f42 [0,4194304] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:1/670: dread - d0/df/d16/fda zero size 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/797: mkdir d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d107 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:1/671: readlink d0/df/d16/d24/dac/d65/la9 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:1/672: dread - d0/df/d62/f85 zero size 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:1/673: getdents d0/df/d16/d24 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/678: dwrite d0/d3/d3a/dab/f44 [0,4194304] 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/679: chown d0/d3/db/ldb 118943 1 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/680: dread d0/d3/db/f13 [0,4194304] 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/681: creat d0/d3/d1d/d83/dcd/fde x:0 0 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:1/674: dwrite d0/df/d16/d24/dac/d6a/d8d/d9b/fb5 [0,4194304] 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:9/717: dread d0/d8/d11/d39/d63/f83 [0,4194304] 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/682: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/c9e 1 1 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:1/675: link d0/df/d16/d24/dc0/d5f/d60/f99 d0/df/d16/d24/dac/d6a/fdf 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:9/718: mkdir d0/d28/d7a/de5 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:9/719: fsync d0/d8/d89/fd9 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/683: read - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 zero size 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi096.stdout:1/676: creat d0/df/d16/d24/da8/fe0 x:0 0 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:9/720: chown d0/d28/d7a/dc3/dc6/f69 11189 1 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:1/677: mknod d0/df/d16/ce1 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:9/721: write d0/d44/f60 [956244,27357] 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:8/684: mknod d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/cdf 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:1/678: rmdir d0/df/d16/d24/da8 39 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:9/722: write d0/d8/d11/d39/d63/fba [4830680,58931] 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:1/679: creat d0/df/d16/d6c/dab/fe2 x:0 0 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:3/548: dread d4/d6/d1b/d2c/d31/d11/f40 [0,4194304] 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:9/723: rename d0/d8/d11/d1f to d0/d28/d2f/de6 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:1/680: write d0/df/d16/d24/dac/d6a/d8d/d9b/fb5 [2215243,6691] 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:3/549: dwrite d4/d6/d1b/d1d/f2b [0,4194304] 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:3/550: symlink d4/d6/d7/d90/la3 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi096.stdout:3/551: fsync d4/d6/d1b/f38 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/552: creat d4/d6/d7/d90/fa4 x:0 0 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/553: truncate d4/d6/d1b/d2c/f53 100929 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/554: readlink d4/d6/l8f 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/555: dread - d4/d6/d1b/d2c/d5c/f80 zero size 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/556: unlink d4/d6/d1b/d2c/d31/d4e/c6c 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/557: symlink d4/d6/d1b/d63/la5 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/558: dread d4/d6/d1b/d2c/d31/d11/f40 [0,4194304] 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/559: readlink d4/d6/d1b/d1d/d64/l79 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:8/685: dread d0/d3/f49 [0,4194304] 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:7/547: dread d0/d7/d8/f55 [0,4194304] 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:8/686: dread d0/d3/d3a/dab/d46/dc5/fa7 [0,4194304] 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:9/724: dread d0/d44/f60 [0,4194304] 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:8/687: write d0/d64/f6d [1532992,53402] 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:4/624: dread d2/d2f/d33/f72 [0,4194304] 0 2024-04-18T21:07:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:8/688: creat d0/d3/d1d/d83/dcd/d7f/dac/d1b/fe0 x:0 0 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:9/725: link d0/dc/d5f/d76/ce2 d0/dc/d5f/ce7 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/625: mknod d2/d2f/d39/d43/ccb 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/626: creat d2/d2f/d33/fcc x:0 0 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/548: dwrite d0/d7/d49/f7b [0,4194304] 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/627: mkdir d2/d2f/d33/d55/d59/d5f/dcd 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/549: write d0/d7/d8/f1a [2250706,111142] 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/628: write d2/d2f/d33/d55/da3/fa7 [357764,21966] 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/550: mkdir d0/d7/da3 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/629: rmdir d2/d2a/d54 39 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/630: creat d2/d2f/d33/d55/d59/d5f/fce x:0 0 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:1/681: dread d0/df/d16/f50 [0,4194304] 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/631: write d2/d2f/fb1 [243276,19765] 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:1/682: symlink d0/df/d30/le3 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/632: truncate d2/d1d/d3a/fbc 455287 0 2024-04-18T21:07:01.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/633: write d2/f31 [921818,123282] 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/726: truncate d0/d28/d3d/f62 777395 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:4/634: unlink d2/d2f/d33/d55/d57/d88/da4/fc0 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:4/635: readlink d2/d2a/d54/d5b/l9c 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/727: creat d0/dc/d5f/fe8 x:0 0 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:4/636: dread - d2/f97 zero size 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/728: creat d0/dc/d5f/d76/fe9 x:0 0 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:4/637: creat d2/d2f/d33/d55/d59/d5f/dcd/fcf x:0 0 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:8/689: dread d0/d3/d1d/d83/dcd/d7f/dac/d33/f3b [0,4194304] 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:8/690: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:4/638: dwrite d2/f4c [4194304,4194304] 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/729: dwrite d0/d8/d9/fb9 [0,4194304] 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/730: chown d0/d28/da1 55529 1 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:8/691: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d33/de2 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/731: creat d0/d28/da1/fea x:0 0 0 2024-04-18T21:07:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:8/692: getdents d0/d64/d43 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:8/693: write d0/f8e [1414167,88366] 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:8/694: stat d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/c34 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:1/683: dread d0/df/d16/d6c/f9a [0,4194304] 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:8/695: truncate d0/d3/db/f2d 69105 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:4/639: write d2/d2f/d39/f4b [2640182,39880] 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:1/684: creat d0/df/d16/d24/dac/d65/fe4 x:0 0 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:8/696: symlink d0/d3/d1d/dca/le3 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:1/685: chown d0/ce 636225205 1 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:8/697: truncate d0/d3/fb2 94886 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:9/732: dread d0/d8/d11/f90 [0,4194304] 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:4/640: dwrite d2/d2f/d33/f35 [0,4194304] 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:9/733: mknod d0/d8/d11/d48/ceb 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi096.stdout:1/686: read d0/df/d30/f4e [128428,73207] 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:4/641: creat d2/d2f/d33/d55/d59/db9/fd0 x:0 0 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:8/698: dwrite d0/d3/d1d/d83/dcd/f7e [0,4194304] 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:1/687: truncate d0/df/d16/d24/f2b 4915489 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:1/688: mkdir d0/df/de5 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:1/689: rename d0/df/d16/d24/dac/f93 to d0/dd0/ddb/fe6 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/621: sync 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/622: write d2/f1b [1672769,12792] 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/623: chown d2/d11/d28/d4a/c58 2427452 1 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/624: getdents d2/d8f 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:1/690: dwrite d0/df/d16/d24/dc0/f73 [4194304,4194304] 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:9/734: getdents d0/d8/d11/d48 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/625: fdatasync d2/d11/d28/d64/dba/fe4 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/626: creat d2/d11/d28/d4a/fea x:0 0 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:1/691: getdents d0/df/d16/d24/dac/d6a/d8d/d9b/dca/dde 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/627: creat d2/d11/d28/d4a/de6/feb x:0 0 0 2024-04-18T21:07:01.079 INFO:tasks.workunit.client.0.smithi096.stdout:1/692: mknod d0/df/de5/ce7 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:8/699: dread d0/f94 [0,4194304] 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:9/735: dwrite d0/d28/fa4 [0,4194304] 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:9/736: chown d0/d8/d11/fb0 1658698574 1 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:9/737: unlink d0/d28/l5b 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:1/693: dwrite d0/df/d16/d24/f3a [4194304,4194304] 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:1/694: getdents d0/df/d16/d24/dac/d6a/d8d/d9b/dca/dde 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:8/700: dread d0/d3/db/f2d [0,4194304] 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:1/695: creat d0/df/d16/d24/dac/dd2/fe8 x:0 0 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:1/696: write d0/df/d16/d24/dac/d6a/d8d/d95/f97 [191734,51788] 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi096.stdout:1/697: rmdir d0/df/d62 39 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:3/560: sync 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:0/597: sync 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:6/648: sync 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:2/798: sync 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:7/551: sync 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:4/642: sync 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:5/628: sync 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:1/698: mknod d0/df/d30/d53/ce9 0 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:5/629: readlink d2/d11/l30 0 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:4/643: chown d2/d2f/d33/d55/d57 358176010 1 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:6/649: creat d1/fd9 x:0 0 0 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:5/630: readlink d2/l4d 0 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi096.stdout:0/598: rename d1/db/d30/f51 to d1/fcd 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:6/650: mkdir d1/d3a/d57/d26/dda 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/631: symlink d2/d11/d28/lec 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:0/599: getdents d1/db/d30/d4a/dae 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/632: mkdir d2/d18/d9d/da0/dab/ded 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:8/701: write d0/d3/fb2 [785650,59403] 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:0/600: chown d1/da5/cbf 5978622 1 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/633: rmdir d2/d11/d28/d64/d7e 39 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:2/799: dread d11/d13/d1a/d1e/d28/d4e/d80/f95 [0,4194304] 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:7/552: dwrite d0/d7/f5f [4194304,4194304] 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:4/644: dwrite d2/d1d/fbe [0,4194304] 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:3/561: dwrite d4/d8/f48 [0,4194304] 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:7/553: chown d0/c27 1487 1 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/634: write d2/d18/d9d/da0/dab/fc9 [682789,118538] 0 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:0/601: unlink d1/f62 0 2024-04-18T21:07:01.085 INFO:tasks.workunit.client.0.smithi096.stdout:7/554: write d0/f1d [2957552,27340] 0 2024-04-18T21:07:01.085 INFO:tasks.workunit.client.0.smithi096.stdout:3/562: fdatasync d4/d6/d1b/d1d/d64/f78 0 2024-04-18T21:07:01.085 INFO:tasks.workunit.client.0.smithi096.stdout:4/645: creat d2/d2a/d54/d71/d99/dad/fd1 x:0 0 0 2024-04-18T21:07:01.085 INFO:tasks.workunit.client.0.smithi096.stdout:2/800: write d11/d50/f83 [2768278,6459] 0 2024-04-18T21:07:01.086 INFO:tasks.workunit.client.0.smithi096.stdout:0/602: mkdir d1/d23/d32/d43/daa/dce 0 2024-04-18T21:07:01.086 INFO:tasks.workunit.client.0.smithi096.stdout:5/635: truncate d2/d18/d9d/da0/fc7 1037132 0 2024-04-18T21:07:01.086 INFO:tasks.workunit.client.0.smithi096.stdout:0/603: mkdir d1/db/d30/d4a/dae/dcf 0 2024-04-18T21:07:01.086 INFO:tasks.workunit.client.0.smithi096.stdout:4/646: mknod d2/d2f/d39/cd2 0 2024-04-18T21:07:01.087 INFO:tasks.workunit.client.0.smithi096.stdout:0/604: rename d1/f3 to d1/db/d30/d31/d85/d58/fd0 0 2024-04-18T21:07:01.087 INFO:tasks.workunit.client.0.smithi096.stdout:2/801: mkdir d11/d50/d108 0 2024-04-18T21:07:01.088 INFO:tasks.workunit.client.0.smithi096.stdout:4/647: getdents d2/d2a/d54/d5b/d89 0 2024-04-18T21:07:01.089 INFO:tasks.workunit.client.0.smithi096.stdout:4/648: stat d2/c24 0 2024-04-18T21:07:01.089 INFO:tasks.workunit.client.0.smithi096.stdout:2/802: mkdir d11/d13/d1a/d1e/d28/d4e/d80/dd2/d109 0 2024-04-18T21:07:01.090 INFO:tasks.workunit.client.0.smithi096.stdout:0/605: getdents d1/db/d30/d31/d39/d6d 0 2024-04-18T21:07:01.091 INFO:tasks.workunit.client.0.smithi096.stdout:4/649: rename d2/fc to d2/d2a/d54/d5b/d89/fd3 0 2024-04-18T21:07:01.091 INFO:tasks.workunit.client.0.smithi096.stdout:2/803: readlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d70/l75 0 2024-04-18T21:07:01.092 INFO:tasks.workunit.client.0.smithi096.stdout:3/563: dwrite d4/d6/d1b/d1d/f2e [0,4194304] 0 2024-04-18T21:07:01.092 INFO:tasks.workunit.client.0.smithi096.stdout:5/636: dread d2/d38/fa9 [0,4194304] 0 2024-04-18T21:07:01.093 INFO:tasks.workunit.client.0.smithi096.stdout:0/606: rename d1/db/d25/d54/l9d to d1/db/d30/ld1 0 2024-04-18T21:07:01.093 INFO:tasks.workunit.client.0.smithi096.stdout:9/738: dread d0/dc/f32 [0,4194304] 0 2024-04-18T21:07:01.095 INFO:tasks.workunit.client.0.smithi096.stdout:5/637: rename d2/d11/f3d to d2/d38/d4c/fee 0 2024-04-18T21:07:01.095 INFO:tasks.workunit.client.0.smithi096.stdout:9/739: creat d0/d28/d7a/fec x:0 0 0 2024-04-18T21:07:01.095 INFO:tasks.workunit.client.0.smithi096.stdout:3/564: rename d4/d6/d1b/d1d/d64 to d4/d6/d1b/d2c/d6b/d99/da6 0 2024-04-18T21:07:01.095 INFO:tasks.workunit.client.0.smithi096.stdout:0/607: getdents d1/db/d30/d31/d65 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:9/740: rmdir d0/d28/d7a/dc3/dc6 39 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/565: unlink d4/fe 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:5/638: creat d2/d11/d28/fef x:0 0 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:9/741: write d0/dc/d5f/d76/f70 [4688243,46025] 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/566: truncate d4/d6/f66 581922 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:5/639: chown d2/d11/d28/d4a/d55/d81/ddf/de5 0 1 2024-04-18T21:07:01.097 INFO:tasks.workunit.client.0.smithi096.stdout:5/640: fdatasync d2/d18/d9d/da0/fc7 0 2024-04-18T21:07:01.098 INFO:tasks.workunit.client.0.smithi096.stdout:9/742: truncate d0/d28/d7a/f9b 2094774 0 2024-04-18T21:07:01.098 INFO:tasks.workunit.client.0.smithi096.stdout:8/702: read d0/d64/d43/f7d [350166,109086] 0 2024-04-18T21:07:01.098 INFO:tasks.workunit.client.0.smithi096.stdout:3/567: truncate d4/d6/d1b/d2c/f53 52528 0 2024-04-18T21:07:01.098 INFO:tasks.workunit.client.0.smithi096.stdout:5/641: write d2/f79 [10337,22776] 0 2024-04-18T21:07:01.099 INFO:tasks.workunit.client.0.smithi096.stdout:9/743: write d0/f4 [5366780,27403] 0 2024-04-18T21:07:01.099 INFO:tasks.workunit.client.0.smithi096.stdout:8/703: write d0/f12 [1242542,29665] 0 2024-04-18T21:07:01.100 INFO:tasks.workunit.client.0.smithi096.stdout:3/568: write d4/d6/d1b/d2c/d31/d11/f40 [729508,22658] 0 2024-04-18T21:07:01.100 INFO:tasks.workunit.client.0.smithi096.stdout:1/699: dread d0/df/d16/d24/dac/d6a/fad [0,4194304] 0 2024-04-18T21:07:01.100 INFO:tasks.workunit.client.0.smithi096.stdout:9/744: symlink d0/d28/d7a/dc3/led 0 2024-04-18T21:07:01.101 INFO:tasks.workunit.client.0.smithi096.stdout:3/569: write d4/d8/f48 [5220309,80007] 0 2024-04-18T21:07:01.101 INFO:tasks.workunit.client.0.smithi096.stdout:4/650: truncate d2/d2f/f36 2434350 0 2024-04-18T21:07:01.101 INFO:tasks.workunit.client.0.smithi096.stdout:1/700: mknod d0/df/cea 0 2024-04-18T21:07:01.102 INFO:tasks.workunit.client.0.smithi096.stdout:5/642: getdents d2/d11/d28/d64/d7e 0 2024-04-18T21:07:01.102 INFO:tasks.workunit.client.0.smithi096.stdout:9/745: mkdir d0/dc/d5f/d76/dc1/dee 0 2024-04-18T21:07:01.103 INFO:tasks.workunit.client.0.smithi096.stdout:6/651: dread d1/d5/da/d46/d71/f84 [0,4194304] 0 2024-04-18T21:07:01.104 INFO:tasks.workunit.client.0.smithi096.stdout:4/651: rename d2/d2a/d54/d5b/l9d to d2/d2a/d54/d71/ld4 0 2024-04-18T21:07:01.105 INFO:tasks.workunit.client.0.smithi096.stdout:5/643: getdents d2 0 2024-04-18T21:07:01.105 INFO:tasks.workunit.client.0.smithi096.stdout:5/644: fsync d2/d11/d28/d4a/fca 0 2024-04-18T21:07:01.106 INFO:tasks.workunit.client.0.smithi096.stdout:5/645: readlink d2/d18/d61/l7d 0 2024-04-18T21:07:01.106 INFO:tasks.workunit.client.0.smithi096.stdout:8/704: dwrite d0/d3/faf [0,4194304] 0 2024-04-18T21:07:01.107 INFO:tasks.workunit.client.0.smithi096.stdout:5/646: dread - d2/d11/d28/d64/f92 zero size 2024-04-18T21:07:01.107 INFO:tasks.workunit.client.0.smithi096.stdout:8/705: stat d0/d3/d3a/cad 0 2024-04-18T21:07:01.108 INFO:tasks.workunit.client.0.smithi096.stdout:3/570: dwrite d4/d6/d1b/d2c/f57 [0,4194304] 0 2024-04-18T21:07:01.109 INFO:tasks.workunit.client.0.smithi096.stdout:3/571: chown d4/d8/f74 38490 1 2024-04-18T21:07:01.110 INFO:tasks.workunit.client.0.smithi096.stdout:5/647: getdents d2/d11/d28/d4a/de6 0 2024-04-18T21:07:01.110 INFO:tasks.workunit.client.0.smithi096.stdout:5/648: chown d2/d38/d4c/c66 32089168 1 2024-04-18T21:07:01.111 INFO:tasks.workunit.client.0.smithi096.stdout:2/804: read d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/ff4 [760040,94136] 0 2024-04-18T21:07:01.112 INFO:tasks.workunit.client.0.smithi096.stdout:5/649: mkdir d2/d6a/df0 0 2024-04-18T21:07:01.112 INFO:tasks.workunit.client.0.smithi096.stdout:5/650: mknod d2/d18/d9d/cf1 0 2024-04-18T21:07:01.112 INFO:tasks.workunit.client.0.smithi096.stdout:2/805: dread - d11/d13/d1a/d1e/d28/d4e/f7a zero size 2024-04-18T21:07:01.113 INFO:tasks.workunit.client.0.smithi096.stdout:5/651: fsync d2/d11/d28/d4a/d55/fd8 0 2024-04-18T21:07:01.113 INFO:tasks.workunit.client.0.smithi096.stdout:5/652: rename d2/d18 to d2/d18/d9d/df2 22 2024-04-18T21:07:01.114 INFO:tasks.workunit.client.0.smithi096.stdout:2/806: rename d11/d13/d1a/d1e/d28/d4e/d80 to d11/d13/d1a/d1e/d28/d4e/d63/d10a 0 2024-04-18T21:07:01.114 INFO:tasks.workunit.client.0.smithi096.stdout:0/608: sync 2024-04-18T21:07:01.114 INFO:tasks.workunit.client.0.smithi096.stdout:1/701: sync 2024-04-18T21:07:01.114 INFO:tasks.workunit.client.0.smithi096.stdout:6/652: sync 2024-04-18T21:07:01.114 INFO:tasks.workunit.client.0.smithi096.stdout:4/652: sync 2024-04-18T21:07:01.115 INFO:tasks.workunit.client.0.smithi096.stdout:0/609: write d1/db/d30/d31/f7f [133559,106384] 0 2024-04-18T21:07:01.115 INFO:tasks.workunit.client.0.smithi096.stdout:6/653: fdatasync d1/f30 0 2024-04-18T21:07:01.115 INFO:tasks.workunit.client.0.smithi096.stdout:2/807: write d11/d13/d1a/d1e/d28/d4e/d63/fb6 [4450421,63454] 0 2024-04-18T21:07:01.116 INFO:tasks.workunit.client.0.smithi096.stdout:4/653: chown d2/d2f/d33/d55/d57/f5c 6837 1 2024-04-18T21:07:01.116 INFO:tasks.workunit.client.0.smithi096.stdout:0/610: chown d1/db/d30/d31/d39/db3 7403474 1 2024-04-18T21:07:01.116 INFO:tasks.workunit.client.0.smithi096.stdout:2/808: creat d11/d50/d5b/f10b x:0 0 0 2024-04-18T21:07:01.117 INFO:tasks.workunit.client.0.smithi096.stdout:1/702: rename d0/c87 to d0/df/d16/d24/dc0/d5f/d60/d90/ceb 0 2024-04-18T21:07:01.117 INFO:tasks.workunit.client.0.smithi096.stdout:6/654: creat d1/d5/da/d90/fdb x:0 0 0 2024-04-18T21:07:01.117 INFO:tasks.workunit.client.0.smithi096.stdout:2/809: chown fe 63 1 2024-04-18T21:07:01.117 INFO:tasks.workunit.client.0.smithi096.stdout:0/611: unlink d1/db/d30/d31/d85/c45 0 2024-04-18T21:07:01.117 INFO:tasks.workunit.client.0.smithi096.stdout:4/654: rename d2/d1d/fbe to d2/d2f/d33/d55/d57/d88/da4/fd5 0 2024-04-18T21:07:01.118 INFO:tasks.workunit.client.0.smithi096.stdout:1/703: write d0/df/d16/d24/da8/fd1 [112549,77478] 0 2024-04-18T21:07:01.118 INFO:tasks.workunit.client.0.smithi096.stdout:0/612: stat d1/db/d30/d31/d85/fa 0 2024-04-18T21:07:01.118 INFO:tasks.workunit.client.0.smithi096.stdout:2/810: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/c10c 0 2024-04-18T21:07:01.119 INFO:tasks.workunit.client.0.smithi096.stdout:4/655: mknod d2/d2a/d54/d5b/d89/d90/cd6 0 2024-04-18T21:07:01.119 INFO:tasks.workunit.client.0.smithi096.stdout:0/613: creat d1/fd2 x:0 0 0 2024-04-18T21:07:01.119 INFO:tasks.workunit.client.0.smithi096.stdout:1/704: mknod d0/df/d62/cec 0 2024-04-18T21:07:01.120 INFO:tasks.workunit.client.0.smithi096.stdout:2/811: link d11/d13/d1a/d1e/d28/f86 d11/d13/d1d/de8/f10d 0 2024-04-18T21:07:01.120 INFO:tasks.workunit.client.0.smithi096.stdout:1/705: creat d0/fed x:0 0 0 2024-04-18T21:07:01.121 INFO:tasks.workunit.client.0.smithi096.stdout:2/812: write d11/d50/d5b/fec [122927,56121] 0 2024-04-18T21:07:01.121 INFO:tasks.workunit.client.0.smithi096.stdout:1/706: rmdir d0/df/d16/d6c/dc8 0 2024-04-18T21:07:01.123 INFO:tasks.workunit.client.0.smithi096.stdout:9/746: truncate d0/dc/d5f/d76/f84 2873629 0 2024-04-18T21:07:01.123 INFO:tasks.workunit.client.0.smithi096.stdout:4/656: fdatasync d2/d2a/d54/d71/d99/dad/fd1 0 2024-04-18T21:07:01.124 INFO:tasks.workunit.client.0.smithi096.stdout:8/706: write d0/d5d/f77 [772700,109790] 0 2024-04-18T21:07:01.124 INFO:tasks.workunit.client.0.smithi096.stdout:9/747: creat d0/dc/d5f/d76/dd5/fef x:0 0 0 2024-04-18T21:07:01.126 INFO:tasks.workunit.client.0.smithi096.stdout:4/657: getdents d2/d2f 0 2024-04-18T21:07:01.127 INFO:tasks.workunit.client.0.smithi096.stdout:0/614: dwrite d1/db/fc1 [0,4194304] 0 2024-04-18T21:07:01.127 INFO:tasks.workunit.client.0.smithi096.stdout:8/707: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4 0 2024-04-18T21:07:01.129 INFO:tasks.workunit.client.0.smithi096.stdout:3/572: read d4/d8/f1f [1233539,53193] 0 2024-04-18T21:07:01.129 INFO:tasks.workunit.client.0.smithi096.stdout:4/658: write d2/d2a/d54/d6d/f81 [535827,16522] 0 2024-04-18T21:07:01.129 INFO:tasks.workunit.client.0.smithi096.stdout:0/615: rmdir d1/db/d30/d4a 39 2024-04-18T21:07:01.130 INFO:tasks.workunit.client.0.smithi096.stdout:6/655: dwrite d1/d5/da/d44/d4e/f59 [0,4194304] 0 2024-04-18T21:07:01.133 INFO:tasks.workunit.client.0.smithi096.stdout:3/573: creat d4/d6/d1b/d1d/fa7 x:0 0 0 2024-04-18T21:07:01.134 INFO:tasks.workunit.client.0.smithi096.stdout:8/708: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/fe5 x:0 0 0 2024-04-18T21:07:01.134 INFO:tasks.workunit.client.0.smithi096.stdout:2/813: dwrite d11/d13/f15 [0,4194304] 0 2024-04-18T21:07:01.134 INFO:tasks.workunit.client.0.smithi096.stdout:0/616: mkdir d1/d23/d32/d43/d6f/dd3 0 2024-04-18T21:07:01.134 INFO:tasks.workunit.client.0.smithi096.stdout:3/574: unlink d4/d6/f66 0 2024-04-18T21:07:01.137 INFO:tasks.workunit.client.0.smithi096.stdout:4/659: dwrite d2/d1d/fb5 [0,4194304] 0 2024-04-18T21:07:01.137 INFO:tasks.workunit.client.0.smithi096.stdout:0/617: mkdir d1/db/dd4 0 2024-04-18T21:07:01.137 INFO:tasks.workunit.client.0.smithi096.stdout:8/709: fsync d0/d3/db/f6a 0 2024-04-18T21:07:01.137 INFO:tasks.workunit.client.0.smithi096.stdout:4/660: unlink d2/l5d 0 2024-04-18T21:07:01.138 INFO:tasks.workunit.client.0.smithi096.stdout:4/661: dread - d2/d1d/faf zero size 2024-04-18T21:07:01.138 INFO:tasks.workunit.client.0.smithi096.stdout:5/653: dread d2/d11/d28/d4a/d55/f7c [0,4194304] 0 2024-04-18T21:07:01.138 INFO:tasks.workunit.client.0.smithi096.stdout:4/662: stat d2/d2f/d39/d43 0 2024-04-18T21:07:01.139 INFO:tasks.workunit.client.0.smithi096.stdout:4/663: chown d2/d2f/d39/cd2 367325693 1 2024-04-18T21:07:01.140 INFO:tasks.workunit.client.0.smithi096.stdout:4/664: dread - d2/d2a/d54/d6d/fc8 zero size 2024-04-18T21:07:01.141 INFO:tasks.workunit.client.0.smithi096.stdout:8/710: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/dd9/fe6 x:0 0 0 2024-04-18T21:07:01.141 INFO:tasks.workunit.client.0.smithi096.stdout:9/748: truncate d0/d8/d9/f3a 531972 0 2024-04-18T21:07:01.142 INFO:tasks.workunit.client.0.smithi096.stdout:5/654: creat d2/d11/d28/d64/ff3 x:0 0 0 2024-04-18T21:07:01.142 INFO:tasks.workunit.client.0.smithi096.stdout:4/665: chown d2/d1d/l69 165 1 2024-04-18T21:07:01.142 INFO:tasks.workunit.client.0.smithi096.stdout:8/711: write d0/d3/f4c [219911,51974] 0 2024-04-18T21:07:01.143 INFO:tasks.workunit.client.0.smithi096.stdout:4/666: stat d2/d2f/d33/fa0 0 2024-04-18T21:07:01.143 INFO:tasks.workunit.client.0.smithi096.stdout:2/814: dwrite d11/d13/d1a/d1e/d28/f3e [0,4194304] 0 2024-04-18T21:07:01.143 INFO:tasks.workunit.client.0.smithi096.stdout:5/655: chown d2/d11/c31 44625 1 2024-04-18T21:07:01.144 INFO:tasks.workunit.client.0.smithi096.stdout:1/707: dread d0/df/f2e [0,4194304] 0 2024-04-18T21:07:01.145 INFO:tasks.workunit.client.0.smithi096.stdout:9/749: symlink d0/dc/d5f/d76/dd5/lf0 0 2024-04-18T21:07:01.146 INFO:tasks.workunit.client.0.smithi096.stdout:5/656: unlink d2/d18/d61/d6d/f77 0 2024-04-18T21:07:01.146 INFO:tasks.workunit.client.0.smithi096.stdout:4/667: write d2/f50 [2496644,19047] 0 2024-04-18T21:07:01.147 INFO:tasks.workunit.client.0.smithi096.stdout:3/575: write d4/d6/d22/d20/f3f [4276644,4954] 0 2024-04-18T21:07:01.147 INFO:tasks.workunit.client.0.smithi096.stdout:1/708: creat d0/df/d16/d24/dac/d65/fee x:0 0 0 2024-04-18T21:07:01.147 INFO:tasks.workunit.client.0.smithi096.stdout:5/657: fdatasync d2/d11/d28/d64/f92 0 2024-04-18T21:07:01.147 INFO:tasks.workunit.client.0.smithi096.stdout:4/668: rmdir d2/d2a/d54/d6d 39 2024-04-18T21:07:01.147 INFO:tasks.workunit.client.0.smithi096.stdout:2/815: getdents d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5 0 2024-04-18T21:07:01.148 INFO:tasks.workunit.client.0.smithi096.stdout:3/576: symlink d4/d6/d1b/d63/la8 0 2024-04-18T21:07:01.149 INFO:tasks.workunit.client.0.smithi096.stdout:1/709: symlink d0/df/d16/d24/dc0/lef 0 2024-04-18T21:07:01.149 INFO:tasks.workunit.client.0.smithi096.stdout:2/816: mknod d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5/c10e 0 2024-04-18T21:07:01.150 INFO:tasks.workunit.client.0.smithi096.stdout:8/712: dread d0/d3/fd [0,4194304] 0 2024-04-18T21:07:01.150 INFO:tasks.workunit.client.0.smithi096.stdout:6/656: dread d1/d5/f15 [0,4194304] 0 2024-04-18T21:07:01.151 INFO:tasks.workunit.client.0.smithi096.stdout:5/658: creat d2/d6a/df0/ff4 x:0 0 0 2024-04-18T21:07:01.152 INFO:tasks.workunit.client.0.smithi096.stdout:1/710: creat d0/df/d16/d24/dac/d6a/d8d/d9b/dca/dde/ff0 x:0 0 0 2024-04-18T21:07:01.152 INFO:tasks.workunit.client.0.smithi096.stdout:8/713: mknod d0/d3/d3a/dab/d61/ce7 0 2024-04-18T21:07:01.152 INFO:tasks.workunit.client.0.smithi096.stdout:6/657: fsync d1/d5/da/d44/d4e/f8c 0 2024-04-18T21:07:01.153 INFO:tasks.workunit.client.0.smithi096.stdout:2/817: write d11/d13/d1a/d1e/d28/d4e/d5c/fb5 [309920,76019] 0 2024-04-18T21:07:01.155 INFO:tasks.workunit.client.0.smithi096.stdout:1/711: symlink d0/df/d16/d24/dac/dd2/lf1 0 2024-04-18T21:07:01.155 INFO:tasks.workunit.client.0.smithi096.stdout:9/750: dwrite d0/d8/d11/f38 [0,4194304] 0 2024-04-18T21:07:01.155 INFO:tasks.workunit.client.0.smithi096.stdout:3/577: rename d4/d6/d1b/d1d/f68 to d4/d6/d1b/d2c/d6b/d99/fa9 0 2024-04-18T21:07:01.155 INFO:tasks.workunit.client.0.smithi096.stdout:2/818: chown d11/d13/d1d/d5d/f8d 4132397 1 2024-04-18T21:07:01.155 INFO:tasks.workunit.client.0.smithi096.stdout:8/714: unlink d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/l30 0 2024-04-18T21:07:01.155 INFO:tasks.workunit.client.0.smithi096.stdout:9/751: fdatasync d0/d8/d11/d48/f67 0 2024-04-18T21:07:01.156 INFO:tasks.workunit.client.0.smithi096.stdout:1/712: mknod d0/df/d16/d24/dac/dd2/cf2 0 2024-04-18T21:07:01.156 INFO:tasks.workunit.client.0.smithi096.stdout:2/819: truncate d11/d50/fdd 430842 0 2024-04-18T21:07:01.157 INFO:tasks.workunit.client.0.smithi096.stdout:3/578: mkdir d4/d6/d22/d20/d46/d50/daa 0 2024-04-18T21:07:01.157 INFO:tasks.workunit.client.0.smithi096.stdout:4/669: dwrite d2/d2f/d33/d55/d57/f5c [0,4194304] 0 2024-04-18T21:07:01.157 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:01.157+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:01.158 INFO:tasks.workunit.client.0.smithi096.stdout:2/820: chown d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5/ld7 1741 1 2024-04-18T21:07:01.158 INFO:tasks.workunit.client.0.smithi096.stdout:6/658: read d1/d5/da/d44/f7d [1128274,90587] 0 2024-04-18T21:07:01.159 INFO:tasks.workunit.client.0.smithi096.stdout:1/713: truncate d0/df/d16/d24/dc0/d5f/d60/d8f/fd4 1048540 0 2024-04-18T21:07:01.160 INFO:tasks.workunit.client.0.smithi096.stdout:4/670: creat d2/d2f/d33/d55/d59/fd7 x:0 0 0 2024-04-18T21:07:01.160 INFO:tasks.workunit.client.0.smithi096.stdout:6/659: chown d1/d5/ld2 96 1 2024-04-18T21:07:01.160 INFO:tasks.workunit.client.0.smithi096.stdout:5/659: fsync d2/d11/d28/d64/ff3 0 2024-04-18T21:07:01.160 INFO:tasks.workunit.client.0.smithi096.stdout:8/715: link d0/d3/d3a/dab/d61/f70 d0/d3/d1d/d83/dcd/dd1/dda/fe8 0 2024-04-18T21:07:01.161 INFO:tasks.workunit.client.0.smithi096.stdout:2/821: dread d11/d13/d1a/d1e/d28/d4e/d63/d10a/f95 [0,4194304] 0 2024-04-18T21:07:01.161 INFO:tasks.workunit.client.0.smithi096.stdout:1/714: stat d0/df/d16/d24/dc0/d5f 0 2024-04-18T21:07:01.163 INFO:tasks.workunit.client.0.smithi096.stdout:6/660: creat d1/d3a/d57/d66/d80/fdc x:0 0 0 2024-04-18T21:07:01.163 INFO:tasks.workunit.client.0.smithi096.stdout:4/671: mknod d2/d2a/d54/cd8 0 2024-04-18T21:07:01.163 INFO:tasks.workunit.client.0.smithi096.stdout:2/822: chown d11/d13/d1a/d1e/d28/d4e/f93 12 1 2024-04-18T21:07:01.165 INFO:tasks.workunit.client.0.smithi096.stdout:3/579: dread d4/d6/d1b/d1d/f2b [0,4194304] 0 2024-04-18T21:07:01.165 INFO:tasks.workunit.client.0.smithi096.stdout:0/618: dread d1/db/d30/f87 [0,4194304] 0 2024-04-18T21:07:01.165 INFO:tasks.workunit.client.0.smithi096.stdout:4/672: symlink d2/dbb/ld9 0 2024-04-18T21:07:01.166 INFO:tasks.workunit.client.0.smithi096.stdout:6/661: chown d1/d3a/d57/d66 3 1 2024-04-18T21:07:01.166 INFO:tasks.workunit.client.0.smithi096.stdout:1/715: write d0/df/d16/d24/dac/d6a/d8d/d95/fbb [4476337,38153] 0 2024-04-18T21:07:01.167 INFO:tasks.workunit.client.0.smithi096.stdout:9/752: dwrite d0/d8/d11/d39/fca [4194304,4194304] 0 2024-04-18T21:07:01.167 INFO:tasks.workunit.client.0.smithi096.stdout:2/823: stat d11/d13/d1d/d5d/l6e 0 2024-04-18T21:07:01.167 INFO:tasks.workunit.client.0.smithi096.stdout:8/716: read - d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/fbc zero size 2024-04-18T21:07:01.167 INFO:tasks.workunit.client.0.smithi096.stdout:6/662: dread - d1/d5/fbd zero size 2024-04-18T21:07:01.168 INFO:tasks.workunit.client.0.smithi096.stdout:7/555: dread d0/d7/d8/f1a [0,4194304] 0 2024-04-18T21:07:01.169 INFO:tasks.workunit.client.0.smithi096.stdout:4/673: mknod d2/d2a/d54/d5b/d89/cda 0 2024-04-18T21:07:01.170 INFO:tasks.workunit.client.0.smithi096.stdout:0/619: mknod d1/db/cd5 0 2024-04-18T21:07:01.170 INFO:tasks.workunit.client.0.smithi096.stdout:7/556: creat d0/d20/d39/d8a/fa4 x:0 0 0 2024-04-18T21:07:01.171 INFO:tasks.workunit.client.0.smithi096.stdout:8/717: write d0/d3/d1d/d83/dcd/d7f/dac/d33/f92 [1076871,100707] 0 2024-04-18T21:07:01.172 INFO:tasks.workunit.client.0.smithi096.stdout:4/674: creat d2/d1d/d3a/fdb x:0 0 0 2024-04-18T21:07:01.172 INFO:tasks.workunit.client.0.smithi096.stdout:5/660: dwrite d2/d11/d28/d4a/fea [0,4194304] 0 2024-04-18T21:07:01.173 INFO:tasks.workunit.client.0.smithi096.stdout:2/824: truncate d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5/fc9 325305 0 2024-04-18T21:07:01.174 INFO:tasks.workunit.client.0.smithi096.stdout:5/661: write d2/d18/d9d/da0/dcb/fde [33420,19142] 0 2024-04-18T21:07:01.175 INFO:tasks.workunit.client.0.smithi096.stdout:9/753: dwrite d0/d44/fcb [0,4194304] 0 2024-04-18T21:07:01.176 INFO:tasks.workunit.client.0.smithi096.stdout:4/675: chown d2/d2f/d33/d55/d59/c68 1 1 2024-04-18T21:07:01.176 INFO:tasks.workunit.client.0.smithi096.stdout:5/662: fdatasync d2/d38/d4c/f85 0 2024-04-18T21:07:01.178 INFO:tasks.workunit.client.0.smithi096.stdout:9/754: fsync d0/dc/d5f/d76/f70 0 2024-04-18T21:07:01.180 INFO:tasks.workunit.client.0.smithi096.stdout:0/620: dwrite d1/db/d30/d31/d85/fa [0,4194304] 0 2024-04-18T21:07:01.181 INFO:tasks.workunit.client.0.smithi096.stdout:8/718: dwrite d0/d3/d1d/fce [0,4194304] 0 2024-04-18T21:07:01.181 INFO:tasks.workunit.client.0.smithi096.stdout:9/755: mknod d0/d28/d66/dd8/cf1 0 2024-04-18T21:07:01.181 INFO:tasks.workunit.client.0.smithi096.stdout:1/716: dwrite d0/df/d16/d24/dc0/d5f/d60/f99 [8388608,4194304] 0 2024-04-18T21:07:01.182 INFO:tasks.workunit.client.0.smithi096.stdout:0/621: mknod d1/d23/d32/d43/d6f/cd6 0 2024-04-18T21:07:01.182 INFO:tasks.workunit.client.0.smithi096.stdout:9/756: write d0/d28/d3d/fcd [738121,125087] 0 2024-04-18T21:07:01.183 INFO:tasks.workunit.client.0.smithi096.stdout:3/580: truncate d4/f35 3773113 0 2024-04-18T21:07:01.183 INFO:tasks.workunit.client.0.smithi096.stdout:7/557: truncate d0/fc 51497 0 2024-04-18T21:07:01.183 INFO:tasks.workunit.client.0.smithi096.stdout:3/581: stat d4/d6/d7/d90/fa4 0 2024-04-18T21:07:01.184 INFO:tasks.workunit.client.0.smithi096.stdout:9/757: unlink d0/d8/d11/fb0 0 2024-04-18T21:07:01.184 INFO:tasks.workunit.client.0.smithi096.stdout:7/558: truncate d0/f52 2224294 0 2024-04-18T21:07:01.184 INFO:tasks.workunit.client.0.smithi096.stdout:8/719: rename d0/cd2 to d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/ce9 0 2024-04-18T21:07:01.185 INFO:tasks.workunit.client.0.smithi096.stdout:7/559: stat d0/d20/d62/d97 0 2024-04-18T21:07:01.185 INFO:tasks.workunit.client.0.smithi096.stdout:3/582: mknod d4/d6/d1b/d2c/d31/d85/cab 0 2024-04-18T21:07:01.185 INFO:tasks.workunit.client.0.smithi096.stdout:9/758: unlink d0/d8/d11/d39/l7f 0 2024-04-18T21:07:01.185 INFO:tasks.workunit.client.0.smithi096.stdout:9/759: chown d0/d28/lac 923 1 2024-04-18T21:07:01.185 INFO:tasks.workunit.client.0.smithi096.stdout:1/717: write d0/df/d16/d24/dac/d65/fbf [718030,37248] 0 2024-04-18T21:07:01.186 INFO:tasks.workunit.client.0.smithi096.stdout:8/720: creat d0/d3/d1d/d83/dcd/dd1/dda/fea x:0 0 0 2024-04-18T21:07:01.186 INFO:tasks.workunit.client.0.smithi096.stdout:7/560: link d0/d11/f17 d0/d20/d4b/d7f/fa5 0 2024-04-18T21:07:01.186 INFO:tasks.workunit.client.0.smithi096.stdout:3/583: rename d4/d6/d22/d20/d46/f6f to d4/d6/d7/fac 0 2024-04-18T21:07:01.187 INFO:tasks.workunit.client.0.smithi096.stdout:2/825: read d11/d13/d1a/d1e/d28/d4e/f93 [444059,39606] 0 2024-04-18T21:07:01.187 INFO:tasks.workunit.client.0.smithi096.stdout:1/718: fsync d0/df/d16/d24/dac/d65/fe4 0 2024-04-18T21:07:01.188 INFO:tasks.workunit.client.0.smithi096.stdout:7/561: chown d0/d20/d62/d7d/l80 483 1 2024-04-18T21:07:01.188 INFO:tasks.workunit.client.0.smithi096.stdout:6/663: sync 2024-04-18T21:07:01.188 INFO:tasks.workunit.client.0.smithi096.stdout:9/760: sync 2024-04-18T21:07:01.188 INFO:tasks.workunit.client.0.smithi096.stdout:3/584: dread - d4/d6/d1b/d2c/d6b/d99/da6/f69 zero size 2024-04-18T21:07:01.188 INFO:tasks.workunit.client.0.smithi096.stdout:2/826: rename d11/d50/d108 to d11/d50/d108/d10f 22 2024-04-18T21:07:01.189 INFO:tasks.workunit.client.0.smithi096.stdout:9/761: write d0/fa0 [2723035,3199] 0 2024-04-18T21:07:01.189 INFO:tasks.workunit.client.0.smithi096.stdout:0/622: dwrite d1/db/d30/f6c [4194304,4194304] 0 2024-04-18T21:07:01.190 INFO:tasks.workunit.client.0.smithi096.stdout:3/585: chown d4/d6/d22/d20/d46/l71 488963 1 2024-04-18T21:07:01.191 INFO:tasks.workunit.client.0.smithi096.stdout:6/664: write d1/d5/da/d44/d4e/f5e [2563045,37898] 0 2024-04-18T21:07:01.192 INFO:tasks.workunit.client.0.smithi096.stdout:3/586: unlink d4/d6/d1b/f3a 0 2024-04-18T21:07:01.193 INFO:tasks.workunit.client.0.smithi096.stdout:0/623: creat d1/d23/d32/d43/d6f/d8a/d96/db4/fd7 x:0 0 0 2024-04-18T21:07:01.193 INFO:tasks.workunit.client.0.smithi096.stdout:7/562: dread d0/d7/f5f [4194304,4194304] 0 2024-04-18T21:07:01.194 INFO:tasks.workunit.client.0.smithi096.stdout:9/762: getdents d0/d8/d11/d39/d63 0 2024-04-18T21:07:01.194 INFO:tasks.workunit.client.0.smithi096.stdout:0/624: mkdir d1/db/d30/d4a/dd8 0 2024-04-18T21:07:01.194 INFO:tasks.workunit.client.0.smithi096.stdout:6/665: link d1/d5/da/d44/d4e/f59 d1/d3a/d57/d26/fdd 0 2024-04-18T21:07:01.196 INFO:tasks.workunit.client.0.smithi096.stdout:9/763: creat d0/d8/d11/d39/d63/ff2 x:0 0 0 2024-04-18T21:07:01.196 INFO:tasks.workunit.client.0.smithi096.stdout:6/666: chown d1/d5/fbd 9063596 1 2024-04-18T21:07:01.196 INFO:tasks.workunit.client.0.smithi096.stdout:1/719: dwrite d0/df/d16/d24/dc0/f7c [0,4194304] 0 2024-04-18T21:07:01.196 INFO:tasks.workunit.client.0.smithi096.stdout:3/587: truncate d4/d6/d1b/d2c/d31/d4e/f97 717591 0 2024-04-18T21:07:01.197 INFO:tasks.workunit.client.0.smithi096.stdout:0/625: fdatasync d1/d23/d32/d43/d6f/d8a/d96/fa9 0 2024-04-18T21:07:01.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/764: rename d0/d28/d2f/de6/c53 to d0/d28/d66/dd8/cf3 0 2024-04-18T21:07:01.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/765: chown d0 0 1 2024-04-18T21:07:01.198 INFO:tasks.workunit.client.0.smithi096.stdout:4/676: truncate d2/d1d/d3a/f51 221655 0 2024-04-18T21:07:01.198 INFO:tasks.workunit.client.0.smithi096.stdout:0/626: write d1/db/d30/d31/d85/d58/f83 [878569,16817] 0 2024-04-18T21:07:01.199 INFO:tasks.workunit.client.0.smithi096.stdout:4/677: creat d2/d2f/fdc x:0 0 0 2024-04-18T21:07:01.199 INFO:tasks.workunit.client.0.smithi096.stdout:0/627: fdatasync d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/fb7 0 2024-04-18T21:07:01.200 INFO:tasks.workunit.client.0.smithi096.stdout:0/628: creat d1/db/d30/d4a/dae/dcf/fd9 x:0 0 0 2024-04-18T21:07:01.204 INFO:tasks.workunit.client.0.smithi096.stdout:1/720: dwrite d0/df/d16/d24/dac/d6a/d8d/d9b/dca/dde/f42 [0,4194304] 0 2024-04-18T21:07:01.205 INFO:tasks.workunit.client.0.smithi096.stdout:1/721: chown d0/df/d16/fc9 113362478 1 2024-04-18T21:07:01.205 INFO:tasks.workunit.client.0.smithi096.stdout:6/667: dwrite d1/d3a/d36/fae [0,4194304] 0 2024-04-18T21:07:01.206 INFO:tasks.workunit.client.0.smithi096.stdout:9/766: dwrite d0/d28/d2f/de6/fd2 [0,4194304] 0 2024-04-18T21:07:01.206 INFO:tasks.workunit.client.0.smithi096.stdout:6/668: readlink d1/l64 0 2024-04-18T21:07:01.206 INFO:tasks.workunit.client.0.smithi096.stdout:1/722: chown d0/df/d16/d24/dc0/d5f/d60/d8f 1729 1 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi096.stdout:6/669: creat d1/d5/da/d46/d71/d7c/d8b/fde x:0 0 0 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi096.stdout:1/723: creat d0/df/d16/d24/dc0/d5f/d60/d90/ff3 x:0 0 0 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi096.stdout:9/767: mknod d0/d28/cf4 0 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi096.stdout:9/768: fsync d0/d8/d11/f19 0 2024-04-18T21:07:01.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/629: sync 2024-04-18T21:07:01.209 INFO:tasks.workunit.client.0.smithi096.stdout:6/670: write d1/d5/da/f63 [4279976,41202] 0 2024-04-18T21:07:01.209 INFO:tasks.workunit.client.0.smithi096.stdout:1/724: write d0/df/d16/d24/dc0/f7c [861982,80868] 0 2024-04-18T21:07:01.210 INFO:tasks.workunit.client.0.smithi096.stdout:6/671: chown d1/d5/ff 75679578 1 2024-04-18T21:07:01.210 INFO:tasks.workunit.client.0.smithi096.stdout:9/769: fdatasync d0/d28/d7a/dc3/dc6/f69 0 2024-04-18T21:07:01.210 INFO:tasks.workunit.client.0.smithi096.stdout:9/770: chown d0/dc/d5f/f61 61 1 2024-04-18T21:07:01.210 INFO:tasks.workunit.client.0.smithi096.stdout:6/672: symlink d1/d5/da/d44/d97/ldf 0 2024-04-18T21:07:01.211 INFO:tasks.workunit.client.0.smithi096.stdout:4/678: creat d2/d2f/fdd x:0 0 0 2024-04-18T21:07:01.211 INFO:tasks.workunit.client.0.smithi096.stdout:9/771: write d0/d8/f71 [256533,102455] 0 2024-04-18T21:07:01.212 INFO:tasks.workunit.client.0.smithi096.stdout:1/725: mkdir d0/df/d16/d24/dac/d6a/df4 0 2024-04-18T21:07:01.212 INFO:tasks.workunit.client.0.smithi096.stdout:6/673: chown d1/d5/f69 94 1 2024-04-18T21:07:01.213 INFO:tasks.workunit.client.0.smithi096.stdout:6/674: mknod d1/d3a/d57/d26/ce0 0 2024-04-18T21:07:01.214 INFO:tasks.workunit.client.0.smithi096.stdout:4/679: write d2/d2f/d33/d55/d59/d5f/fce [567929,39639] 0 2024-04-18T21:07:01.214 INFO:tasks.workunit.client.0.smithi096.stdout:9/772: link d0/dc/d5f/ce7 d0/dc/d5f/d76/dc1/cf5 0 2024-04-18T21:07:01.215 INFO:tasks.workunit.client.0.smithi096.stdout:9/773: chown d0/d44/fa9 3645 1 2024-04-18T21:07:01.215 INFO:tasks.workunit.client.0.smithi096.stdout:0/630: dwrite d1/da3/fc5 [0,4194304] 0 2024-04-18T21:07:01.216 INFO:tasks.workunit.client.0.smithi096.stdout:4/680: fsync d2/d2f/d33/d55/d57/d7d/fb4 0 2024-04-18T21:07:01.216 INFO:tasks.workunit.client.0.smithi096.stdout:9/774: chown d0/ld 0 1 2024-04-18T21:07:01.216 INFO:tasks.workunit.client.0.smithi096.stdout:4/681: rmdir d2/d2f/d39/d43 39 2024-04-18T21:07:01.217 INFO:tasks.workunit.client.0.smithi096.stdout:9/775: creat d0/d28/d7a/ff6 x:0 0 0 2024-04-18T21:07:01.217 INFO:tasks.workunit.client.0.smithi096.stdout:0/631: read d1/db/d25/f3d [130301,72763] 0 2024-04-18T21:07:01.218 INFO:tasks.workunit.client.0.smithi096.stdout:9/776: rmdir d0/dc 39 2024-04-18T21:07:01.219 INFO:tasks.workunit.client.0.smithi096.stdout:9/777: fsync d0/d28/d2f/de6/f96 0 2024-04-18T21:07:01.221 INFO:tasks.workunit.client.0.smithi096.stdout:9/778: rename d0/d28/d7a/fec to d0/dc/d5f/d76/dc1/dee/ff7 0 2024-04-18T21:07:01.223 INFO:tasks.workunit.client.0.smithi096.stdout:9/779: chown d0/d8/ca 13 1 2024-04-18T21:07:01.223 INFO:tasks.workunit.client.0.smithi096.stdout:4/682: dwrite d2/d2a/f7b [0,4194304] 0 2024-04-18T21:07:01.224 INFO:tasks.workunit.client.0.smithi096.stdout:9/780: unlink d0/fc0 0 2024-04-18T21:07:01.224 INFO:tasks.workunit.client.0.smithi096.stdout:5/663: dread d2/d18/d9d/de8/fa3 [0,4194304] 0 2024-04-18T21:07:01.225 INFO:tasks.workunit.client.0.smithi096.stdout:0/632: dwrite d1/db/d30/d31/d39/f55 [0,4194304] 0 2024-04-18T21:07:01.225 INFO:tasks.workunit.client.0.smithi096.stdout:4/683: mkdir d2/dbb/dde 0 2024-04-18T21:07:01.225 INFO:tasks.workunit.client.0.smithi096.stdout:9/781: write d0/d8/d11/f95 [3247741,13001] 0 2024-04-18T21:07:01.226 INFO:tasks.workunit.client.0.smithi096.stdout:4/684: symlink d2/d2a/d54/ldf 0 2024-04-18T21:07:01.226 INFO:tasks.workunit.client.0.smithi096.stdout:5/664: truncate d2/d18/f8a 7564081 0 2024-04-18T21:07:01.227 INFO:tasks.workunit.client.0.smithi096.stdout:9/782: rename d0/d28/c35 to d0/d28/d66/dd8/cf8 0 2024-04-18T21:07:01.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/685: mkdir d2/d2f/d33/d55/de0 0 2024-04-18T21:07:01.230 INFO:tasks.workunit.client.0.smithi096.stdout:9/783: rename d0/d28/d66/db2/le3 to d0/dc/d5f/lf9 0 2024-04-18T21:07:01.231 INFO:tasks.workunit.client.0.smithi096.stdout:0/633: dwrite d1/da3/fcb [0,4194304] 0 2024-04-18T21:07:01.231 INFO:tasks.workunit.client.0.smithi096.stdout:9/784: creat d0/d8/d11/d48/ffa x:0 0 0 2024-04-18T21:07:01.233 INFO:tasks.workunit.client.0.smithi096.stdout:8/721: dread d0/f27 [0,4194304] 0 2024-04-18T21:07:01.234 INFO:tasks.workunit.client.0.smithi096.stdout:0/634: fsync d1/db/d30/d31/d65/f94 0 2024-04-18T21:07:01.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/722: rename d0/d3/db/ldb to d0/d3/d1d/d83/dcd/d7f/dac/d33/de2/leb 0 2024-04-18T21:07:01.237 INFO:tasks.workunit.client.0.smithi096.stdout:0/635: getdents d1/db/d30/d31/d39/d6d/db1 0 2024-04-18T21:07:01.242 INFO:tasks.workunit.client.0.smithi096.stdout:7/563: dread d0/d7/d49/f4e [0,4194304] 0 2024-04-18T21:07:01.243 INFO:tasks.workunit.client.0.smithi096.stdout:7/564: fdatasync d0/d20/f46 0 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:13769 4.3 4:c356f952:::100000034da.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:07:01.231792+0000", 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015176537, 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015201236999999999, 2024-04-18T21:07:01.244 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13769 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.231792+0000", 2024-04-18T21:07:01.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.231792+0000", 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.231793+0000", 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9400000000000004e-07 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.240517+0000", 2024-04-18T21:07:01.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087235360000000005 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.240529+0000", 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1992e-05 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.240535+0000", 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2559999999999999e-06 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.240631+0000", 2024-04-18T21:07:01.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5771000000000002e-05 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.240804+0000", 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017347099999999999 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.240973+0000", 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168398 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:01.246787+0000", 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058139259999999996 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-04-18T21:07:01.249 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:01.250 INFO:tasks.workunit.client.0.smithi096.stdout:8/723: dwrite d0/d3/f18 [0,4194304] 0 2024-04-18T21:07:01.250 INFO:tasks.workunit.client.0.smithi096.stdout:7/565: write d0/d11/d18/d8f/f96 [70203,60516] 0 2024-04-18T21:07:01.250 INFO:tasks.workunit.client.0.smithi096.stdout:8/724: fdatasync d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/f50 0 2024-04-18T21:07:01.250 INFO:tasks.workunit.client.0.smithi096.stdout:9/785: getdents d0/d8/d11/d48 0 2024-04-18T21:07:01.250 INFO:tasks.workunit.client.0.smithi096.stdout:3/588: dread d4/d6/d1b/d2c/d31/d11/f55 [0,4194304] 0 2024-04-18T21:07:01.251 INFO:tasks.workunit.client.0.smithi096.stdout:3/589: mkdir d4/d8/d49/dad 0 2024-04-18T21:07:01.251 INFO:tasks.workunit.client.0.smithi096.stdout:3/590: write d4/d6/d1b/d2c/d31/d11/f5b [100204,105665] 0 2024-04-18T21:07:01.253 INFO:tasks.workunit.client.0.smithi096.stdout:9/786: dwrite d0/d28/d3d/fcd [0,4194304] 0 2024-04-18T21:07:01.254 INFO:tasks.workunit.client.0.smithi096.stdout:6/675: dread d1/d5/f2c [0,4194304] 0 2024-04-18T21:07:01.255 INFO:tasks.workunit.client.0.smithi096.stdout:6/676: write d1/f3 [3201014,10545] 0 2024-04-18T21:07:01.256 INFO:tasks.workunit.client.0.smithi096.stdout:9/787: dread d0/d8/d11/d39/fca [4194304,4194304] 0 2024-04-18T21:07:01.257 INFO:tasks.workunit.client.0.smithi096.stdout:5/665: dread d2/f79 [0,4194304] 0 2024-04-18T21:07:01.257 INFO:tasks.workunit.client.0.smithi096.stdout:1/726: dread d0/df/d16/d24/dc0/d5f/f6f [0,4194304] 0 2024-04-18T21:07:01.257 INFO:tasks.workunit.client.0.smithi096.stdout:0/636: write d1/db/d30/d31/d85/d58/fd0 [1518979,74696] 0 2024-04-18T21:07:01.258 INFO:tasks.workunit.client.0.smithi096.stdout:8/725: truncate d0/d3/d1d/d83/dcd/d7f/dac/f31 1868980 0 2024-04-18T21:07:01.258 INFO:tasks.workunit.client.0.smithi096.stdout:5/666: dread - d2/d11/d28/d4a/d55/fd8 zero size 2024-04-18T21:07:01.259 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:01.255+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:01.259 INFO:tasks.workunit.client.0.smithi096.stdout:9/788: rename d0/dc/d5f/d76/fce to d0/d8/d11/d48/ffb 0 2024-04-18T21:07:01.259 INFO:tasks.workunit.client.0.smithi096.stdout:6/677: link d1/d5/da/d46/cc2 d1/d3a/d36/ce1 0 2024-04-18T21:07:01.260 INFO:tasks.workunit.client.0.smithi096.stdout:9/789: fdatasync d0/d28/d7a/dc3/d43/f8e 0 2024-04-18T21:07:01.260 INFO:tasks.workunit.client.0.smithi096.stdout:5/667: chown d2/d11/d28/d4a/d55/l8e 438464713 1 2024-04-18T21:07:01.261 INFO:tasks.workunit.client.0.smithi096.stdout:8/726: mknod d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/cec 0 2024-04-18T21:07:01.261 INFO:tasks.workunit.client.0.smithi096.stdout:0/637: getdents d1/d23/d32/d43/d6f 0 2024-04-18T21:07:01.261 INFO:tasks.workunit.client.0.smithi096.stdout:5/668: chown d2/c53 13257 1 2024-04-18T21:07:01.261 INFO:tasks.workunit.client.0.smithi096.stdout:9/790: creat d0/d8/d11/d39/d63/ffc x:0 0 0 2024-04-18T21:07:01.262 INFO:tasks.workunit.client.0.smithi096.stdout:7/566: dwrite d0/d20/f5d [0,4194304] 0 2024-04-18T21:07:01.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/638: rename d1/db/d25/d54 to d1/db/dda 0 2024-04-18T21:07:01.264 INFO:tasks.workunit.client.0.smithi096.stdout:9/791: rename d0/d8/d11/f38 to d0/d28/d3d/ffd 0 2024-04-18T21:07:01.264 INFO:tasks.workunit.client.0.smithi096.stdout:7/567: truncate d0/d20/f5d 4448230 0 2024-04-18T21:07:01.264 INFO:tasks.workunit.client.0.smithi096.stdout:0/639: chown d1/db/d30/d31/d39/d6d/db1/cac 580940 1 2024-04-18T21:07:01.265 INFO:tasks.workunit.client.0.smithi096.stdout:8/727: rename d0/d3/d1d/d83/dcd/d7f/dac/d33/l6c to d0/d3/db/d6f/led 0 2024-04-18T21:07:01.265 INFO:tasks.workunit.client.0.smithi096.stdout:3/591: dread d4/d6/d22/f3e [0,4194304] 0 2024-04-18T21:07:01.266 INFO:tasks.workunit.client.0.smithi096.stdout:9/792: mknod d0/d8/d11/cfe 0 2024-04-18T21:07:01.266 INFO:tasks.workunit.client.0.smithi096.stdout:7/568: mknod d0/d7/d2f/ca6 0 2024-04-18T21:07:01.266 INFO:tasks.workunit.client.0.smithi096.stdout:8/728: creat d0/d5d/fee x:0 0 0 2024-04-18T21:07:01.266 INFO:tasks.workunit.client.0.smithi096.stdout:3/592: dread - d4/d6/f92 zero size 2024-04-18T21:07:01.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:01.268 INFO:tasks.workunit.client.0.smithi096.stdout:0/640: creat d1/db/d30/d31/d39/d6d/db1/fdb x:0 0 0 2024-04-18T21:07:01.268 INFO:tasks.workunit.client.0.smithi096.stdout:7/569: symlink d0/d20/d6c/la7 0 2024-04-18T21:07:01.268 INFO:tasks.workunit.client.0.smithi096.stdout:6/678: dwrite d1/d3a/d57/d26/f3c [0,4194304] 0 2024-04-18T21:07:01.268 INFO:tasks.workunit.client.0.smithi096.stdout:9/793: creat d0/d28/d66/dd8/fff x:0 0 0 2024-04-18T21:07:01.268 INFO:tasks.workunit.client.0.smithi096.stdout:7/570: chown d0/d20/d62/d7d 17250 1 2024-04-18T21:07:01.269 INFO:tasks.workunit.client.0.smithi096.stdout:8/729: rename d0/d3/c17 to d0/d3/d3a/d9f/cef 0 2024-04-18T21:07:01.269 INFO:tasks.workunit.client.0.smithi096.stdout:7/571: dread - d0/d20/d39/f64 zero size 2024-04-18T21:07:01.269 INFO:tasks.workunit.client.0.smithi096.stdout:0/641: unlink d1/da5/cbf 0 2024-04-18T21:07:01.270 INFO:tasks.workunit.client.0.smithi096.stdout:8/730: symlink d0/d3/d1d/d66/lf0 0 2024-04-18T21:07:01.270 INFO:tasks.workunit.client.0.smithi096.stdout:7/572: creat d0/d7/d2f/d63/fa8 x:0 0 0 2024-04-18T21:07:01.271 INFO:tasks.workunit.client.0.smithi096.stdout:0/642: creat d1/db/d30/d4a/dae/dcf/fdc x:0 0 0 2024-04-18T21:07:01.271 INFO:tasks.workunit.client.0.smithi096.stdout:7/573: readlink d0/l5b 0 2024-04-18T21:07:01.271 INFO:tasks.workunit.client.0.smithi096.stdout:8/731: creat d0/d3/d3a/d9f/ff1 x:0 0 0 2024-04-18T21:07:01.272 INFO:tasks.workunit.client.0.smithi096.stdout:3/593: dread d4/d6/d1b/d1d/f2e [0,4194304] 0 2024-04-18T21:07:01.272 INFO:tasks.workunit.client.0.smithi096.stdout:6/679: creat d1/d5/da/d90/db5/fe2 x:0 0 0 2024-04-18T21:07:01.273 INFO:tasks.workunit.client.0.smithi096.stdout:6/680: write d1/d3a/f3f [4459604,105165] 0 2024-04-18T21:07:01.274 INFO:tasks.workunit.client.0.smithi096.stdout:8/732: write d0/d3/d1d/d83/dcd/d7f/dac/d1b/fe0 [98932,56637] 0 2024-04-18T21:07:01.275 INFO:tasks.workunit.client.0.smithi096.stdout:7/574: link d0/d20/d4b/c81 d0/d20/d4b/d7f/da1/ca9 0 2024-04-18T21:07:01.275 INFO:tasks.workunit.client.0.smithi096.stdout:4/686: dread d2/d2a/f73 [0,4194304] 0 2024-04-18T21:07:01.276 INFO:tasks.workunit.client.0.smithi096.stdout:7/575: creat d0/d7/d8/faa x:0 0 0 2024-04-18T21:07:01.276 INFO:tasks.workunit.client.0.smithi096.stdout:2/827: dread d11/d13/d1d/d5d/f8d [4194304,4194304] 0 2024-04-18T21:07:01.278 INFO:tasks.workunit.client.0.smithi096.stdout:8/733: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/df2 0 2024-04-18T21:07:01.278 INFO:tasks.workunit.client.0.smithi096.stdout:9/794: dwrite d0/d28/d7a/dc3/dc6/fe0 [0,4194304] 0 2024-04-18T21:07:01.278 INFO:tasks.workunit.client.0.smithi096.stdout:4/687: fdatasync d2/d2a/d54/d71/f82 0 2024-04-18T21:07:01.279 INFO:tasks.workunit.client.0.smithi096.stdout:9/795: dread - d0/d8/d11/d48/ffb zero size 2024-04-18T21:07:01.279 INFO:tasks.workunit.client.0.smithi096.stdout:0/643: dwrite d1/db/d30/d31/d39/d6d/f80 [0,4194304] 0 2024-04-18T21:07:01.280 INFO:tasks.workunit.client.0.smithi096.stdout:9/796: readlink d0/d28/d7a/dc3/dc6/l8d 0 2024-04-18T21:07:01.280 INFO:tasks.workunit.client.0.smithi096.stdout:0/644: read - d1/d23/d32/d7d/fa0 zero size 2024-04-18T21:07:01.281 INFO:tasks.workunit.client.0.smithi096.stdout:6/681: rename d1/d5/da/d44/d4e to d1/d3a/d57/de3 0 2024-04-18T21:07:01.281 INFO:tasks.workunit.client.0.smithi096.stdout:8/734: creat d0/d3/d3a/dab/d61/ff3 x:0 0 0 2024-04-18T21:07:01.281 INFO:tasks.workunit.client.0.smithi096.stdout:2/828: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d107/c110 0 2024-04-18T21:07:01.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/645: write d1/f15 [1146181,14768] 0 2024-04-18T21:07:01.284 INFO:tasks.workunit.client.0.smithi096.stdout:3/594: truncate d4/d6/d7/f10 245077 0 2024-04-18T21:07:01.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/727: dread d0/f49 [0,4194304] 0 2024-04-18T21:07:01.285 INFO:tasks.workunit.client.0.smithi096.stdout:6/682: unlink d1/l16 0 2024-04-18T21:07:01.286 INFO:tasks.workunit.client.0.smithi096.stdout:0/646: creat d1/d23/d32/d43/d6f/d8a/d96/fdd x:0 0 0 2024-04-18T21:07:01.286 INFO:tasks.workunit.client.0.smithi096.stdout:7/576: dwrite d0/d7/d2f/d63/f9a [0,4194304] 0 2024-04-18T21:07:01.287 INFO:tasks.workunit.client.0.smithi096.stdout:3/595: symlink d4/d6/d1b/d2c/d31/d11/d8c/lae 0 2024-04-18T21:07:01.287 INFO:tasks.workunit.client.0.smithi096.stdout:6/683: stat d1/d3a/d36/c39 0 2024-04-18T21:07:01.289 INFO:tasks.workunit.client.0.smithi096.stdout:0/647: write d1/db/d30/d31/d85/fa [2706784,118603] 0 2024-04-18T21:07:01.290 INFO:tasks.workunit.client.0.smithi096.stdout:4/688: dwrite d2/d2a/d54/d6d/f81 [0,4194304] 0 2024-04-18T21:07:01.291 INFO:tasks.workunit.client.0.smithi096.stdout:1/728: link d0/dd0/ddb/fe6 d0/df/d16/d24/dac/d6a/d8d/d9b/dca/ff5 0 2024-04-18T21:07:01.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/684: rename d1/d5/ld2 to d1/d3a/d57/de3/d52/le4 0 2024-04-18T21:07:01.292 INFO:tasks.workunit.client.0.smithi096.stdout:3/596: write d4/d6/d1b/d1d/f2e [2177482,55848] 0 2024-04-18T21:07:01.293 INFO:tasks.workunit.client.0.smithi096.stdout:0/648: write d1/d23/d32/d43/d6f/d8a/d96/fdd [84025,109352] 0 2024-04-18T21:07:01.293 INFO:tasks.workunit.client.0.smithi096.stdout:4/689: symlink d2/d2f/d39/le1 0 2024-04-18T21:07:01.293 INFO:tasks.workunit.client.0.smithi096.stdout:2/829: dwrite d11/d13/d1a/fe3 [0,4194304] 0 2024-04-18T21:07:01.294 INFO:tasks.workunit.client.0.smithi096.stdout:0/649: mkdir d1/da3/dde 0 2024-04-18T21:07:01.295 INFO:tasks.workunit.client.0.smithi096.stdout:2/830: link d11/d13/d1a/d1e/d28/d4e/f7a d11/d50/d5b/dcb/f111 0 2024-04-18T21:07:01.296 INFO:tasks.workunit.client.0.smithi096.stdout:0/650: creat d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/fdf x:0 0 0 2024-04-18T21:07:01.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/831: mkdir d11/d13/d1a/d1e/d9f/d112 0 2024-04-18T21:07:01.299 INFO:tasks.workunit.client.0.smithi096.stdout:2/832: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d94/f113 x:0 0 0 2024-04-18T21:07:01.299 INFO:tasks.workunit.client.0.smithi096.stdout:3/597: dwrite d4/d6/d22/d20/d46/f56 [0,4194304] 0 2024-04-18T21:07:01.301 INFO:tasks.workunit.client.0.smithi096.stdout:3/598: write d4/d6/f96 [367324,54300] 0 2024-04-18T21:07:01.301 INFO:tasks.workunit.client.0.smithi096.stdout:2/833: symlink d11/d13/d1a/d1e/d28/l114 0 2024-04-18T21:07:01.303 INFO:tasks.workunit.client.0.smithi096.stdout:0/651: dwrite d1/d23/d32/d43/d6f/fab [0,4194304] 0 2024-04-18T21:07:01.304 INFO:tasks.workunit.client.0.smithi096.stdout:7/577: dwrite d0/fc [0,4194304] 0 2024-04-18T21:07:01.304 INFO:tasks.workunit.client.0.smithi096.stdout:5/669: dread d2/d11/d28/d64/f6c [0,4194304] 0 2024-04-18T21:07:01.306 INFO:tasks.workunit.client.0.smithi096.stdout:0/652: write d1/db/d30/d31/d85/f16 [6973017,25169] 0 2024-04-18T21:07:01.306 INFO:tasks.workunit.client.0.smithi096.stdout:3/599: rename d4/d6/d1b/d2c/d6b/d99/da6/l88 to d4/d6/d1b/laf 0 2024-04-18T21:07:01.307 INFO:tasks.workunit.client.0.smithi096.stdout:0/653: rename d1/db/d30/d31/d39 to d1/db/d30/d31/d39/d5d/de0 22 2024-04-18T21:07:01.308 INFO:tasks.workunit.client.0.smithi096.stdout:3/600: symlink d4/d6/d1b/d2c/d31/d11/lb0 0 2024-04-18T21:07:01.308 INFO:tasks.workunit.client.0.smithi096.stdout:2/834: dwrite d11/d50/d5b/f10b [0,4194304] 0 2024-04-18T21:07:01.309 INFO:tasks.workunit.client.0.smithi096.stdout:3/601: write d4/d8/fa [2741031,101465] 0 2024-04-18T21:07:01.310 INFO:tasks.workunit.client.0.smithi096.stdout:2/835: creat d11/d13/d1a/d1e/d28/d4e/d63/d10a/dd2/d109/f115 x:0 0 0 2024-04-18T21:07:01.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/685: dread d1/d5/da/d46/d71/f84 [0,4194304] 0 2024-04-18T21:07:01.311 INFO:tasks.workunit.client.0.smithi096.stdout:6/686: stat d1/d3a/d57/d66/d9b/la4 0 2024-04-18T21:07:01.313 INFO:tasks.workunit.client.0.smithi096.stdout:3/602: dread d4/d6/d1b/d2c/d31/d11/f55 [0,4194304] 0 2024-04-18T21:07:01.315 INFO:tasks.workunit.client.0.smithi096.stdout:3/603: rename d4/d6/c3c to d4/d6/d1b/d1d/cb1 0 2024-04-18T21:07:01.318 INFO:tasks.workunit.client.0.smithi096.stdout:2/836: dwrite d11/d13/d1a/d1e/d28/d4e/d5c/fa1 [4194304,4194304] 0 2024-04-18T21:07:01.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/837: unlink d11/f7e 0 2024-04-18T21:07:01.319 INFO:tasks.workunit.client.0.smithi096.stdout:1/729: read d0/df/d16/d24/dac/d6a/d8d/d95/f97 [972085,125306] 0 2024-04-18T21:07:01.319 INFO:tasks.workunit.client.0.smithi096.stdout:7/578: dwrite d0/fc [4194304,4194304] 0 2024-04-18T21:07:01.324 INFO:tasks.workunit.client.0.smithi096.stdout:7/579: dwrite d0/f1d [0,4194304] 0 2024-04-18T21:07:01.326 INFO:tasks.workunit.client.0.smithi096.stdout:2/838: truncate d11/d13/f7b 1390745 0 2024-04-18T21:07:01.327 INFO:tasks.workunit.client.0.smithi096.stdout:2/839: write d11/d13/d1a/d1e/d28/f103 [1311426,1101] 0 2024-04-18T21:07:01.331 INFO:tasks.workunit.client.0.smithi096.stdout:8/735: dread d0/d3/d1d/d83/dcd/d7f/dac/f8f [0,4194304] 0 2024-04-18T21:07:01.331 INFO:tasks.workunit.client.0.smithi096.stdout:7/580: dwrite d0/f1d [4194304,4194304] 0 2024-04-18T21:07:01.332 INFO:tasks.workunit.client.0.smithi096.stdout:7/581: creat d0/d20/d39/d8a/fab x:0 0 0 2024-04-18T21:07:01.333 INFO:tasks.workunit.client.0.smithi096.stdout:8/736: rename d0/d3/db/d6f/f98 to d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 0 2024-04-18T21:07:01.333 INFO:tasks.workunit.client.0.smithi096.stdout:7/582: fsync d0/d20/d4b/f86 0 2024-04-18T21:07:01.334 INFO:tasks.workunit.client.0.smithi096.stdout:7/583: readlink d0/d20/d62/d7d/l80 0 2024-04-18T21:07:01.336 INFO:tasks.workunit.client.0.smithi096.stdout:7/584: rmdir d0/d20/d4b/d7f/da1 39 2024-04-18T21:07:01.336 INFO:tasks.workunit.client.0.smithi096.stdout:2/840: dwrite d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/ff4 [0,4194304] 0 2024-04-18T21:07:01.336 INFO:tasks.workunit.client.0.smithi096.stdout:7/585: write d0/d7/d2f/d53/f92 [948390,50596] 0 2024-04-18T21:07:01.338 INFO:tasks.workunit.client.0.smithi096.stdout:2/841: link d11/c84 d11/d13/d1a/d1e/d28/d4e/d89/d8b/c116 0 2024-04-18T21:07:01.339 INFO:tasks.workunit.client.0.smithi096.stdout:2/842: sync 2024-04-18T21:07:01.341 INFO:tasks.workunit.client.0.smithi096.stdout:8/737: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/f5f [0,4194304] 0 2024-04-18T21:07:01.341 INFO:tasks.workunit.client.0.smithi096.stdout:2/843: symlink d11/d13/d1a/d1e/dbf/l117 0 2024-04-18T21:07:01.342 INFO:tasks.workunit.client.0.smithi096.stdout:2/844: write d11/d13/d1a/d1e/d28/d4e/d5c/fb5 [419103,4975] 0 2024-04-18T21:07:01.342 INFO:tasks.workunit.client.0.smithi096.stdout:8/738: creat d0/d3/d1d/d83/dcd/d7f/dac/d33/de2/ff5 x:0 0 0 2024-04-18T21:07:01.344 INFO:tasks.workunit.client.0.smithi096.stdout:7/586: dwrite d0/d7/d8/f1a [0,4194304] 0 2024-04-18T21:07:01.344 INFO:tasks.workunit.client.0.smithi096.stdout:2/845: readlink d11/d13/d1d/de8/lf8 0 2024-04-18T21:07:01.346 INFO:tasks.workunit.client.0.smithi096.stdout:7/587: write d0/d11/f17 [2802125,73820] 0 2024-04-18T21:07:01.346 INFO:tasks.workunit.client.0.smithi096.stdout:2/846: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f118 x:0 0 0 2024-04-18T21:07:01.347 INFO:tasks.workunit.client.0.smithi096.stdout:7/588: fdatasync d0/f52 0 2024-04-18T21:07:01.348 INFO:tasks.workunit.client.0.smithi096.stdout:7/589: symlink d0/d7/lac 0 2024-04-18T21:07:01.350 INFO:tasks.workunit.client.0.smithi096.stdout:8/739: dwrite d0/d3/faf [0,4194304] 0 2024-04-18T21:07:01.351 INFO:tasks.workunit.client.0.smithi096.stdout:7/590: creat d0/d11/fad x:0 0 0 2024-04-18T21:07:01.351 INFO:tasks.workunit.client.0.smithi096.stdout:7/591: chown d0/d20/d4b/d7f 154598 1 2024-04-18T21:07:01.351 INFO:tasks.workunit.client.0.smithi096.stdout:8/740: mknod d0/d3/d3a/dab/d46/dc5/cf6 0 2024-04-18T21:07:01.352 INFO:tasks.workunit.client.0.smithi096.stdout:7/592: readlink d0/d20/d39/d59/l88 0 2024-04-18T21:07:01.352 INFO:tasks.workunit.client.0.smithi096.stdout:8/741: mknod d0/d3/d3a/cf7 0 2024-04-18T21:07:01.352 INFO:tasks.workunit.client.0.smithi096.stdout:7/593: write d0/d7/fb [291486,50168] 0 2024-04-18T21:07:01.353 INFO:tasks.workunit.client.0.smithi096.stdout:7/594: write d0/d20/f46 [1723899,71054] 0 2024-04-18T21:07:01.353 INFO:tasks.workunit.client.0.smithi096.stdout:7/595: mkdir d0/d11/d18/d2e/dae 0 2024-04-18T21:07:01.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/596: rmdir d0/d20/d62/d97 0 2024-04-18T21:07:01.355 INFO:tasks.workunit.client.0.smithi096.stdout:7/597: rmdir d0/d7/d2f/d63 39 2024-04-18T21:07:01.356 INFO:tasks.workunit.client.0.smithi096.stdout:4/690: dread d2/d1d/d3a/f45 [0,4194304] 0 2024-04-18T21:07:01.356 INFO:tasks.workunit.client.0.smithi096.stdout:7/598: link d0/d20/f46 d0/d11/d18/faf 0 2024-04-18T21:07:01.356 INFO:tasks.workunit.client.0.smithi096.stdout:7/599: fsync d0/d7/f5c 0 2024-04-18T21:07:01.359 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:01.359+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:01.361 INFO:tasks.workunit.client.0.smithi096.stdout:7/600: truncate d0/d20/f2d 1192585 0 2024-04-18T21:07:01.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/601: link d0/d7/d2f/d53/l65 d0/d7/d42/lb0 0 2024-04-18T21:07:01.363 INFO:tasks.workunit.client.0.smithi096.stdout:0/654: dread d1/db/d30/d31/d39/d6d/db1/fc8 [0,4194304] 0 2024-04-18T21:07:01.364 INFO:tasks.workunit.client.0.smithi096.stdout:7/602: write d0/d20/d39/d8a/fa4 [292949,65402] 0 2024-04-18T21:07:01.365 INFO:tasks.workunit.client.0.smithi096.stdout:7/603: creat d0/d20/d4b/d7f/da1/fb1 x:0 0 0 2024-04-18T21:07:01.365 INFO:tasks.workunit.client.0.smithi096.stdout:0/655: mknod d1/db/d30/d31/d39/d6d/ce1 0 2024-04-18T21:07:01.365 INFO:tasks.workunit.client.0.smithi096.stdout:7/604: write d0/d20/d4b/d7f/da1/fb1 [85259,39913] 0 2024-04-18T21:07:01.366 INFO:tasks.workunit.client.0.smithi096.stdout:7/605: mkdir d0/d11/db2 0 2024-04-18T21:07:01.367 INFO:tasks.workunit.client.0.smithi096.stdout:7/606: rename d0/d20/d39/l9e to d0/d7/d8/lb3 0 2024-04-18T21:07:01.369 INFO:tasks.workunit.client.0.smithi096.stdout:6/687: dread d1/d3a/d36/f51 [0,4194304] 0 2024-04-18T21:07:01.369 INFO:tasks.workunit.client.0.smithi096.stdout:0/656: dread d1/d23/d32/d43/d6f/d8a/d96/fa9 [0,4194304] 0 2024-04-18T21:07:01.369 INFO:tasks.workunit.client.0.smithi096.stdout:6/688: write d1/d5/f87 [136775,111442] 0 2024-04-18T21:07:01.370 INFO:tasks.workunit.client.0.smithi096.stdout:6/689: dread - d1/d3a/d57/de3/f95 zero size 2024-04-18T21:07:01.370 INFO:tasks.workunit.client.0.smithi096.stdout:2/847: read d11/d13/d1a/d1e/d28/d4e/d89/fb2 [641874,56954] 0 2024-04-18T21:07:01.370 INFO:tasks.workunit.client.0.smithi096.stdout:8/742: read d0/d3/db/f6a [876033,18785] 0 2024-04-18T21:07:01.371 INFO:tasks.workunit.client.0.smithi096.stdout:6/690: mknod d1/d3a/d57/de3/d52/ce5 0 2024-04-18T21:07:01.371 INFO:tasks.workunit.client.0.smithi096.stdout:2/848: write d11/d50/d5b/f10b [3040975,48747] 0 2024-04-18T21:07:01.371 INFO:tasks.workunit.client.0.smithi096.stdout:7/607: chown d0/d7/d8/lb3 721 1 2024-04-18T21:07:01.372 INFO:tasks.workunit.client.0.smithi096.stdout:6/691: chown d1/d3a/d57/de3/c96 2 1 2024-04-18T21:07:01.373 INFO:tasks.workunit.client.0.smithi096.stdout:6/692: symlink d1/d3a/le6 0 2024-04-18T21:07:01.373 INFO:tasks.workunit.client.0.smithi096.stdout:7/608: mkdir d0/d20/d39/d8a/db4 0 2024-04-18T21:07:01.373 INFO:tasks.workunit.client.0.smithi096.stdout:8/743: link d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 d0/d5d/ff8 0 2024-04-18T21:07:01.373 INFO:tasks.workunit.client.0.smithi096.stdout:2/849: rename d11/c7c to d11/d13/d1a/d1e/c119 0 2024-04-18T21:07:01.374 INFO:tasks.workunit.client.0.smithi096.stdout:7/609: mknod d0/d7/cb5 0 2024-04-18T21:07:01.374 INFO:tasks.workunit.client.0.smithi096.stdout:6/693: creat d1/d17/fe7 x:0 0 0 2024-04-18T21:07:01.375 INFO:tasks.workunit.client.0.smithi096.stdout:0/657: truncate d1/db/d30/d31/d39/d5d/d60/f3c 1763853 0 2024-04-18T21:07:01.375 INFO:tasks.workunit.client.0.smithi096.stdout:7/610: write d0/f52 [109781,38197] 0 2024-04-18T21:07:01.375 INFO:tasks.workunit.client.0.smithi096.stdout:2/850: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f6b [611619,118030] 0 2024-04-18T21:07:01.377 INFO:tasks.workunit.client.0.smithi096.stdout:7/611: read d0/d20/d39/d8a/fa4 [147326,70578] 0 2024-04-18T21:07:01.377 INFO:tasks.workunit.client.0.smithi096.stdout:9/797: dread d0/d28/da1/f6e [0,4194304] 0 2024-04-18T21:07:01.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/744: rename d0/d3/d1d/d83/fa3 to d0/d3/d1d/d83/dcd/d7f/dac/d56/ff9 0 2024-04-18T21:07:01.377 INFO:tasks.workunit.client.0.smithi096.stdout:5/670: dread d2/f1b [0,4194304] 0 2024-04-18T21:07:01.378 INFO:tasks.workunit.client.0.smithi096.stdout:0/658: rename d1/db/d30/d4a/dd8 to d1/db/d30/d4a/dae/de2 0 2024-04-18T21:07:01.378 INFO:tasks.workunit.client.0.smithi096.stdout:5/671: fdatasync d2/d11/d28/d4a/fd6 0 2024-04-18T21:07:01.378 INFO:tasks.workunit.client.0.smithi096.stdout:9/798: mkdir d0/d28/d66/d100 0 2024-04-18T21:07:01.379 INFO:tasks.workunit.client.0.smithi096.stdout:7/612: mknod d0/d20/d4b/cb6 0 2024-04-18T21:07:01.379 INFO:tasks.workunit.client.0.smithi096.stdout:0/659: readlink d1/da5/lb6 0 2024-04-18T21:07:01.379 INFO:tasks.workunit.client.0.smithi096.stdout:5/672: creat d2/d8f/ff5 x:0 0 0 2024-04-18T21:07:01.380 INFO:tasks.workunit.client.0.smithi096.stdout:8/745: read d0/d3/d3a/dab/f4b [1559989,120470] 0 2024-04-18T21:07:01.380 INFO:tasks.workunit.client.0.smithi096.stdout:0/660: readlink d1/db/d30/d31/d85/l90 0 2024-04-18T21:07:01.381 INFO:tasks.workunit.client.0.smithi096.stdout:0/661: creat d1/da3/fe3 x:0 0 0 2024-04-18T21:07:01.381 INFO:tasks.workunit.client.0.smithi096.stdout:7/613: rename d0/d7/d42/l68 to d0/d20/d6c/lb7 0 2024-04-18T21:07:01.381 INFO:tasks.workunit.client.0.smithi096.stdout:5/673: getdents d2/d18/d9d/da0/dab/ded 0 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi096.stdout:7/614: readlink d0/d20/d6c/l98 0 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi096.stdout:8/746: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 14801 1 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi096.stdout:6/694: dwrite d1/d5/da/d46/d71/d7c/f8f [4194304,4194304] 0 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi096.stdout:0/662: readlink d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/lc0 0 2024-04-18T21:07:01.383 INFO:tasks.workunit.client.0.smithi096.stdout:7/615: write d0/d7/d8/f6a [2093332,20278] 0 2024-04-18T21:07:01.384 INFO:tasks.workunit.client.0.smithi096.stdout:2/851: truncate d11/d13/d1a/d1e/d28/d4e/d63/f65 1972771 0 2024-04-18T21:07:01.384 INFO:tasks.workunit.client.0.smithi096.stdout:9/799: truncate d0/dc/f32 137821 0 2024-04-18T21:07:01.385 INFO:tasks.workunit.client.0.smithi096.stdout:4/691: dread d2/f5 [0,4194304] 0 2024-04-18T21:07:01.385 INFO:tasks.workunit.client.0.smithi096.stdout:0/663: fsync d1/d23/d32/d43/d6f/d8a/d96/f98 0 2024-04-18T21:07:01.385 INFO:tasks.workunit.client.0.smithi096.stdout:6/695: creat d1/d5/fe8 x:0 0 0 2024-04-18T21:07:01.386 INFO:tasks.workunit.client.0.smithi096.stdout:9/800: write d0/fa0 [2130779,78743] 0 2024-04-18T21:07:01.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/747: rename d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/ld7 to d0/d3/db/lfa 0 2024-04-18T21:07:01.387 INFO:tasks.workunit.client.0.smithi096.stdout:9/801: stat d0/d8/l9e 0 2024-04-18T21:07:01.387 INFO:tasks.workunit.client.0.smithi096.stdout:5/674: dread d2/f46 [0,4194304] 0 2024-04-18T21:07:01.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/696: symlink d1/d3a/le9 0 2024-04-18T21:07:01.388 INFO:tasks.workunit.client.0.smithi096.stdout:5/675: fdatasync d2/f44 0 2024-04-18T21:07:01.388 INFO:tasks.workunit.client.0.smithi096.stdout:6/697: dread - d1/d5/da/d90/db5/fe2 zero size 2024-04-18T21:07:01.388 INFO:tasks.workunit.client.0.smithi096.stdout:0/664: rename d1/db/d25/c3e to d1/db/d30/d31/ce4 0 2024-04-18T21:07:01.389 INFO:tasks.workunit.client.0.smithi096.stdout:8/748: write d0/d3/d3a/dab/d46/d78/f80 [991233,101300] 0 2024-04-18T21:07:01.389 INFO:tasks.workunit.client.0.smithi096.stdout:9/802: write d0/d8/d11/d39/d63/ff2 [958967,10123] 0 2024-04-18T21:07:01.389 INFO:tasks.workunit.client.0.smithi096.stdout:0/665: chown d1/db/d30/d31/f7f 40994 1 2024-04-18T21:07:01.390 INFO:tasks.workunit.client.0.smithi096.stdout:5/676: truncate d2/d11/d28/d64/d7e/f99 1697874 0 2024-04-18T21:07:01.390 INFO:tasks.workunit.client.0.smithi096.stdout:0/666: creat d1/db/d30/d31/d85/d58/fe5 x:0 0 0 2024-04-18T21:07:01.391 INFO:tasks.workunit.client.0.smithi096.stdout:2/852: dread d11/d13/d1a/d1e/d28/d4e/d5c/fb5 [0,4194304] 0 2024-04-18T21:07:01.391 INFO:tasks.workunit.client.0.smithi096.stdout:5/677: symlink d2/d18/d9d/da0/dab/ded/lf6 0 2024-04-18T21:07:01.392 INFO:tasks.workunit.client.0.smithi096.stdout:0/667: creat d1/db/d25/fe6 x:0 0 0 2024-04-18T21:07:01.393 INFO:tasks.workunit.client.0.smithi096.stdout:0/668: creat d1/db/dda/fe7 x:0 0 0 2024-04-18T21:07:01.393 INFO:tasks.workunit.client.0.smithi096.stdout:3/604: dread d4/d8/f1f [0,4194304] 0 2024-04-18T21:07:01.395 INFO:tasks.workunit.client.0.smithi096.stdout:3/605: chown d4/d6/d1b/d63/l70 704 1 2024-04-18T21:07:01.396 INFO:tasks.workunit.client.0.smithi096.stdout:1/730: dread d0/df/d16/d24/dac/d6a/d8d/d95/fbb [0,4194304] 0 2024-04-18T21:07:01.396 INFO:tasks.workunit.client.0.smithi096.stdout:9/803: dwrite d0/d28/d2f/f17 [0,4194304] 0 2024-04-18T21:07:01.397 INFO:tasks.workunit.client.0.smithi096.stdout:1/731: chown d0/df/d16/f19 2455031 1 2024-04-18T21:07:01.401 INFO:tasks.workunit.client.0.smithi096.stdout:6/698: chown d1/d3a/d57/d26/ce0 1016126230 1 2024-04-18T21:07:01.402 INFO:tasks.workunit.client.0.smithi096.stdout:6/699: readlink d1/d5/da/d44/d97/ldf 0 2024-04-18T21:07:01.403 INFO:tasks.workunit.client.0.smithi096.stdout:2/853: sync 2024-04-18T21:07:01.403 INFO:tasks.workunit.client.0.smithi096.stdout:3/606: dwrite d4/d6/f92 [0,4194304] 0 2024-04-18T21:07:01.405 INFO:tasks.workunit.client.0.smithi096.stdout:3/607: write d4/d6/d22/f3e [98607,75407] 0 2024-04-18T21:07:01.405 INFO:tasks.workunit.client.0.smithi096.stdout:1/732: dwrite d0/df/d16/d24/dc0/d5f/f51 [0,4194304] 0 2024-04-18T21:07:01.405 INFO:tasks.workunit.client.0.smithi096.stdout:6/700: symlink d1/d5/da/d46/lea 0 2024-04-18T21:07:01.407 INFO:tasks.workunit.client.0.smithi096.stdout:1/733: rename d0/df/d16/d24/dc0/d5f/d60/d8f to d0/dd0/df6 0 2024-04-18T21:07:01.408 INFO:tasks.workunit.client.0.smithi096.stdout:1/734: stat d0/df/d16/d24/dc0/d5f/d60/d90 0 2024-04-18T21:07:01.409 INFO:tasks.workunit.client.0.smithi096.stdout:1/735: write d0/f7 [8772621,79155] 0 2024-04-18T21:07:01.411 INFO:tasks.workunit.client.0.smithi096.stdout:2/854: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f9e [135420,111716] 0 2024-04-18T21:07:01.411 INFO:tasks.workunit.client.0.smithi096.stdout:1/736: creat d0/df/ddc/ff7 x:0 0 0 2024-04-18T21:07:01.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/692: dread d2/d2a/f4a [0,4194304] 0 2024-04-18T21:07:01.412 INFO:tasks.workunit.client.0.smithi096.stdout:2/855: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f11a x:0 0 0 2024-04-18T21:07:01.414 INFO:tasks.workunit.client.0.smithi096.stdout:1/737: rename d0/df/d16/d24/dac/d6a/d8d to d0/df/de5/df8 0 2024-04-18T21:07:01.414 INFO:tasks.workunit.client.0.smithi096.stdout:1/738: sync 2024-04-18T21:07:01.414 INFO:tasks.workunit.client.0.smithi096.stdout:2/856: chown d11/d13/d1a/d1e/d28/l52 208021 1 2024-04-18T21:07:01.415 INFO:tasks.workunit.client.0.smithi096.stdout:9/804: dwrite d0/d28/d2f/de6/f52 [0,4194304] 0 2024-04-18T21:07:01.415 INFO:tasks.workunit.client.0.smithi096.stdout:5/678: dread d2/d11/d28/d4a/d87/fcf [0,4194304] 0 2024-04-18T21:07:01.416 INFO:tasks.workunit.client.0.smithi096.stdout:7/616: dread d0/d7/fb [0,4194304] 0 2024-04-18T21:07:01.417 INFO:tasks.workunit.client.0.smithi096.stdout:9/805: creat d0/d28/d66/f101 x:0 0 0 2024-04-18T21:07:01.417 INFO:tasks.workunit.client.0.smithi096.stdout:1/739: chown d0/df/d16/d6c/dab/lc2 11 1 2024-04-18T21:07:01.417 INFO:tasks.workunit.client.0.smithi096.stdout:9/806: mkdir d0/d28/d7a/d102 0 2024-04-18T21:07:01.418 INFO:tasks.workunit.client.0.smithi096.stdout:7/617: rename d0/d20/l5e to d0/d20/d62/d7d/lb8 0 2024-04-18T21:07:01.418 INFO:tasks.workunit.client.0.smithi096.stdout:9/807: mkdir d0/d44/d103 0 2024-04-18T21:07:01.418 INFO:tasks.workunit.client.0.smithi096.stdout:1/740: creat d0/df/d16/d24/dac/d6a/df4/ff9 x:0 0 0 2024-04-18T21:07:01.419 INFO:tasks.workunit.client.0.smithi096.stdout:9/808: creat d0/d8/d9/f104 x:0 0 0 2024-04-18T21:07:01.419 INFO:tasks.workunit.client.0.smithi096.stdout:7/618: rename d0/d11/f72 to d0/d7/fb9 0 2024-04-18T21:07:01.420 INFO:tasks.workunit.client.0.smithi096.stdout:7/619: chown d0/d11 513 1 2024-04-18T21:07:01.420 INFO:tasks.workunit.client.0.smithi096.stdout:3/608: read d4/d6/d1b/d2c/d6b/d99/da6/f83 [724000,46128] 0 2024-04-18T21:07:01.421 INFO:tasks.workunit.client.0.smithi096.stdout:1/741: getdents d0/df/d16/d6c/d9d 0 2024-04-18T21:07:01.421 INFO:tasks.workunit.client.0.smithi096.stdout:7/620: read d0/d7/fb [3542816,64887] 0 2024-04-18T21:07:01.422 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:01.422 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:01.423 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:01.423 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:01.423 INFO:tasks.workunit.client.0.smithi096.stdout:2/857: dwrite d11/d13/d1a/d1e/d28/f103 [0,4194304] 0 2024-04-18T21:07:01.423 INFO:tasks.workunit.client.0.smithi096.stdout:1/742: write d0/df/de5/df8/d95/fba [1055238,106375] 0 2024-04-18T21:07:01.423 INFO:tasks.workunit.client.0.smithi096.stdout:7/621: creat d0/d20/d39/d59/fba x:0 0 0 2024-04-18T21:07:01.424 INFO:tasks.workunit.client.0.smithi096.stdout:1/743: symlink d0/df/ddc/lfa 0 2024-04-18T21:07:01.424 INFO:tasks.workunit.client.0.smithi096.stdout:7/622: creat d0/d11/d18/d2e/fbb x:0 0 0 2024-04-18T21:07:01.425 INFO:tasks.workunit.client.0.smithi096.stdout:2/858: creat d11/d13/d1a/d1e/d28/d4e/d5c/f11b x:0 0 0 2024-04-18T21:07:01.425 INFO:tasks.workunit.client.0.smithi096.stdout:7/623: write d0/d20/d39/d8a/fab [959300,16483] 0 2024-04-18T21:07:01.426 INFO:tasks.workunit.client.0.smithi096.stdout:7/624: chown d0/d20/d62 259 1 2024-04-18T21:07:01.430 INFO:tasks.workunit.client.0.smithi096.stdout:8/749: dread d0/d3/d1d/d83/dcd/d7f/dac/d1b/f1f [0,4194304] 0 2024-04-18T21:07:01.431 INFO:tasks.workunit.client.0.smithi096.stdout:7/625: getdents d0/d20/d62/d7d 0 2024-04-18T21:07:01.431 INFO:tasks.workunit.client.0.smithi096.stdout:1/744: dwrite d0/df/f5b [0,4194304] 0 2024-04-18T21:07:01.433 INFO:tasks.workunit.client.0.smithi096.stdout:7/626: read d0/d7/f5c [374944,26918] 0 2024-04-18T21:07:01.433 INFO:tasks.workunit.client.0.smithi096.stdout:8/750: symlink d0/d3/d1d/d83/dcd/d7f/dac/d56/lfb 0 2024-04-18T21:07:01.435 INFO:tasks.workunit.client.0.smithi096.stdout:5/679: dwrite d2/f3a [4194304,4194304] 0 2024-04-18T21:07:01.436 INFO:tasks.workunit.client.0.smithi096.stdout:5/680: chown d2/d11/d28/c40 55340 1 2024-04-18T21:07:01.436 INFO:tasks.workunit.client.0.smithi096.stdout:8/751: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 zero size 2024-04-18T21:07:01.437 INFO:tasks.workunit.client.0.smithi096.stdout:9/809: dwrite d0/dc/f32 [0,4194304] 0 2024-04-18T21:07:01.437 INFO:tasks.workunit.client.0.smithi096.stdout:1/745: read d0/df/d16/d24/dc0/d5f/d60/f92 [11676048,115004] 0 2024-04-18T21:07:01.439 INFO:tasks.workunit.client.0.smithi096.stdout:8/752: chown d0/d3/d1d/d83/dcd/fde 42494 1 2024-04-18T21:07:01.439 INFO:tasks.workunit.client.0.smithi096.stdout:9/810: write d0/dc/d5f/d76/fe4 [487913,55640] 0 2024-04-18T21:07:01.439 INFO:tasks.workunit.client.0.smithi096.stdout:1/746: write d0/df/d16/fc9 [92363,51002] 0 2024-04-18T21:07:01.440 INFO:tasks.workunit.client.0.smithi096.stdout:4/693: dread d2/d2f/d33/d55/d57/f5c [0,4194304] 0 2024-04-18T21:07:01.440 INFO:tasks.workunit.client.0.smithi096.stdout:5/681: creat d2/d18/ff7 x:0 0 0 2024-04-18T21:07:01.440 INFO:tasks.workunit.client.0.smithi096.stdout:5/682: readlink d2/l4 0 2024-04-18T21:07:01.442 INFO:tasks.workunit.client.0.smithi096.stdout:5/683: creat d2/d11/ff8 x:0 0 0 2024-04-18T21:07:01.443 INFO:tasks.workunit.client.0.smithi096.stdout:7/627: dwrite d0/d11/d18/d8f/f96 [0,4194304] 0 2024-04-18T21:07:01.444 INFO:tasks.workunit.client.0.smithi096.stdout:5/684: unlink d2/d9b/cc0 0 2024-04-18T21:07:01.444 INFO:tasks.workunit.client.0.smithi096.stdout:2/859: dwrite d11/d50/d8e/fed [0,4194304] 0 2024-04-18T21:07:01.444 INFO:tasks.workunit.client.0.smithi096.stdout:4/694: rename d2/d2a/d54/d71/f82 to d2/d2a/fe2 0 2024-04-18T21:07:01.446 INFO:tasks.workunit.client.0.smithi096.stdout:7/628: truncate d0/d20/d39/d8a/fa4 722395 0 2024-04-18T21:07:01.446 INFO:tasks.workunit.client.0.smithi096.stdout:5/685: write d2/d18/d61/fdd [264030,4616] 0 2024-04-18T21:07:01.447 INFO:tasks.workunit.client.0.smithi096.stdout:4/695: symlink d2/d2a/d54/d6d/d78/le3 0 2024-04-18T21:07:01.447 INFO:tasks.workunit.client.0.smithi096.stdout:2/860: creat d11/d13/d1a/d1e/dbf/f11c x:0 0 0 2024-04-18T21:07:01.447 INFO:tasks.workunit.client.0.smithi096.stdout:4/696: sync 2024-04-18T21:07:01.449 INFO:tasks.workunit.client.0.smithi096.stdout:9/811: dwrite d0/d28/d2f/fc7 [0,4194304] 0 2024-04-18T21:07:01.449 INFO:tasks.workunit.client.0.smithi096.stdout:5/686: write d2/f1b [3217289,42564] 0 2024-04-18T21:07:01.449 INFO:tasks.workunit.client.0.smithi096.stdout:4/697: fsync d2/d2f/fdd 0 2024-04-18T21:07:01.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/629: creat d0/d20/d39/d8a/db4/fbc x:0 0 0 2024-04-18T21:07:01.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:01.450 INFO:tasks.workunit.client.0.smithi096.stdout:1/747: dwrite d0/df/de5/df8/d9b/dca/ff5 [0,4194304] 0 2024-04-18T21:07:01.450 INFO:tasks.workunit.client.0.smithi096.stdout:9/812: unlink d0/d28/d7a/dc3/l73 0 2024-04-18T21:07:01.450 INFO:tasks.workunit.client.0.smithi096.stdout:2/861: fsync d11/d13/d1a/d1e/d28/d4e/d63/dce/fdc 0 2024-04-18T21:07:01.450 INFO:tasks.workunit.client.0.smithi096.stdout:0/669: dread d1/db/d30/f81 [0,4194304] 0 2024-04-18T21:07:01.451 INFO:tasks.workunit.client.0.smithi096.stdout:0/670: sync 2024-04-18T21:07:01.452 INFO:tasks.workunit.client.0.smithi096.stdout:7/630: fdatasync d0/d20/f46 0 2024-04-18T21:07:01.452 INFO:tasks.workunit.client.0.smithi096.stdout:1/748: creat d0/dd0/ffb x:0 0 0 2024-04-18T21:07:01.452 INFO:tasks.workunit.client.0.smithi096.stdout:0/671: rmdir d1/d23 39 2024-04-18T21:07:01.452 INFO:tasks.workunit.client.0.smithi096.stdout:4/698: rename d2/d2f/d33/d55/d57/c8f to d2/d2f/d33/d55/d57/d88/da4/ce4 0 2024-04-18T21:07:01.453 INFO:tasks.workunit.client.0.smithi096.stdout:5/687: getdents d2/d11/d28/d4a/d69 0 2024-04-18T21:07:01.453 INFO:tasks.workunit.client.0.smithi096.stdout:7/631: chown d0/d20/d4b/d7f/da1/ca9 235754 1 2024-04-18T21:07:01.454 INFO:tasks.workunit.client.0.smithi096.stdout:9/813: rename d0/d28/d7a/dc3/f55 to d0/d8/d9/f105 0 2024-04-18T21:07:01.454 INFO:tasks.workunit.client.0.smithi096.stdout:7/632: rmdir d0/d11/db2 0 2024-04-18T21:07:01.454 INFO:tasks.workunit.client.0.smithi096.stdout:9/814: write d0/f4 [361998,10971] 0 2024-04-18T21:07:01.454 INFO:tasks.workunit.client.0.smithi096.stdout:2/862: rename d11/d13/d1a/d1e/dbf/fe6 to d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/f11d 0 2024-04-18T21:07:01.454 INFO:tasks.workunit.client.0.smithi096.stdout:0/672: chown d1/d23/d32/d43/d6f/d8a/d91/dba 56757 1 2024-04-18T21:07:01.455 INFO:tasks.workunit.client.0.smithi096.stdout:7/633: rmdir d0/d7/da3 0 2024-04-18T21:07:01.455 INFO:tasks.workunit.client.0.smithi096.stdout:5/688: mknod d2/d11/d28/d4a/d55/d81/cf9 0 2024-04-18T21:07:01.456 INFO:tasks.workunit.client.0.smithi096.stdout:2/863: truncate d11/d50/d5b/fbd 116933 0 2024-04-18T21:07:01.456 INFO:tasks.workunit.client.0.smithi096.stdout:7/634: stat d0/d11/d18/d2e 0 2024-04-18T21:07:01.457 INFO:tasks.workunit.client.0.smithi096.stdout:7/635: stat d0/d7/c33 0 2024-04-18T21:07:01.457 INFO:tasks.workunit.client.0.smithi096.stdout:5/689: mknod d2/d11/d28/cfa 0 2024-04-18T21:07:01.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/864: rename d11/l20 to d11/l11e 0 2024-04-18T21:07:01.459 INFO:tasks.workunit.client.0.smithi096.stdout:4/699: write d2/d2a/d54/d71/d99/fb8 [738639,41444] 0 2024-04-18T21:07:01.460 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:01.459+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:01.460 INFO:tasks.workunit.client.0.smithi096.stdout:7/636: write d0/d7/d8/f94 [27124,105899] 0 2024-04-18T21:07:01.460 INFO:tasks.workunit.client.0.smithi096.stdout:1/749: dwrite d0/df/d16/d24/da8/fe0 [0,4194304] 0 2024-04-18T21:07:01.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/690: creat d2/d18/d61/d6f/d88/ffb x:0 0 0 2024-04-18T21:07:01.461 INFO:tasks.workunit.client.0.smithi096.stdout:7/637: fsync d0/d11/d18/faf 0 2024-04-18T21:07:01.462 INFO:tasks.workunit.client.0.smithi096.stdout:4/700: truncate d2/d2f/d39/d43/fc1 90409 0 2024-04-18T21:07:01.462 INFO:tasks.workunit.client.0.smithi096.stdout:1/750: write d0/df/d16/d24/f4a [911779,99758] 0 2024-04-18T21:07:01.463 INFO:tasks.workunit.client.0.smithi096.stdout:0/673: dread d1/d23/d32/d43/d6f/d8a/d96/fa9 [0,4194304] 0 2024-04-18T21:07:01.463 INFO:tasks.workunit.client.0.smithi096.stdout:9/815: dwrite d0/d28/d7a/f8a [0,4194304] 0 2024-04-18T21:07:01.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/638: fdatasync d0/d7/d2f/d53/f92 0 2024-04-18T21:07:01.463 INFO:tasks.workunit.client.0.smithi096.stdout:0/674: dread - d1/db/d25/fb0 zero size 2024-04-18T21:07:01.464 INFO:tasks.workunit.client.0.smithi096.stdout:1/751: stat d0/df/d16/d24/dac/d65/fbf 0 2024-04-18T21:07:01.464 INFO:tasks.workunit.client.0.smithi096.stdout:7/639: chown d0/d7/d8/f26 889880 1 2024-04-18T21:07:01.467 INFO:tasks.workunit.client.0.smithi096.stdout:2/865: dwrite d11/fd5 [0,4194304] 0 2024-04-18T21:07:01.467 INFO:tasks.workunit.client.0.smithi096.stdout:5/691: creat d2/d11/d28/d4a/d69/ffc x:0 0 0 2024-04-18T21:07:01.467 INFO:tasks.workunit.client.0.smithi096.stdout:4/701: rename d2/d2f/d33/d55/d59/d5f/l70 to d2/dbb/db0/le5 0 2024-04-18T21:07:01.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/752: mknod d0/df/d16/d24/d9c/cfc 0 2024-04-18T21:07:01.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/692: truncate d2/d11/d28/d64/dba/fe4 9294 0 2024-04-18T21:07:01.468 INFO:tasks.workunit.client.0.smithi096.stdout:4/702: creat d2/d2f/d33/d55/d57/fe6 x:0 0 0 2024-04-18T21:07:01.468 INFO:tasks.workunit.client.0.smithi096.stdout:7/640: link d0/d11/fad d0/d7/fbd 0 2024-04-18T21:07:01.468 INFO:tasks.workunit.client.0.smithi096.stdout:9/816: creat d0/d28/d7a/dc3/dc6/f106 x:0 0 0 2024-04-18T21:07:01.469 INFO:tasks.workunit.client.0.smithi096.stdout:9/817: read - d0/dc/f86 zero size 2024-04-18T21:07:01.469 INFO:tasks.workunit.client.0.smithi096.stdout:4/703: write d2/d2f/d39/d43/fc1 [822617,50681] 0 2024-04-18T21:07:01.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/753: creat d0/ffd x:0 0 0 2024-04-18T21:07:01.471 INFO:tasks.workunit.client.0.smithi096.stdout:2/866: getdents d11/d50/d5b 0 2024-04-18T21:07:01.471 INFO:tasks.workunit.client.0.smithi096.stdout:4/704: mknod d2/d1d/d3a/ce7 0 2024-04-18T21:07:01.471 INFO:tasks.workunit.client.0.smithi096.stdout:9/818: creat d0/d28/d7a/de5/f107 x:0 0 0 2024-04-18T21:07:01.472 INFO:tasks.workunit.client.0.smithi096.stdout:7/641: rename d0/d11/d18/d8f/f96 to d0/d20/d4b/d7f/fbe 0 2024-04-18T21:07:01.474 INFO:tasks.workunit.client.0.smithi096.stdout:7/642: fdatasync d0/d20/d4b/d7f/fbe 0 2024-04-18T21:07:01.475 INFO:tasks.workunit.client.0.smithi096.stdout:4/705: rename d2/d2a/d54/d5b/d89/d90/cd6 to d2/d1d/d3a/dc9/ce8 0 2024-04-18T21:07:01.476 INFO:tasks.workunit.client.0.smithi096.stdout:2/867: mkdir d11/d13/d1a/d1e/d28/d4e/d63/dce/d11f 0 2024-04-18T21:07:01.477 INFO:tasks.workunit.client.0.smithi096.stdout:7/643: link d0/d20/d39/d59/l88 d0/d20/d39/lbf 0 2024-04-18T21:07:01.478 INFO:tasks.workunit.client.0.smithi096.stdout:5/693: dwrite d2/d18/d9d/da0/fd0 [0,4194304] 0 2024-04-18T21:07:01.478 INFO:tasks.workunit.client.0.smithi096.stdout:2/868: dread - d11/d13/d1a/d1e/ff3 zero size 2024-04-18T21:07:01.480 INFO:tasks.workunit.client.0.smithi096.stdout:5/694: chown d2/f15 104737433 1 2024-04-18T21:07:01.482 INFO:tasks.workunit.client.0.smithi096.stdout:7/644: rename d0/d7/d8/f55 to d0/d20/d4b/fc0 0 2024-04-18T21:07:01.482 INFO:tasks.workunit.client.0.smithi096.stdout:3/609: dread d4/d6/d1b/d2c/d31/d11/f40 [0,4194304] 0 2024-04-18T21:07:01.482 INFO:tasks.workunit.client.0.smithi096.stdout:1/754: dwrite d0/dd0/ddb/fe6 [4194304,4194304] 0 2024-04-18T21:07:01.483 INFO:tasks.workunit.client.0.smithi096.stdout:0/675: dwrite d1/f75 [0,4194304] 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi096.stdout:4/706: dread d2/d2a/d54/d6d/f81 [0,4194304] 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi096.stdout:7/645: creat d0/d20/d62/fc1 x:0 0 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi096.stdout:9/819: dwrite d0/d28/d7a/faa [0,4194304] 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi096.stdout:2/869: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/f120 x:0 0 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi096.stdout:6/701: dread d1/f13 [0,4194304] 0 2024-04-18T21:07:01.486 INFO:tasks.workunit.client.0.smithi096.stdout:2/870: chown d11/d13/d1a/d1e/d28/l114 116961673 1 2024-04-18T21:07:01.486 INFO:tasks.workunit.client.0.smithi096.stdout:9/820: write d0/d28/d7a/dc3/dc6/da3/fd7 [123261,62032] 0 2024-04-18T21:07:01.486 INFO:tasks.workunit.client.0.smithi096.stdout:6/702: fsync d1/d5/da/d46/d71/d7c/f8f 0 2024-04-18T21:07:01.487 INFO:tasks.workunit.client.0.smithi096.stdout:2/871: fdatasync d11/d50/f83 0 2024-04-18T21:07:01.488 INFO:tasks.workunit.client.0.smithi096.stdout:0/676: rmdir d1/db/d30/d31/d85 39 2024-04-18T21:07:01.488 INFO:tasks.workunit.client.0.smithi096.stdout:6/703: dread - d1/d3a/d57/d66/d9b/d9f/fc7 zero size 2024-04-18T21:07:01.488 INFO:tasks.workunit.client.0.smithi096.stdout:4/707: creat d2/d2a/d54/d5b/d89/d90/fe9 x:0 0 0 2024-04-18T21:07:01.488 INFO:tasks.workunit.client.0.smithi096.stdout:5/695: getdents d2/d18/d9d/da0/dcb 0 2024-04-18T21:07:01.489 INFO:tasks.workunit.client.0.smithi096.stdout:9/821: truncate d0/dc/f26 4036386 0 2024-04-18T21:07:01.489 INFO:tasks.workunit.client.0.smithi096.stdout:9/822: chown d0/dc 56953643 1 2024-04-18T21:07:01.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/696: creat d2/d18/d61/d6f/d7a/ffd x:0 0 0 2024-04-18T21:07:01.490 INFO:tasks.workunit.client.0.smithi096.stdout:6/704: mknod d1/d3a/d57/d66/d9b/d9f/ceb 0 2024-04-18T21:07:01.491 INFO:tasks.workunit.client.0.smithi096.stdout:4/708: creat d2/d2a/d54/d5b/fea x:0 0 0 2024-04-18T21:07:01.492 INFO:tasks.workunit.client.0.smithi096.stdout:5/697: unlink d2/d11/c98 0 2024-04-18T21:07:01.493 INFO:tasks.workunit.client.0.smithi096.stdout:4/709: read - d2/d2f/d33/fcc zero size 2024-04-18T21:07:01.493 INFO:tasks.workunit.client.0.smithi096.stdout:3/610: dwrite d4/d6/d22/f3e [0,4194304] 0 2024-04-18T21:07:01.494 INFO:tasks.workunit.client.0.smithi096.stdout:9/823: mkdir d0/d28/d2f/de6/ddb/d108 0 2024-04-18T21:07:01.495 INFO:tasks.workunit.client.0.smithi096.stdout:1/755: write d0/df/d16/f68 [1968548,67753] 0 2024-04-18T21:07:01.495 INFO:tasks.workunit.client.0.smithi096.stdout:7/646: dwrite d0/d11/f29 [4194304,4194304] 0 2024-04-18T21:07:01.498 INFO:tasks.workunit.client.0.smithi096.stdout:5/698: symlink d2/d18/lfe 0 2024-04-18T21:07:01.499 INFO:tasks.workunit.client.0.smithi096.stdout:6/705: rename d1/d5/da/d90/db5 to d1/d3a/dec 0 2024-04-18T21:07:01.500 INFO:tasks.workunit.client.0.smithi096.stdout:2/872: dwrite d11/d50/fdd [0,4194304] 0 2024-04-18T21:07:01.501 INFO:tasks.workunit.client.0.smithi096.stdout:0/677: dwrite d1/db/d30/d31/d65/f94 [8388608,4194304] 0 2024-04-18T21:07:01.501 INFO:tasks.workunit.client.0.smithi096.stdout:3/611: truncate d4/d6/d1b/d2c/d31/f9b 530891 0 2024-04-18T21:07:01.501 INFO:tasks.workunit.client.0.smithi096.stdout:7/647: write d0/d7/d8/f16 [1446124,35410] 0 2024-04-18T21:07:01.503 INFO:tasks.workunit.client.0.smithi096.stdout:0/678: fsync d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/fdf 0 2024-04-18T21:07:01.505 INFO:tasks.workunit.client.0.smithi096.stdout:4/710: dwrite d2/d2f/d33/d55/da3/faa [0,4194304] 0 2024-04-18T21:07:01.505 INFO:tasks.workunit.client.0.smithi096.stdout:7/648: rmdir d0/d7/d49 39 2024-04-18T21:07:01.505 INFO:tasks.workunit.client.0.smithi096.stdout:9/824: dwrite d0/d8/d11/f19 [0,4194304] 0 2024-04-18T21:07:01.505 INFO:tasks.workunit.client.0.smithi096.stdout:5/699: rename d2/d38/l89 to d2/d18/d61/d6d/lff 0 2024-04-18T21:07:01.507 INFO:tasks.workunit.client.0.smithi096.stdout:7/649: symlink d0/d20/d39/d8a/lc2 0 2024-04-18T21:07:01.508 INFO:tasks.workunit.client.0.smithi096.stdout:9/825: read - d0/dc/d5f/d76/dd5/fef zero size 2024-04-18T21:07:01.508 INFO:tasks.workunit.client.0.smithi096.stdout:5/700: write d2/f79 [728177,130725] 0 2024-04-18T21:07:01.508 INFO:tasks.workunit.client.0.smithi096.stdout:3/612: rename d4/d6/d1b/d1d/c89 to d4/d6/d22/d20/d46/d50/daa/cb2 0 2024-04-18T21:07:01.510 INFO:tasks.workunit.client.0.smithi096.stdout:4/711: fdatasync d2/d2f/d33/d55/d59/d5f/f8c 0 2024-04-18T21:07:01.510 INFO:tasks.workunit.client.0.smithi096.stdout:2/873: dwrite d11/d50/d5b/d8a/f105 [0,4194304] 0 2024-04-18T21:07:01.511 INFO:tasks.workunit.client.0.smithi096.stdout:6/706: dwrite d1/d5/da/d46/d71/d7c/f8f [0,4194304] 0 2024-04-18T21:07:01.513 INFO:tasks.workunit.client.0.smithi096.stdout:3/613: mkdir d4/d8/d49/db3 0 2024-04-18T21:07:01.513 INFO:tasks.workunit.client.0.smithi096.stdout:9/826: mknod d0/d8/d9/c109 0 2024-04-18T21:07:01.513 INFO:tasks.workunit.client.0.smithi096.stdout:4/712: mkdir d2/d2a/d54/d71/d99/deb 0 2024-04-18T21:07:01.513 INFO:tasks.workunit.client.0.smithi096.stdout:6/707: unlink d1/d5/ff 0 2024-04-18T21:07:01.513 INFO:tasks.workunit.client.0.smithi096.stdout:0/679: dwrite d1/db/f92 [0,4194304] 0 2024-04-18T21:07:01.514 INFO:tasks.workunit.client.0.smithi096.stdout:2/874: mkdir d11/d13/d1a/d1e/d28/d4e/d5c/d121 0 2024-04-18T21:07:01.516 INFO:tasks.workunit.client.0.smithi096.stdout:4/713: mknod d2/d2f/d39/d98/cec 0 2024-04-18T21:07:01.516 INFO:tasks.workunit.client.0.smithi096.stdout:3/614: mkdir d4/d8/d49/db3/db4 0 2024-04-18T21:07:01.516 INFO:tasks.workunit.client.0.smithi096.stdout:2/875: mkdir d11/d13/d1d/d5d/d97/d122 0 2024-04-18T21:07:01.516 INFO:tasks.workunit.client.0.smithi096.stdout:9/827: symlink d0/d44/d103/l10a 0 2024-04-18T21:07:01.516 INFO:tasks.workunit.client.0.smithi096.stdout:0/680: rename d1/db/d30/d4a/dae/de2 to d1/de8 0 2024-04-18T21:07:01.517 INFO:tasks.workunit.client.0.smithi096.stdout:3/615: fdatasync d4/d6/d1b/d2c/d6b/d99/da6/f78 0 2024-04-18T21:07:01.517 INFO:tasks.workunit.client.0.smithi096.stdout:9/828: symlink d0/d28/l10b 0 2024-04-18T21:07:01.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/714: link d2/d1d/d3a/l6b d2/dc3/led 0 2024-04-18T21:07:01.518 INFO:tasks.workunit.client.0.smithi096.stdout:2/876: mkdir d11/d13/d1a/d1e/d28/d4e/d5c/d121/d123 0 2024-04-18T21:07:01.518 INFO:tasks.workunit.client.0.smithi096.stdout:0/681: fdatasync d1/d23/d32/d43/d6f/d8a/d96/db4/fc4 0 2024-04-18T21:07:01.518 INFO:tasks.workunit.client.0.smithi096.stdout:9/829: chown d0/d8/d9/c109 7316 1 2024-04-18T21:07:01.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/715: fdatasync d2/d1d/f5e 0 2024-04-18T21:07:01.519 INFO:tasks.workunit.client.0.smithi096.stdout:3/616: creat d4/d6/d1b/d2c/d31/d85/fb5 x:0 0 0 2024-04-18T21:07:01.519 INFO:tasks.workunit.client.0.smithi096.stdout:9/830: rename d0/d8/l33 to d0/d28/d3d/l10c 0 2024-04-18T21:07:01.520 INFO:tasks.workunit.client.0.smithi096.stdout:3/617: fdatasync d4/d6/d1b/d2c/d31/f41 0 2024-04-18T21:07:01.520 INFO:tasks.workunit.client.0.smithi096.stdout:0/682: truncate d1/db/d30/d31/d39/d6d/db1/fc8 5114227 0 2024-04-18T21:07:01.521 INFO:tasks.workunit.client.0.smithi096.stdout:0/683: mkdir d1/db/dda/de9 0 2024-04-18T21:07:01.521 INFO:tasks.workunit.client.0.smithi096.stdout:3/618: creat d4/d6/d1b/d2c/d31/d4e/fb6 x:0 0 0 2024-04-18T21:07:01.522 INFO:tasks.workunit.client.0.smithi096.stdout:3/619: stat d4/d6/d1b/d2c/d31/d11/f5b 0 2024-04-18T21:07:01.523 INFO:tasks.workunit.client.0.smithi096.stdout:3/620: unlink d4/d6/d1b/d2c/d5c/f80 0 2024-04-18T21:07:01.523 INFO:tasks.workunit.client.0.smithi096.stdout:9/831: dread d0/d28/d2f/fc7 [0,4194304] 0 2024-04-18T21:07:01.524 INFO:tasks.workunit.client.0.smithi096.stdout:2/877: dwrite d11/d13/d1a/d1e/d28/d4e/d5c/fa1 [4194304,4194304] 0 2024-04-18T21:07:01.526 INFO:tasks.workunit.client.0.smithi096.stdout:9/832: creat d0/d28/d66/dd8/f10d x:0 0 0 2024-04-18T21:07:01.526 INFO:tasks.workunit.client.0.smithi096.stdout:9/833: unlink d0/d28/fa4 0 2024-04-18T21:07:01.527 INFO:tasks.workunit.client.0.smithi096.stdout:0/684: dwrite d1/d23/d32/d43/d6f/d8a/d96/db4/fd7 [0,4194304] 0 2024-04-18T21:07:01.530 INFO:tasks.workunit.client.0.smithi096.stdout:3/621: write d4/f73 [690802,37575] 0 2024-04-18T21:07:01.533 INFO:tasks.workunit.client.0.smithi096.stdout:9/834: dwrite d0/fa0 [4194304,4194304] 0 2024-04-18T21:07:01.533 INFO:tasks.workunit.client.0.smithi096.stdout:9/835: write d0/d28/d7a/ff6 [502113,24403] 0 2024-04-18T21:07:01.534 INFO:tasks.workunit.client.0.smithi096.stdout:2/878: write d11/d13/d1a/d1e/d28/d4e/f7a [874698,97858] 0 2024-04-18T21:07:01.535 INFO:tasks.workunit.client.0.smithi096.stdout:9/836: link d0/dc/f26 d0/dc/d5f/d76/dc1/dee/f10e 0 2024-04-18T21:07:01.538 INFO:tasks.workunit.client.0.smithi096.stdout:1/756: dread d0/f3e [0,4194304] 0 2024-04-18T21:07:01.539 INFO:tasks.workunit.client.0.smithi096.stdout:9/837: dread d0/dc/f32 [0,4194304] 0 2024-04-18T21:07:01.539 INFO:tasks.workunit.client.0.smithi096.stdout:2/879: fdatasync d11/d50/fdd 0 2024-04-18T21:07:01.539 INFO:tasks.workunit.client.0.smithi096.stdout:1/757: mknod d0/df/d16/d24/da8/cfe 0 2024-04-18T21:07:01.540 INFO:tasks.workunit.client.0.smithi096.stdout:9/838: creat d0/dc/d5f/f10f x:0 0 0 2024-04-18T21:07:01.540 INFO:tasks.workunit.client.0.smithi096.stdout:1/758: stat d0/df/de5/df8/d9b/dca/dde 0 2024-04-18T21:07:01.540 INFO:tasks.workunit.client.0.smithi096.stdout:9/839: dread - d0/d8/d11/d39/d63/f8c zero size 2024-04-18T21:07:01.541 INFO:tasks.workunit.client.0.smithi096.stdout:1/759: chown d0/df/d16/d24/dc0/d5f/l56 140 1 2024-04-18T21:07:01.541 INFO:tasks.workunit.client.0.smithi096.stdout:1/760: write d0/df/d16/d24/dc0/d5f/f51 [4274924,94469] 0 2024-04-18T21:07:01.546 INFO:tasks.workunit.client.0.smithi096.stdout:9/840: dread d0/dc/f32 [0,4194304] 0 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi096.stdout:9/841: rename d0/d8/d11/d48/fad to d0/d8/d11/d39/d63/f110 0 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi096.stdout:9/842: unlink d0/d44/fa9 0 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi096.stdout:0/685: fdatasync d1/db/f92 0 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi096.stdout:7/650: dread d0/d7/fb9 [0,4194304] 0 2024-04-18T21:07:01.549 INFO:tasks.workunit.client.0.smithi096.stdout:9/843: write d0/d8/d11/d39/d63/f8c [435785,127270] 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi096.stdout:7/651: symlink d0/d7/d2f/d53/lc3 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi096.stdout:0/686: write d1/db/d30/f81 [296494,17418] 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi096.stdout:9/844: write d0/d28/d2f/de6/f96 [1506416,48529] 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi096.stdout:7/652: write d0/d7/d8/f26 [206774,20999] 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi096.stdout:0/687: read - d1/d23/d32/d43/d6f/d8a/d96/f98 zero size 2024-04-18T21:07:01.551 INFO:tasks.workunit.client.0.smithi096.stdout:9/845: write d0/d8/d9/f23 [2992429,75258] 0 2024-04-18T21:07:01.551 INFO:tasks.workunit.client.0.smithi096.stdout:7/653: mkdir d0/d7/d2f/d63/dc4 0 2024-04-18T21:07:01.552 INFO:tasks.workunit.client.0.smithi096.stdout:7/654: fsync d0/d7/f90 0 2024-04-18T21:07:01.552 INFO:tasks.workunit.client.0.smithi096.stdout:9/846: write d0/dc/d5f/f10f [887981,103869] 0 2024-04-18T21:07:01.552 INFO:tasks.workunit.client.0.smithi096.stdout:2/880: read d11/d13/d1a/fe3 [63902,2856] 0 2024-04-18T21:07:01.553 INFO:tasks.workunit.client.0.smithi096.stdout:2/881: rmdir d11/d13/d1a/d1e 39 2024-04-18T21:07:01.555 INFO:tasks.workunit.client.0.smithi096.stdout:6/708: dread d1/d5/f5f [0,4194304] 0 2024-04-18T21:07:01.557 INFO:tasks.workunit.client.0.smithi096.stdout:3/622: dread d4/d6/d1b/d2c/d6b/d99/fa9 [0,4194304] 0 2024-04-18T21:07:01.557 INFO:tasks.workunit.client.0.smithi096.stdout:6/709: dread - d1/d5/da/d46/d71/d7c/d8b/fde zero size 2024-04-18T21:07:01.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/710: write d1/d5/fbd [309876,125798] 0 2024-04-18T21:07:01.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/655: dwrite d0/d7/d8/f1a [0,4194304] 0 2024-04-18T21:07:01.560 INFO:tasks.workunit.client.0.smithi096.stdout:9/847: dwrite d0/d28/d3d/fd3 [4194304,4194304] 0 2024-04-18T21:07:01.560 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:01.557+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:01.561 INFO:tasks.workunit.client.0.smithi096.stdout:9/848: chown d0/dc/d5f/d76/dc1/fcf 327771 1 2024-04-18T21:07:01.562 INFO:tasks.workunit.client.0.smithi096.stdout:9/849: write d0/d28/d2f/f17 [828942,57372] 0 2024-04-18T21:07:01.563 INFO:tasks.workunit.client.0.smithi096.stdout:7/656: creat d0/d20/d4b/d7f/da1/fc5 x:0 0 0 2024-04-18T21:07:01.565 INFO:tasks.workunit.client.0.smithi096.stdout:2/882: dwrite d11/d13/d1a/d1e/d28/d4e/d63/d10a/ff2 [0,4194304] 0 2024-04-18T21:07:01.565 INFO:tasks.workunit.client.0.smithi096.stdout:9/850: readlink d0/d28/da1/l4f 0 2024-04-18T21:07:01.565 INFO:tasks.workunit.client.0.smithi096.stdout:7/657: write d0/d7/d42/f87 [398132,60554] 0 2024-04-18T21:07:01.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/658: dread - d0/d7/d2f/d63/fa8 zero size 2024-04-18T21:07:01.567 INFO:tasks.workunit.client.0.smithi096.stdout:6/711: rename d1/d3a/d57/d66/d67/fc9 to d1/d5/da/d44/fed 0 2024-04-18T21:07:01.567 INFO:tasks.workunit.client.0.smithi096.stdout:9/851: mknod d0/d44/c111 0 2024-04-18T21:07:01.568 INFO:tasks.workunit.client.0.smithi096.stdout:7/659: chown d0/d7/d2f/d63/fa8 773383 1 2024-04-18T21:07:01.568 INFO:tasks.workunit.client.0.smithi096.stdout:0/688: dwrite d1/d23/d32/d7d/f8d [0,4194304] 0 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi096.stdout:5/701: dread d2/d11/d28/d4a/fea [0,4194304] 0 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi096.stdout:7/660: sync 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi096.stdout:6/712: creat d1/d5/da/d46/d71/d7c/d8b/fee x:0 0 0 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi096.stdout:9/852: creat d0/d8/d11/d39/d63/f112 x:0 0 0 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi096.stdout:0/689: mknod d1/db/dda/de9/cea 0 2024-04-18T21:07:01.570 INFO:tasks.workunit.client.0.smithi096.stdout:9/853: creat d0/dc/d5f/f113 x:0 0 0 2024-04-18T21:07:01.570 INFO:tasks.workunit.client.0.smithi096.stdout:6/713: chown d1/d3a/d57/d26/ce0 4 1 2024-04-18T21:07:01.570 INFO:tasks.workunit.client.0.smithi096.stdout:5/702: truncate d2/d18/d61/d6f/f91 435074 0 2024-04-18T21:07:01.571 INFO:tasks.workunit.client.0.smithi096.stdout:6/714: chown d1/d61/fc5 93517128 1 2024-04-18T21:07:01.571 INFO:tasks.workunit.client.0.smithi096.stdout:5/703: creat d2/d11/d28/d4a/d55/d81/f100 x:0 0 0 2024-04-18T21:07:01.572 INFO:tasks.workunit.client.0.smithi096.stdout:6/715: sync 2024-04-18T21:07:01.572 INFO:tasks.workunit.client.0.smithi096.stdout:0/690: truncate d1/d23/d32/d43/d6f/d8a/d96/f98 709409 0 2024-04-18T21:07:01.572 INFO:tasks.workunit.client.0.smithi096.stdout:0/691: write d1/f6a [816395,50368] 0 2024-04-18T21:07:01.572 INFO:tasks.workunit.client.0.smithi096.stdout:5/704: fsync d2/d11/d28/d4a/d55/d81/f9c 0 2024-04-18T21:07:01.572 INFO:tasks.workunit.client.0.smithi096.stdout:6/716: unlink d1/d5/da/d46/d71/d7c/d8b/lb3 0 2024-04-18T21:07:01.573 INFO:tasks.workunit.client.0.smithi096.stdout:5/705: write d2/d11/d28/d64/dba/fe4 [24789,91701] 0 2024-04-18T21:07:01.573 INFO:tasks.workunit.client.0.smithi096.stdout:6/717: dread - d1/d5/da/d46/d71/d7c/d8b/fde zero size 2024-04-18T21:07:01.573 INFO:tasks.workunit.client.0.smithi096.stdout:0/692: rename d1/db/d30/d31/d39 to d1/db/dda/de9/deb 0 2024-04-18T21:07:01.577 INFO:tasks.workunit.client.0.smithi096.stdout:4/716: dread d2/d1d/f7e [0,4194304] 0 2024-04-18T21:07:01.578 INFO:tasks.workunit.client.0.smithi096.stdout:4/717: chown d2/dbb/db0/le5 8447 1 2024-04-18T21:07:01.579 INFO:tasks.workunit.client.0.smithi096.stdout:4/718: unlink d2/d1d/d3a/dc9/fc7 0 2024-04-18T21:07:01.579 INFO:tasks.workunit.client.0.smithi096.stdout:5/706: dwrite d2/d11/d28/d4a/fe2 [0,4194304] 0 2024-04-18T21:07:01.580 INFO:tasks.workunit.client.0.smithi096.stdout:6/718: dwrite d1/d3a/d57/d66/d80/fbf [0,4194304] 0 2024-04-18T21:07:01.580 INFO:tasks.workunit.client.0.smithi096.stdout:4/719: write d2/d1d/d3a/fdb [385597,111177] 0 2024-04-18T21:07:01.580 INFO:tasks.workunit.client.0.smithi096.stdout:5/707: chown d2/d18/d9d/da0/fc7 15454489 1 2024-04-18T21:07:01.581 INFO:tasks.workunit.client.0.smithi096.stdout:4/720: fsync d2/d2f/d33/d55/f6f 0 2024-04-18T21:07:01.581 INFO:tasks.workunit.client.0.smithi096.stdout:6/719: stat d1/d5/da/d46/d71/d7c/d8b/fde 0 2024-04-18T21:07:01.581 INFO:tasks.workunit.client.0.smithi096.stdout:6/720: sync 2024-04-18T21:07:01.582 INFO:tasks.workunit.client.0.smithi096.stdout:6/721: mknod d1/d3a/cef 0 2024-04-18T21:07:01.583 INFO:tasks.workunit.client.0.smithi096.stdout:2/883: truncate d11/d13/d1a/d1e/d28/d4e/d5c/fb5 130926 0 2024-04-18T21:07:01.584 INFO:tasks.workunit.client.0.smithi096.stdout:6/722: fsync d1/d3a/d57/de3/f5e 0 2024-04-18T21:07:01.584 INFO:tasks.workunit.client.0.smithi096.stdout:0/693: write d1/db/dda/de9/deb/d6d/db1/fc8 [3371051,53067] 0 2024-04-18T21:07:01.584 INFO:tasks.workunit.client.0.smithi096.stdout:2/884: chown d11/d50/d5b/dcb/deb 0 1 2024-04-18T21:07:01.585 INFO:tasks.workunit.client.0.smithi096.stdout:2/885: sync 2024-04-18T21:07:01.585 INFO:tasks.workunit.client.0.smithi096.stdout:4/721: link d2/d2f/d39/d98/ca5 d2/d2f/d33/d55/d59/db9/cee 0 2024-04-18T21:07:01.585 INFO:tasks.workunit.client.0.smithi096.stdout:6/723: write d1/d3a/d57/de3/f5e [4321984,39059] 0 2024-04-18T21:07:01.586 INFO:tasks.workunit.client.0.smithi096.stdout:8/753: dread d0/d3/f18 [0,4194304] 0 2024-04-18T21:07:01.586 INFO:tasks.workunit.client.0.smithi096.stdout:4/722: mkdir d2/d2f/d39/def 0 2024-04-18T21:07:01.587 INFO:tasks.workunit.client.0.smithi096.stdout:6/724: rename d1/d5/l3e to d1/d5/da/lf0 0 2024-04-18T21:07:01.587 INFO:tasks.workunit.client.0.smithi096.stdout:8/754: mknod d0/d3/d1d/d83/dcd/d7f/dac/d33/cfc 0 2024-04-18T21:07:01.589 INFO:tasks.workunit.client.0.smithi096.stdout:0/694: truncate d1/d23/d32/d43/d6f/d8a/d96/fdd 477103 0 2024-04-18T21:07:01.590 INFO:tasks.workunit.client.0.smithi096.stdout:6/725: rename d1/d3a/d57/de3/d52/le4 to d1/d5/da/d46/d71/lf1 0 2024-04-18T21:07:01.590 INFO:tasks.workunit.client.0.smithi096.stdout:0/695: chown d1/f8e 1795 1 2024-04-18T21:07:01.590 INFO:tasks.workunit.client.0.smithi096.stdout:7/661: read d0/d20/d39/f61 [1413653,36269] 0 2024-04-18T21:07:01.591 INFO:tasks.workunit.client.0.smithi096.stdout:5/708: dwrite d2/d18/fe [0,4194304] 0 2024-04-18T21:07:01.592 INFO:tasks.workunit.client.0.smithi096.stdout:0/696: write d1/f15 [2739869,31072] 0 2024-04-18T21:07:01.592 INFO:tasks.workunit.client.0.smithi096.stdout:6/726: getdents d1/d5/da/d46 0 2024-04-18T21:07:01.594 INFO:tasks.workunit.client.0.smithi096.stdout:5/709: unlink d2/d11/d28/d64/cc8 0 2024-04-18T21:07:01.594 INFO:tasks.workunit.client.0.smithi096.stdout:7/662: write d0/d7/d2f/d53/f92 [1697138,31930] 0 2024-04-18T21:07:01.595 INFO:tasks.workunit.client.0.smithi096.stdout:0/697: getdents d1/d23/d32/daf 0 2024-04-18T21:07:01.595 INFO:tasks.workunit.client.0.smithi096.stdout:4/723: dwrite d2/d2a/d54/d71/d99/dad/fd1 [0,4194304] 0 2024-04-18T21:07:01.596 INFO:tasks.workunit.client.0.smithi096.stdout:5/710: chown d2/d11/d28/d4a/d55/d81/lb2 3716308 1 2024-04-18T21:07:01.596 INFO:tasks.workunit.client.0.smithi096.stdout:7/663: write d0/d20/d4b/f86 [610177,76782] 0 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi096.stdout:0/698: chown d1/db/d30/d31/d85/d58 158626 1 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi096.stdout:8/755: dwrite d0/d3/d3a/dab/d61/ff3 [0,4194304] 0 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi096.stdout:6/727: link d1/d5/da/d90/d94/lc0 d1/d5/da/d46/d71/d7c/lf2 0 2024-04-18T21:07:01.598 INFO:tasks.workunit.client.0.smithi096.stdout:4/724: write d2/d2f/d33/d55/d59/db9/fd0 [876615,828] 0 2024-04-18T21:07:01.599 INFO:tasks.workunit.client.0.smithi096.stdout:7/664: chown d0/d7/d2f/d53/c6b 22 1 2024-04-18T21:07:01.599 INFO:tasks.workunit.client.0.smithi096.stdout:5/711: write d2/d11/d28/d64/d7e/f99 [2173476,114492] 0 2024-04-18T21:07:01.600 INFO:tasks.workunit.client.0.smithi096.stdout:0/699: read - d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/fb7 zero size 2024-04-18T21:07:01.600 INFO:tasks.workunit.client.0.smithi096.stdout:4/725: rmdir d2/d2f/d33/d55/d57/d7d 39 2024-04-18T21:07:01.600 INFO:tasks.workunit.client.0.smithi096.stdout:6/728: getdents d1/d3a 0 2024-04-18T21:07:01.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/665: truncate d0/d20/d39/d59/fba 273695 0 2024-04-18T21:07:01.602 INFO:tasks.workunit.client.0.smithi096.stdout:5/712: truncate d2/d18/d61/d6f/f91 706827 0 2024-04-18T21:07:01.602 INFO:tasks.workunit.client.0.smithi096.stdout:4/726: symlink d2/d2f/d33/d55/d57/d88/lf0 0 2024-04-18T21:07:01.603 INFO:tasks.workunit.client.0.smithi096.stdout:2/886: dwrite d11/d13/d1a/d1e/d28/f86 [0,4194304] 0 2024-04-18T21:07:01.603 INFO:tasks.workunit.client.0.smithi096.stdout:0/700: write d1/db/dda/de9/deb/f52 [2778479,44010] 0 2024-04-18T21:07:01.604 INFO:tasks.workunit.client.0.smithi096.stdout:2/887: truncate d11/d50/d5b/d8a/f105 4449524 0 2024-04-18T21:07:01.605 INFO:tasks.workunit.client.0.smithi096.stdout:2/888: write d11/d13/d1a/d1e/ff3 [124370,2299] 0 2024-04-18T21:07:01.606 INFO:tasks.workunit.client.0.smithi096.stdout:7/666: rmdir d0/d20/d62/d7d 39 2024-04-18T21:07:01.606 INFO:tasks.workunit.client.0.smithi096.stdout:4/727: unlink d2/d2f/d39/lbf 0 2024-04-18T21:07:01.606 INFO:tasks.workunit.client.0.smithi096.stdout:5/713: symlink d2/d11/d28/d4a/d69/l101 0 2024-04-18T21:07:01.606 INFO:tasks.workunit.client.0.smithi096.stdout:6/729: write d1/f34 [4107542,60519] 0 2024-04-18T21:07:01.606 INFO:tasks.workunit.client.0.smithi096.stdout:2/889: chown d11/d13/d1a/d1e/c119 657 1 2024-04-18T21:07:01.606 INFO:tasks.workunit.client.0.smithi096.stdout:5/714: chown d2/l1e 16 1 2024-04-18T21:07:01.607 INFO:tasks.workunit.client.0.smithi096.stdout:4/728: write d2/d2f/d39/d43/f83 [879367,45225] 0 2024-04-18T21:07:01.607 INFO:tasks.workunit.client.0.smithi096.stdout:6/730: unlink d1/l49 0 2024-04-18T21:07:01.607 INFO:tasks.workunit.client.0.smithi096.stdout:7/667: symlink d0/d11/d18/d2e/dae/lc6 0 2024-04-18T21:07:01.608 INFO:tasks.workunit.client.0.smithi096.stdout:5/715: creat d2/d18/d61/d6d/f102 x:0 0 0 2024-04-18T21:07:01.608 INFO:tasks.workunit.client.0.smithi096.stdout:2/890: write d11/d13/f2d [1774682,102532] 0 2024-04-18T21:07:01.609 INFO:tasks.workunit.client.0.smithi096.stdout:6/731: rmdir d1/d5/da/d46/d71/d7c/d8b 39 2024-04-18T21:07:01.609 INFO:tasks.workunit.client.0.smithi096.stdout:2/891: mknod d11/d13/d1a/d1e/c124 0 2024-04-18T21:07:01.611 INFO:tasks.workunit.client.0.smithi096.stdout:2/892: fdatasync d11/d13/d1a/d1e/d28/d4e/d89/fb2 0 2024-04-18T21:07:01.611 INFO:tasks.workunit.client.0.smithi096.stdout:2/893: sync 2024-04-18T21:07:01.612 INFO:tasks.workunit.client.0.smithi096.stdout:3/623: dread d4/f35 [0,4194304] 0 2024-04-18T21:07:01.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/894: dread - d11/d13/d1a/d1e/d28/d4e/d89/dc0/fe9 zero size 2024-04-18T21:07:01.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/668: dwrite d0/d7/d8/f26 [0,4194304] 0 2024-04-18T21:07:01.614 INFO:tasks.workunit.client.0.smithi096.stdout:2/895: mkdir d11/d13/d1a/d1e/d28/d4e/d5c/d121/d125 0 2024-04-18T21:07:01.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/732: dwrite d1/d3a/d57/f65 [0,4194304] 0 2024-04-18T21:07:01.616 INFO:tasks.workunit.client.0.smithi096.stdout:6/733: rmdir d1/d61/d91/dd1 39 2024-04-18T21:07:01.617 INFO:tasks.workunit.client.0.smithi096.stdout:6/734: link d1/fd9 d1/d61/ff3 0 2024-04-18T21:07:01.619 INFO:tasks.workunit.client.0.smithi096.stdout:6/735: rename d1/d5/da/d46/l5a to d1/d3a/lf4 0 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.029237331000001, 2024-04-18T21:07:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.016373111, 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.015571641000001, 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.014797936000001, 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.007552371999999, 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:01.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.004485712000001, 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:01.658 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:01.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:01.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.986641006999999, 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.665 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:01.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:01.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.985801967, 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:01.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:01.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:01.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.981448286999999, 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.680 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:01.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:01.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:01.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:01.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.980679975000001, 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:01.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:01.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.977330371000001, 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:01.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:01.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.963854393999998, 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:01.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:01.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:01.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.710 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.962200889999998, 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:01.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:01.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.959070121, 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:01.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:01.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.931757409999999, 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:01.723 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:01.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:01.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:01.730 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.930384984, 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.731 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:01.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:01.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:01.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:01.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.747178205, 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:01.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:01.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:01.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2145176549999999, 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:01.745 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:01.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:01.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:01.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2098324050000002, 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:01.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2091447439999996, 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:01.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:01.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:01.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:01.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:01.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:01.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:01.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:01.764 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:01.764 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:01.766 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:01.683+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:01.792 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:01.785+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:3/624: read d4/d6/d1b/d2c/d31/f41 [4565513,6862] 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:3/625: fsync d4/d8/f1f 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:3/626: fdatasync d4/d6/d1b/d2c/d5c/f91 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:9/854: dread d0/d28/d7a/dc3/d43/f8e [0,4194304] 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:9/855: readlink d0/d28/d7a/dc3/led 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:3/627: chown d4/d6/d1b/d2c/d6b/d99/da6/f83 511330146 1 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:1/761: dread d0/df/d16/d24/da8/fae [0,4194304] 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:1/762: chown d0/df/ddc 7 1 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi096.stdout:8/756: dread d0/f94 [0,4194304] 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:8/757: chown d0/d3/d1d/d83/dcd/d7f/ca6 827126 1 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:0/701: dread d1/d23/d32/d43/fb5 [0,4194304] 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:8/758: link d0/f94 d0/d3/d3a/dab/d46/dc5/ffd 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:0/702: mknod d1/d23/d32/daf/cec 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:8/759: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/dfe 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:5/716: dwrite d2/f7 [0,4194304] 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:2/896: truncate d11/d13/d1a/f26 3566624 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:1/763: truncate d0/df/de5/df8/d9b/dca/ff5 6406450 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:8/760: symlink d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/dd9/lff 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:0/703: getdents d1/d23/d32/d43/d6f/d8a/d96 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:6/736: readlink d1/d3a/d57/de3/d52/lb9 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:0/704: chown d1/db/d30/d31/d85 2 1 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:6/737: creat d1/d61/d91/dd1/ff5 x:0 0 0 2024-04-18T21:07:01.795 INFO:tasks.workunit.client.0.smithi096.stdout:8/761: write d0/d3/d1d/d83/dcd/d7f/dac/f8f [4647389,74222] 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/897: truncate d11/d13/d1a/d1e/d28/d4e/d63/d10a/dd2/d109/f115 705201 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:8/762: unlink d0/d3/d3a/dab/d61/ce7 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:6/738: mkdir d1/d5/da/d46/d71/dbc/df6 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:0/705: link d1/d23/d32/d7d/cb9 d1/d23/d32/d43/d6f/dd3/ced 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:0/706: stat d1/fd2 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:6/739: chown d1/d3a/d57/d66/d80/fce 65580513 1 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/898: link d11/d13/c38 d11/d13/d1a/d1e/d28/c126 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:7/669: dread d0/d7/d8/f1e [0,4194304] 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:3/628: dread d4/d8/f3d [0,4194304] 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:0/707: mkdir d1/d23/d32/d43/d6f/d8a/d91/dba/dee 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:7/670: mknod d0/d20/d4b/cc7 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:8/763: mknod d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/c100 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi096.stdout:8/764: stat d0/d64/d43/f4a 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:2/899: symlink d11/d13/d1a/d1e/d28/d4e/d63/d10a/l127 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:6/740: symlink d1/d3a/d36/d7a/lf7 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:7/671: rename d0/d20/f2d to d0/d7/d2f/d63/dc4/fc8 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:3/629: write d4/d6/f96 [1315127,100944] 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:3/630: chown d4/d8/f74 1362353384 1 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:7/672: mknod d0/d11/d18/cc9 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:8/765: symlink d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/l101 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:3/631: creat d4/d8/d49/d9e/fb7 x:0 0 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:7/673: dread - d0/d11/fad zero size 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:8/766: write d0/d64/f42 [2542523,54209] 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:0/708: dwrite d1/db/d30/d31/d85/f5 [0,4194304] 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:0/709: chown d1/db/d30/c69 111 1 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:4/729: dread d2/f19 [0,4194304] 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi096.stdout:2/900: dwrite d11/d13/d1a/d1e/d28/d4e/f7a [0,4194304] 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:6/741: dwrite d1/f14 [0,4194304] 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:5/717: dread d2/f16 [0,4194304] 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:9/856: sync 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:3/632: mkdir d4/d6/d7/db8 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/767: mkdir d0/d3/d1d/d102 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:2/901: stat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:0/710: creat d1/d23/d32/daf/fef x:0 0 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:6/742: truncate d1/d3a/d57/d66/d80/fbf 5088012 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:1/764: dread d0/df/d16/d24/dc0/d5f/d60/fa5 [0,4194304] 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:9/857: truncate d0/d8/d9/f105 4663291 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:7/674: rename d0/d11/d18/d2e to d0/d20/d62/dca 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/768: fsync d0/d3/f57 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi096.stdout:5/718: creat d2/d11/d28/d4a/de6/f103 x:0 0 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:3/633: getdents d4/d6/d1b/d2c/d6b 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:6/743: creat d1/d5/da/d46/d71/d7c/d8b/ff8 x:0 0 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:5/719: symlink d2/d11/d28/d4a/d69/l104 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:3/634: creat d4/d8/fb9 x:0 0 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:8/769: write d0/d3/d1d/d83/dcd/d7f/dac/d33/de2/ff5 [857476,69330] 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:6/744: stat d1/d5/da/d55/ld0 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:4/730: dwrite d2/d2f/d33/d55/d57/d88/da4/fd5 [0,4194304] 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:0/711: dwrite d1/da3/fc5 [0,4194304] 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:9/858: dwrite d0/d8/d11/d39/d63/f112 [0,4194304] 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:1/765: dwrite d0/f4 [4194304,4194304] 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/902: write d11/d13/f7b [707453,100904] 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:4/731: unlink f1 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:6/745: write d1/f1c [1941593,101711] 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:8/770: stat d0/d3/d1d/d83/dcd/fcf 0 2024-04-18T21:07:01.799 INFO:tasks.workunit.client.0.smithi096.stdout:9/859: rmdir d0/d28 39 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:5/720: rename d2/d11/d28/d4a/de6/f103 to d2/d6a/f105 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:7/675: dread d0/d20/f34 [0,4194304] 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:7/676: creat d0/d20/d39/d8a/fcb x:0 0 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:3/635: truncate d4/d6/d1b/d2c/f53 699513 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:4/732: mknod d2/d2f/d33/d55/d59/d5f/dcd/cf1 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:9/860: truncate d0/d8/d9/fb9 5028307 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:2/903: symlink d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/l128 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:4/733: chown d2/d2a/d54/d71/d99/deb 2 1 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:8/771: fdatasync d0/d3/d1d/d83/dcd/d7f/dac/f2a 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:1/766: getdents d0/df/d30 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:5/721: link d2/d11/d28/d4a/d55/f7c d2/f106 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:8/772: creat d0/d64/d43/f103 x:0 0 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:4/734: mknod d2/d2f/d39/d43/cf2 0 2024-04-18T21:07:01.800 INFO:tasks.workunit.client.0.smithi096.stdout:5/722: fsync d2/d6a/faa 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:8/773: chown d0/d3/d1d/d66 622744 1 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:5/723: creat d2/d6a/f107 x:0 0 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/677: link d0/d7/d2f/d63/dc4/fc8 d0/d20/d62/dca/fcc 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:9/861: fdatasync d0/d28/d3d/fcc 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/735: mknod d2/d2f/d39/cf3 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:5/724: chown d2/fd 16 1 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/678: chown d0/d20/d39/d59/fba 939 1 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/736: chown d2/f50 220167765 1 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:8/774: write d0/d3/d1d/d83/dcd/d7f/dac/d1b/f20 [2535989,89795] 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/679: creat d0/d7/d42/fcd x:0 0 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:5/725: rename d2/d11/d28/fef to d2/d11/d28/d4a/de6/f108 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/737: mknod d2/d2a/d54/d71/cf4 0 2024-04-18T21:07:01.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/680: write d0/d7/f5f [391315,98778] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:6/746: dwrite d1/d5/da/d46/d71/d7c/d8b/fba [0,4194304] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:7/681: stat d0/c54 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/738: write d2/d2f/d39/d43/fc1 [54401,44696] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:2/904: dwrite d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f6b [0,4194304] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:8/775: rename d0/f12 to d0/d5d/f104 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:5/726: mkdir d2/d18/d61/d6d/d109 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:1/767: dwrite d0/df/fb9 [0,4194304] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:7/682: creat d0/d20/d39/fce x:0 0 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/739: chown d2/d2a/d54/d5b/c95 0 1 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:5/727: stat d2/d11/d28/d64/dba/fdc 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:1/768: chown d0/df/d16/d24/dac/l8b 12043242 1 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:6/747: truncate d1/d3a/d36/f42 3122206 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:7/683: mknod d0/d7/d49/ccf 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/740: stat d2/d1d/d3a/dc9/ce8 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:1/769: readlink d0/df/d16/d24/dc0/l47 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:7/684: dread - d0/d7/d2f/d63/fa8 zero size 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:7/685: readlink d0/d7/d8/l15 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:2/905: mkdir d11/d13/d1a/d1e/d28/d4e/d5c/d121/d125/d129 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:1/770: creat d0/df/d16/d24/dac/fff x:0 0 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:4/741: creat d2/d2f/d33/d55/d57/d88/ff5 x:0 0 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:6/748: write d1/d3a/f3f [1026365,60747] 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:7/686: creat d0/d20/d62/fd0 x:0 0 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/862: truncate d0/d28/d3d/f54 1390385 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:4/742: creat d2/d2a/d54/d5b/ff6 x:0 0 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:2/906: write d11/d13/d1a/d1e/d28/d4e/f3d [1749869,31830] 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:4/743: chown d2/d2f/fac 48575044 1 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi096.stdout:7/687: mknod d0/d20/d4b/d7f/da1/cd1 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:5/728: dwrite d2/d38/d4c/f5e [0,4194304] 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/771: rename d0/df/d16/d24/dac/dd2/lf1 to d0/df/d16/d6c/d9d/l100 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:7/688: mknod d0/d20/d39/d8a/db4/cd2 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/772: symlink d0/df/de5/l101 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:5/729: creat d2/d11/d28/d4a/d55/d81/dbe/f10a x:0 0 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:7/689: fsync d0/d7/d8/f56 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:2/907: getdents d11/d13/d1a/d1e/d28/d4e/d40/d51 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/773: stat d0/df/d16/d24/da8 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:4/744: write d2/d2a/d54/d6d/f81 [2674034,127513] 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:7/690: write d0/d11/f17 [1501538,28942] 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/774: stat d0/df/de5/df8/d9b/dca/dde/fc4 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:2/908: symlink d11/d13/d1a/d1e/d28/l12a 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:4/745: creat d2/dbb/ff7 x:0 0 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi096.stdout:7/691: mkdir d0/d7/d2f/d63/dd3 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:5/730: link d2/d18/d9d/cf1 d2/d11/d28/d4a/d55/d81/c10b 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:4/746: dread - d2/d2f/d33/fcc zero size 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/863: dwrite d0/d28/d7a/dc3/dc6/da3/fd7 [0,4194304] 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/909: mknod d11/d13/d1a/d1e/d28/c12b 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:5/731: truncate d2/d18/fc5 967919 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/864: symlink d0/d8/d9/l114 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:5/732: dread - d2/d11/d28/d64/dba/fdc zero size 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:8/776: read d0/d64/d43/f4a [789820,43364] 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:5/733: fsync d2/d11/d28/f72 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/910: fdatasync d11/d13/d1a/d1e/d28/d4e/d63/d10a/dd2/d109/f115 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:4/747: dread d2/d2a/d54/d6d/f81 [0,4194304] 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:6/749: truncate d1/d5/f1b 3447608 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:7/692: write d0/d20/d62/dca/fcc [1286518,77629] 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi096.stdout:6/750: stat d1/d3a/d57/d66 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/693: rmdir d0/d7/d2f 39 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/694: chown d0/l5b 0 1 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:8/777: dwrite d0/d3/db/f45 [0,4194304] 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:6/751: rename d1/d5/da/lf0 to d1/d5/da/d46/d71/dbc/df6/lf9 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:4/748: link d2/d2f/d33/d55/d59/d5f/fb6 d2/d2f/d33/d55/d59/db9/ff8 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/695: mknod d0/d7/d2f/d53/cd4 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:1/775: truncate d0/df/d16/d24/dc0/f7c 5549158 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:1/776: stat d0/df/d16/d24/dac/dd2 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/696: mknod d0/d20/d39/d8a/db4/cd5 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:1/777: chown d0/df/d16/d24/dac/d65 1506 1 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:7/697: mkdir d0/d20/d62/dca/dd6 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:6/752: truncate d1/d61/d91/fb1 44638 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:1/778: dwrite d0/df/d62/f85 [0,4194304] 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi096.stdout:6/753: mknod d1/d5/da/d46/d71/dbc/df6/cfa 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:1/779: unlink d0/df/d16/d24/dac/fff 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:7/698: dwrite d0/d7/d49/f7b [4194304,4194304] 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:7/699: read - d0/d20/d62/fd0 zero size 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:1/780: unlink d0/df/d16/d6c/dab/fe2 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:6/754: rename d1/d5/da/d90 to d1/d3a/d57/d66/d80/dfb 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:4/749: dread d2/d2f/d33/d55/f9f [0,4194304] 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:6/755: creat d1/d3a/d57/d26/ffc x:0 0 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:4/750: mknod d2/d2f/d33/d55/d59/db9/cf9 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:0/712: dread d1/db/d30/d31/f3b [0,4194304] 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:4/751: write d2/d2a/d54/d5b/fa8 [775046,96860] 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:0/713: chown d1/db/d25/f99 166 1 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:6/756: mknod d1/cfd 0 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:3/636: sync 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:5/734: sync 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:4/752: chown d2/f38 22043954 1 2024-04-18T21:07:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:3/637: dread - d4/d6/d1b/d2c/d6b/d99/da6/f9f zero size 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:0/714: creat d1/d23/d32/d43/d6f/ff0 x:0 0 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:5/735: creat d2/d18/d61/d6f/d7a/f10c x:0 0 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/757: mknod d1/d3a/d57/d66/d80/dfb/dbb/cfe 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:4/753: rename d2/d1d/d3a/fdb to d2/d2a/d54/d5b/d89/d90/ffa 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:0/715: write d1/da3/fc5 [2642001,124606] 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/758: symlink d1/d17/lff 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:1/781: dwrite d0/df/d16/d6c/d9d/fa4 [0,4194304] 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:9/865: dread d0/d28/d2f/f17 [0,4194304] 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:0/716: unlink d1/db/d30/f81 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:9/866: unlink d0/d28/d3d/f62 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:1/782: creat d0/df/d16/d24/dc0/f102 x:0 0 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:0/717: fsync d1/db/dda/de9/deb/d5d/d60/f1f 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:9/867: creat d0/d28/d2f/de6/ddb/f115 x:0 0 0 2024-04-18T21:07:01.808 INFO:tasks.workunit.client.0.smithi096.stdout:0/718: readlink d1/db/dda/de9/deb/l9b 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/778: dread d0/d5d/f77 [0,4194304] 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:0/719: stat d1/db/dda/de9/deb/d5d/d60/f1f 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:1/783: read d0/df/d30/f4e [1003975,117850] 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:9/868: getdents d0/d28/d7a/dc3/dc6 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/779: fsync d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:1/784: creat d0/dd0/df6/f103 x:0 0 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:0/720: mknod d1/db/dda/de9/deb/d5d/d60/cf1 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:1/785: write d0/df/d30/f94 [1037156,118811] 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/780: creat d0/d3/d1d/d102/f105 x:0 0 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/781: creat d0/d3/d3a/d81/f106 x:0 0 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:4/754: truncate d2/f19 1006522 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/782: rename d0/fe to d0/d3/d1d/d83/dcd/dd1/f107 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:5/736: truncate d2/d38/d4c/f9f 495099 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:4/755: stat d2/d1d/ca 0 2024-04-18T21:07:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:5/737: dread - d2/d11/d28/d64/f92 zero size 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:0/721: chown d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/lc0 20 1 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:8/783: fsync d0/d3/d1d/d83/dcd/d7f/dac/d33/f6b 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:4/756: symlink d2/d2a/d54/lfb 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:1/786: dread d0/df/fb9 [0,4194304] 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:8/784: fsync d0/d3/d1d/d83/dcd/d7f/dac/f8f 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:7/700: dread d0/d20/d39/d8a/fab [0,4194304] 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:5/738: creat d2/d11/d28/d4a/d55/d81/ddf/de5/f10d x:0 0 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:1/787: write d0/dd0/df6/f103 [922090,118392] 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:5/739: readlink d2/d11/l19 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:8/785: getdents d0/d3 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:5/740: creat d2/d18/d9d/da0/dcb/f10e x:0 0 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:8/786: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/f108 x:0 0 0 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:4/757: write d2/d1d/f29 [801888,84572] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:5/741: symlink d2/d11/d28/d4a/l10f 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:8/787: unlink d0/d3/db/d6f/fa9 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:5/742: mknod d2/d11/d28/d4a/c110 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:4/758: write d2/d2a/d54/d71/d99/dad/fd1 [3421906,119395] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:4/759: readlink d2/d2f/d33/d55/d59/l77 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:6/759: dread d1/d3a/d36/f8e [0,4194304] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:2/911: dread d11/d13/d1a/d1e/d28/d4e/f3d [0,4194304] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:1/788: truncate d0/df/d62/f85 2285642 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:7/701: write d0/d7/fbd [574441,109472] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:7/702: stat d0/d20/d4b/f86 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:7/703: fsync d0/d7/d8/f16 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:8/788: dwrite d0/d5d/fee [0,4194304] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:3/638: dread d4/d6/d1b/d1d/f28 [0,4194304] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:4/760: dwrite d2/d2f/d39/d43/f83 [0,4194304] 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:7/704: mknod d0/d20/d4b/d7f/da1/cd7 0 2024-04-18T21:07:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:1/789: link d0/df/d16/d24/c74 d0/df/d16/d24/c104 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/761: dread - d2/d1d/fae zero size 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:6/760: dwrite d1/d3a/d57/de3/f8c [0,4194304] 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:8/789: write d0/d3/d1d/d83/dcd/d7f/dac/d1b/fe0 [685438,109526] 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:2/912: dwrite d11/d13/f15 [0,4194304] 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:1/790: mknod d0/df/d16/d24/dc0/d5f/d60/d90/c105 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/762: unlink d2/d2f/d39/l3c 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:3/639: write d4/d8/f3d [729018,10622] 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:7/705: getdents d0/d7/d2f/d63/dd3 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:1/791: stat d0/df/f64 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:8/790: link d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/cbf d0/d3/d1d/d102/c109 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:2/913: getdents d11/d13/d1a/d1e/d28/d4e/d89 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:3/640: mknod d4/d6/d1b/d2c/d31/d4e/cba 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/763: write d2/d2a/d54/d5b/ff6 [960052,120431] 0 2024-04-18T21:07:01.812 INFO:tasks.workunit.client.0.smithi096.stdout:3/641: write d4/d6/d1b/f38 [1932084,21781] 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:7/706: mkdir d0/d7/d2f/d63/dd3/dd8 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/791: mkdir d0/d3/d1d/d66/d10a 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:7/707: fsync d0/d7/d42/f87 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:3/642: write d4/d6/d7/fac [891774,128471] 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/792: rmdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d9b 39 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:3/643: getdents d4/d6/d1b 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/793: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 zero size 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/794: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:5/743: read d2/f10 [201338,42684] 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/795: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d33/de2/d10c 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:5/744: mkdir d2/d18/d61/d6f/d7a/d111 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:5/745: stat d2/d18/fc5 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:5/746: chown d2/d8f 1410741974 1 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:1/792: rename d0/df/d16/d24/dc0/d5f/d60 to d0/df/d16/d6c/d106 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:1/793: stat d0/df/d16/d24/dc0 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:4/764: rename d2/d2a/d54/d71/f80 to d2/d2a/d54/d6d/d78/ffc 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:3/644: truncate d4/d6/f32 1580169 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:1/794: rmdir d0/df/d62 39 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:4/765: write d2/f60 [82048,116550] 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:7/708: rename d0/d20/d4b/d7f/da1/cd1 to d0/d20/d39/cd9 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:9/869: sync 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:3/645: mkdir d4/d6/dbb 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:1/795: creat d0/df/d16/d24/d9c/f107 x:0 0 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:3/646: creat d4/d8/d49/fbc x:0 0 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:6/761: dwrite d1/d61/ff3 [0,4194304] 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:0/722: dread d1/f75 [0,4194304] 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:7/709: getdents d0/d7/d2f/d63/dc4 0 2024-04-18T21:07:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:6/762: unlink d1/d5/da/d44/d97/ldf 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:1/796: creat d0/df/d16/d24/da8/f108 x:0 0 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:9/870: dwrite d0/d44/f60 [0,4194304] 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:6/763: symlink d1/d3a/d57/d66/l100 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:4/766: dwrite d2/d2f/d33/f34 [4194304,4194304] 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:3/647: fdatasync d4/d6/d1b/d2c/f53 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:1/797: symlink d0/df/d30/d53/l109 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:9/871: rmdir d0/d8/d11/d48 39 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:5/747: dwrite d2/d18/f8a [0,4194304] 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:9/872: sync 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:6/764: stat d1/d5/da/d55/f6c 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:8/796: dwrite d0/d3/d1d/d83/dcd/d7f/dac/f31 [0,4194304] 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:3/648: chown d4/d6/d1b/d63/la8 0 1 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:4/767: write d2/d2a/d54/d5b/d89/fd3 [5709049,118800] 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:0/723: dwrite d1/db/d25/f3d [0,4194304] 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:3/649: readlink d4/l2d 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:9/873: link d0/d44/ld6 d0/d28/d66/l116 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:8/797: mkdir d0/d3/d3a/dab/d61/d10d 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:5/748: chown d2/d18/c39 857 1 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:1/798: link d0/df/d16/d24/dc0/f7c d0/df/d30/d53/da2/f10a 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:1/799: rmdir d0/df/d30/d53 39 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:4/768: symlink d2/dc3/lfd 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:7/710: dwrite d0/d11/f29 [4194304,4194304] 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/914: dread d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 [0,4194304] 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:0/724: creat d1/db/dda/de9/deb/d82/ff2 x:0 0 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:4/769: write d2/d2a/f4a [4817540,50203] 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:7/711: mkdir d0/d20/d39/dda 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:6/765: read d1/d3a/d57/d26/fa9 [194727,43344] 0 2024-04-18T21:07:01.817 INFO:tasks.workunit.client.0.smithi096.stdout:4/770: dread - d2/d2a/d54/d6d/fc8 zero size 2024-04-18T21:07:01.817 INFO:tasks.workunit.client.0.smithi096.stdout:6/766: sync 2024-04-18T21:07:01.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/874: creat d0/f117 x:0 0 0 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:2/915: rmdir d11/d13/d1a/d1e/d28/d4e/d40/dbe 39 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:9/875: chown d0/dc/d5f/d76/fe9 59897924 1 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:1/800: creat d0/df/d16/d24/dac/d6a/f10b x:0 0 0 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:5/749: dwrite d2/d11/d28/d4a/fca [0,4194304] 0 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:3/650: getdents d4/d6/d7/d90 0 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:4/771: write d2/d2f/fb1 [2749,125824] 0 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:1/801: stat d0/df/d16/d24/f31 0 2024-04-18T21:07:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:9/876: creat d0/d28/da1/f118 x:0 0 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:2/916: rmdir d11/d13/d1a/d1e/d28/d4e/d63/dce 39 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/802: rmdir d0/df/d16/d24/da8 39 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:5/750: write d2/d11/d28/d4a/d55/d81/ddf/de5/f10d [1046518,39310] 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:0/725: dwrite d1/db/dda/de9/deb/d6d/db1/fc8 [0,4194304] 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:5/751: stat d2/f3a 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:6/767: truncate d1/d3a/f3f 4363852 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:3/651: link d4/d8/d49/l4d d4/d8/d7f/d94/lbd 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:5/752: write d2/d11/f68 [274368,48934] 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/803: chown d0/df/d16/d24/dac/dd2/fe8 8 1 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:6/768: chown d1/d3a/d57/de3/fa6 32289 1 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/804: chown d0/dd0/ddb 618533739 1 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:7/712: dwrite d0/d7/d8/f94 [0,4194304] 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:2/917: creat d11/d13/d1a/d1e/d28/d4e/d63/dce/f12c x:0 0 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/805: truncate d0/dd0/fd6 409096 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:6/769: write d1/d61/d91/f9a [530544,34695] 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:6/770: sync 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:4/772: dwrite d2/d2f/d33/f8a [4194304,4194304] 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/918: mkdir d11/d13/d1a/d1e/d28/d4e/d12d 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:9/877: dwrite d0/d28/d3d/fd3 [0,4194304] 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:3/652: truncate d4/d6/d1b/d2c/d31/f41 1288632 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:3/653: symlink d4/d8/d49/d9e/lbe 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/919: rename d11/d50/d5b/fb7 to d11/d13/d1a/d1e/de7/f12e 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:5/753: dwrite d2/f46 [0,4194304] 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:0/726: dwrite d1/d23/d32/d43/f4f [0,4194304] 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:7/713: dwrite d0/d11/fad [0,4194304] 0 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:5/754: chown d2/d18/d61/d6f/f95 1970755 1 2024-04-18T21:07:01.822 INFO:tasks.workunit.client.0.smithi096.stdout:0/727: fdatasync d1/db/d30/f5b 0 2024-04-18T21:07:01.823 INFO:tasks.workunit.client.0.smithi096.stdout:7/714: creat d0/d20/d6c/fdb x:0 0 0 2024-04-18T21:07:01.823 INFO:tasks.workunit.client.0.smithi096.stdout:6/771: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:07:01.823 INFO:tasks.workunit.client.0.smithi096.stdout:6/772: sync 2024-04-18T21:07:01.823 INFO:tasks.workunit.client.0.smithi096.stdout:4/773: dwrite d2/d2f/d39/d43/fc1 [0,4194304] 0 2024-04-18T21:07:01.823 INFO:tasks.workunit.client.0.smithi096.stdout:5/755: rename d2/d11/d28/d4a/de6 to d2/d6a/d112 0 2024-04-18T21:07:01.824 INFO:tasks.workunit.client.0.smithi096.stdout:4/774: chown d2/dc3/lfd 3494 1 2024-04-18T21:07:01.825 INFO:tasks.workunit.client.0.smithi096.stdout:6/773: dread d1/d3a/d36/f8e [0,4194304] 0 2024-04-18T21:07:01.825 INFO:tasks.workunit.client.0.smithi096.stdout:9/878: dwrite d0/d8/d11/d48/f7e [0,4194304] 0 2024-04-18T21:07:01.825 INFO:tasks.workunit.client.0.smithi096.stdout:6/774: write d1/d17/f5c [5156610,63476] 0 2024-04-18T21:07:01.826 INFO:tasks.workunit.client.0.smithi096.stdout:8/798: dread d0/d3/d3a/dab/f4b [0,4194304] 0 2024-04-18T21:07:01.828 INFO:tasks.workunit.client.0.smithi096.stdout:3/654: dwrite d4/d6/d1b/d2c/f43 [0,4194304] 0 2024-04-18T21:07:01.828 INFO:tasks.workunit.client.0.smithi096.stdout:6/775: readlink d1/d3a/d57/de3/la7 0 2024-04-18T21:07:01.829 INFO:tasks.workunit.client.0.smithi096.stdout:9/879: creat d0/d8/d11/d48/f119 x:0 0 0 2024-04-18T21:07:01.832 INFO:tasks.workunit.client.0.smithi096.stdout:8/799: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/d10e 0 2024-04-18T21:07:01.832 INFO:tasks.workunit.client.0.smithi096.stdout:0/728: dwrite d1/db/d30/d31/d85/fd [0,4194304] 0 2024-04-18T21:07:01.832 INFO:tasks.workunit.client.0.smithi096.stdout:5/756: dwrite d2/d11/d28/f78 [0,4194304] 0 2024-04-18T21:07:01.832 INFO:tasks.workunit.client.0.smithi096.stdout:0/729: chown d1/db/d30/d31/d65 2 1 2024-04-18T21:07:01.833 INFO:tasks.workunit.client.0.smithi096.stdout:5/757: symlink d2/d11/d28/d4a/l113 0 2024-04-18T21:07:01.833 INFO:tasks.workunit.client.0.smithi096.stdout:8/800: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/f10f x:0 0 0 2024-04-18T21:07:01.834 INFO:tasks.workunit.client.0.smithi096.stdout:0/730: getdents d1/d23/d32/d7d 0 2024-04-18T21:07:01.835 INFO:tasks.workunit.client.0.smithi096.stdout:7/715: dwrite d0/d20/d39/d8a/fcb [0,4194304] 0 2024-04-18T21:07:01.835 INFO:tasks.workunit.client.0.smithi096.stdout:8/801: unlink d0/d3/db/f13 0 2024-04-18T21:07:01.835 INFO:tasks.workunit.client.0.smithi096.stdout:5/758: creat d2/d11/d28/d4a/d55/d81/ddf/de5/f114 x:0 0 0 2024-04-18T21:07:01.836 INFO:tasks.workunit.client.0.smithi096.stdout:0/731: symlink d1/da3/dde/lf3 0 2024-04-18T21:07:01.836 INFO:tasks.workunit.client.0.smithi096.stdout:7/716: creat d0/d20/d62/dca/dd6/fdc x:0 0 0 2024-04-18T21:07:01.836 INFO:tasks.workunit.client.0.smithi096.stdout:8/802: symlink d0/d3/db/d6f/l110 0 2024-04-18T21:07:01.836 INFO:tasks.workunit.client.0.smithi096.stdout:5/759: dread - d2/d8f/ff5 zero size 2024-04-18T21:07:01.837 INFO:tasks.workunit.client.0.smithi096.stdout:0/732: symlink d1/d23/d32/d43/d6f/d8a/d91/dba/lf4 0 2024-04-18T21:07:01.838 INFO:tasks.workunit.client.0.smithi096.stdout:8/803: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/cbf 596150 1 2024-04-18T21:07:01.838 INFO:tasks.workunit.client.0.smithi096.stdout:7/717: creat d0/fdd x:0 0 0 2024-04-18T21:07:01.839 INFO:tasks.workunit.client.0.smithi096.stdout:7/718: mkdir d0/d20/d4b/d7f/d9b/dde 0 2024-04-18T21:07:01.847 INFO:tasks.workunit.client.0.smithi096.stdout:3/655: truncate d4/d8/f3d 965838 0 2024-04-18T21:07:01.849 INFO:tasks.workunit.client.0.smithi096.stdout:4/775: dread d2/d2f/d33/d55/d57/d7d/fb4 [0,4194304] 0 2024-04-18T21:07:01.849 INFO:tasks.workunit.client.0.smithi096.stdout:4/776: chown d2/d2a/d54 19759415 1 2024-04-18T21:07:01.850 INFO:tasks.workunit.client.0.smithi096.stdout:5/760: truncate d2/d18/f5c 1474872 0 2024-04-18T21:07:01.850 INFO:tasks.workunit.client.0.smithi096.stdout:0/733: truncate d1/db/dda/de9/deb/d6d/f80 853224 0 2024-04-18T21:07:01.851 INFO:tasks.workunit.client.0.smithi096.stdout:8/804: truncate d0/d3/d3a/dab/d61/ff3 1231798 0 2024-04-18T21:07:01.852 INFO:tasks.workunit.client.0.smithi096.stdout:4/777: mknod d2/d2f/d33/d55/da3/cfe 0 2024-04-18T21:07:01.852 INFO:tasks.workunit.client.0.smithi096.stdout:5/761: creat d2/d38/f115 x:0 0 0 2024-04-18T21:07:01.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/734: truncate d1/d23/d32/d43/d6f/d8a/d96/db4/fc4 115058 0 2024-04-18T21:07:01.853 INFO:tasks.workunit.client.0.smithi096.stdout:5/762: unlink d2/d18/d9d/da0/fd0 0 2024-04-18T21:07:01.856 INFO:tasks.workunit.client.0.smithi096.stdout:4/778: creat d2/d2f/d33/d55/de0/fff x:0 0 0 2024-04-18T21:07:01.856 INFO:tasks.workunit.client.0.smithi096.stdout:7/719: dwrite d0/d20/f34 [0,4194304] 0 2024-04-18T21:07:01.857 INFO:tasks.workunit.client.0.smithi096.stdout:4/779: stat d2/d2f/d33/d55/d59/db9/cf9 0 2024-04-18T21:07:01.857 INFO:tasks.workunit.client.0.smithi096.stdout:7/720: creat d0/fdf x:0 0 0 2024-04-18T21:07:01.858 INFO:tasks.workunit.client.0.smithi096.stdout:7/721: mknod d0/d20/d4b/ce0 0 2024-04-18T21:07:01.859 INFO:tasks.workunit.client.0.smithi096.stdout:4/780: getdents d2/dc3 0 2024-04-18T21:07:01.859 INFO:tasks.workunit.client.0.smithi096.stdout:8/805: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d1b/db3/fd6 [0,4194304] 0 2024-04-18T21:07:01.860 INFO:tasks.workunit.client.0.smithi096.stdout:4/781: dread - d2/d2f/d33/fa0 zero size 2024-04-18T21:07:01.860 INFO:tasks.workunit.client.0.smithi096.stdout:7/722: creat d0/d7/d2f/d63/dd3/dd8/fe1 x:0 0 0 2024-04-18T21:07:01.860 INFO:tasks.workunit.client.0.smithi096.stdout:5/763: dwrite d2/f44 [0,4194304] 0 2024-04-18T21:07:01.861 INFO:tasks.workunit.client.0.smithi096.stdout:8/806: chown d0/d3/d1d/d102/c109 149 1 2024-04-18T21:07:01.861 INFO:tasks.workunit.client.0.smithi096.stdout:7/723: symlink d0/le2 0 2024-04-18T21:07:01.861 INFO:tasks.workunit.client.0.smithi096.stdout:4/782: chown d2/d2f/f5a 511 1 2024-04-18T21:07:01.862 INFO:tasks.workunit.client.0.smithi096.stdout:7/724: chown d0/d20/d4b/f86 0 1 2024-04-18T21:07:01.862 INFO:tasks.workunit.client.0.smithi096.stdout:4/783: chown d2/d2f/fdc 243697780 1 2024-04-18T21:07:01.862 INFO:tasks.workunit.client.0.smithi096.stdout:8/807: creat d0/d3/d3a/dab/d46/dc5/f111 x:0 0 0 2024-04-18T21:07:01.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/764: link d2/d18/l35 d2/d18/d9d/da0/db5/l116 0 2024-04-18T21:07:01.863 INFO:tasks.workunit.client.0.smithi096.stdout:4/784: mkdir d2/d2f/d33/d55/d100 0 2024-04-18T21:07:01.863 INFO:tasks.workunit.client.0.smithi096.stdout:5/765: unlink d2/d11/d28/d4a/c110 0 2024-04-18T21:07:01.864 INFO:tasks.workunit.client.0.smithi096.stdout:4/785: write d2/d1d/d3a/fbc [722258,48163] 0 2024-04-18T21:07:01.864 INFO:tasks.workunit.client.0.smithi096.stdout:7/725: link d0/d11/d18/c1b d0/d20/d39/d8a/ce3 0 2024-04-18T21:07:01.864 INFO:tasks.workunit.client.0.smithi096.stdout:6/776: dread d1/f30 [0,4194304] 0 2024-04-18T21:07:01.865 INFO:tasks.workunit.client.0.smithi096.stdout:5/766: rmdir d2/d6a/df0 39 2024-04-18T21:07:01.865 INFO:tasks.workunit.client.0.smithi096.stdout:8/808: getdents d0/d3/d3a/dab/d46/d78 0 2024-04-18T21:07:01.866 INFO:tasks.workunit.client.0.smithi096.stdout:6/777: creat d1/d3a/d57/d66/d9b/d9f/f101 x:0 0 0 2024-04-18T21:07:01.866 INFO:tasks.workunit.client.0.smithi096.stdout:8/809: fdatasync d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/f50 0 2024-04-18T21:07:01.867 INFO:tasks.workunit.client.0.smithi096.stdout:6/778: fsync d1/d3a/d36/f8e 0 2024-04-18T21:07:01.867 INFO:tasks.workunit.client.0.smithi096.stdout:8/810: stat d0/d3/db/d6f/l110 0 2024-04-18T21:07:01.868 INFO:tasks.workunit.client.0.smithi096.stdout:8/811: rename d0/d3/f18 to d0/d3/d1d/d83/dcd/d7f/f112 0 2024-04-18T21:07:01.873 INFO:tasks.workunit.client.0.smithi096.stdout:0/735: truncate d1/db/dda/de9/deb/f52 2832397 0 2024-04-18T21:07:01.874 INFO:tasks.workunit.client.0.smithi096.stdout:4/786: dwrite d2/d2f/d33/fcc [0,4194304] 0 2024-04-18T21:07:01.874 INFO:tasks.workunit.client.0.smithi096.stdout:6/779: dwrite d1/d3a/d57/de3/fa6 [0,4194304] 0 2024-04-18T21:07:01.875 INFO:tasks.workunit.client.0.smithi096.stdout:0/736: unlink d1/d23/d32/l44 0 2024-04-18T21:07:01.877 INFO:tasks.workunit.client.0.smithi096.stdout:0/737: truncate d1/db/d25/f99 2134287 0 2024-04-18T21:07:01.878 INFO:tasks.workunit.client.0.smithi096.stdout:3/656: read d4/d6/d1b/d1d/f7a [107542,106914] 0 2024-04-18T21:07:01.880 INFO:tasks.workunit.client.0.smithi096.stdout:0/738: creat d1/db/d30/d4a/d67/ff5 x:0 0 0 2024-04-18T21:07:01.880 INFO:tasks.workunit.client.0.smithi096.stdout:8/812: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/f113 x:0 0 0 2024-04-18T21:07:01.881 INFO:tasks.workunit.client.0.smithi096.stdout:4/787: dwrite d2/d1d/fb5 [0,4194304] 0 2024-04-18T21:07:01.883 INFO:tasks.workunit.client.0.smithi096.stdout:2/920: dread d11/d13/d1a/d1e/d28/d4e/d63/d10a/ff2 [0,4194304] 0 2024-04-18T21:07:01.884 INFO:tasks.workunit.client.0.smithi096.stdout:4/788: rmdir d2/d2f/d39/d43 39 2024-04-18T21:07:01.886 INFO:tasks.workunit.client.0.smithi096.stdout:4/789: mkdir d2/d2a/d54/d71/d99/dad/d101 0 2024-04-18T21:07:01.886 INFO:tasks.workunit.client.0.smithi096.stdout:3/657: dwrite d4/d6/d1b/d1d/f28 [0,4194304] 0 2024-04-18T21:07:01.887 INFO:tasks.workunit.client.0.smithi096.stdout:6/780: dwrite d1/d5/da/f21 [0,4194304] 0 2024-04-18T21:07:01.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:01.886+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:01.889 INFO:tasks.workunit.client.0.smithi096.stdout:3/658: fsync d4/d6/d7/f10 0 2024-04-18T21:07:01.889 INFO:tasks.workunit.client.0.smithi096.stdout:4/790: creat d2/d2a/d54/d71/f102 x:0 0 0 2024-04-18T21:07:01.889 INFO:tasks.workunit.client.0.smithi096.stdout:6/781: write d1/d5/da/d46/d71/f7f [747642,19125] 0 2024-04-18T21:07:01.889 INFO:tasks.workunit.client.0.smithi096.stdout:3/659: symlink d4/d8/lbf 0 2024-04-18T21:07:01.890 INFO:tasks.workunit.client.0.smithi096.stdout:6/782: write d1/d5/da/d44/f7d [2366928,35490] 0 2024-04-18T21:07:01.891 INFO:tasks.workunit.client.0.smithi096.stdout:0/739: read d1/f15 [3295042,128998] 0 2024-04-18T21:07:01.892 INFO:tasks.workunit.client.0.smithi096.stdout:2/921: dwrite d11/d13/d1a/d1e/d28/d4e/d63/d10a/f95 [0,4194304] 0 2024-04-18T21:07:01.892 INFO:tasks.workunit.client.0.smithi096.stdout:6/783: rename d1/d3a/d57/de3/d52 to d1/d3a/d36/d7a/d102 0 2024-04-18T21:07:01.893 INFO:tasks.workunit.client.0.smithi096.stdout:6/784: chown d1/d61/d91/dd1/fd4 155 1 2024-04-18T21:07:01.894 INFO:tasks.workunit.client.0.smithi096.stdout:2/922: truncate d11/d13/d1a/faf 170416 0 2024-04-18T21:07:01.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/740: mkdir d1/db/dda/de9/deb/d5d/d60/df6 0 2024-04-18T21:07:01.898 INFO:tasks.workunit.client.0.smithi096.stdout:4/791: dwrite d2/d2f/d33/d55/d59/db9/fca [0,4194304] 0 2024-04-18T21:07:01.898 INFO:tasks.workunit.client.0.smithi096.stdout:0/741: symlink d1/db/d30/d31/lf7 0 2024-04-18T21:07:01.899 INFO:tasks.workunit.client.0.smithi096.stdout:6/785: truncate d1/d3a/d36/f42 2194025 0 2024-04-18T21:07:01.899 INFO:tasks.workunit.client.0.smithi096.stdout:9/880: dread d0/fa0 [4194304,4194304] 0 2024-04-18T21:07:01.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/923: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/f12f x:0 0 0 2024-04-18T21:07:01.899 INFO:tasks.workunit.client.0.smithi096.stdout:3/660: dwrite d4/d6/d22/d20/f44 [0,4194304] 0 2024-04-18T21:07:01.900 INFO:tasks.workunit.client.0.smithi096.stdout:0/742: truncate d1/d23/d32/d43/d6f/ff0 847839 0 2024-04-18T21:07:01.901 INFO:tasks.workunit.client.0.smithi096.stdout:1/806: dread d0/f44 [0,4194304] 0 2024-04-18T21:07:01.901 INFO:tasks.workunit.client.0.smithi096.stdout:0/743: mknod d1/d23/d32/cf8 0 2024-04-18T21:07:01.902 INFO:tasks.workunit.client.0.smithi096.stdout:4/792: rename d2/d1d/d3a/dc9 to d2/d2f/d39/d43/d103 0 2024-04-18T21:07:01.903 INFO:tasks.workunit.client.0.smithi096.stdout:0/744: fsync d1/db/d30/d31/d85/d58/fd0 0 2024-04-18T21:07:01.904 INFO:tasks.workunit.client.0.smithi096.stdout:4/793: unlink d2/f2e 0 2024-04-18T21:07:01.904 INFO:tasks.workunit.client.0.smithi096.stdout:9/881: truncate d0/dc/d5f/d76/dc1/dee/f10e 1280662 0 2024-04-18T21:07:01.908 INFO:tasks.workunit.client.0.smithi096.stdout:6/786: dwrite d1/f41 [0,4194304] 0 2024-04-18T21:07:01.909 INFO:tasks.workunit.client.0.smithi096.stdout:9/882: creat d0/d28/d66/db2/f11a x:0 0 0 2024-04-18T21:07:01.910 INFO:tasks.workunit.client.0.smithi096.stdout:0/745: creat d1/d23/d32/d43/d6f/d8a/d91/dba/dee/ff9 x:0 0 0 2024-04-18T21:07:01.910 INFO:tasks.workunit.client.0.smithi096.stdout:2/924: dwrite d11/d13/f2d [0,4194304] 0 2024-04-18T21:07:01.910 INFO:tasks.workunit.client.0.smithi096.stdout:4/794: rename d2/d2f/d33/d55/d57/d88/da4 to d2/d2f/d33/d55/d104 0 2024-04-18T21:07:01.912 INFO:tasks.workunit.client.0.smithi096.stdout:3/661: dwrite d4/d6/d1b/d2c/d31/f9b [0,4194304] 0 2024-04-18T21:07:01.912 INFO:tasks.workunit.client.0.smithi096.stdout:9/883: creat d0/d8/d11/d39/f11b x:0 0 0 2024-04-18T21:07:01.912 INFO:tasks.workunit.client.0.smithi096.stdout:0/746: creat d1/db/d30/d4a/ffa x:0 0 0 2024-04-18T21:07:01.913 INFO:tasks.workunit.client.0.smithi096.stdout:3/662: symlink d4/d8/d49/lc0 0 2024-04-18T21:07:01.913 INFO:tasks.workunit.client.0.smithi096.stdout:0/747: fsync d1/db/d30/d31/f7f 0 2024-04-18T21:07:01.914 INFO:tasks.workunit.client.0.smithi096.stdout:9/884: write d0/d8/d9/f104 [374403,79244] 0 2024-04-18T21:07:01.914 INFO:tasks.workunit.client.0.smithi096.stdout:4/795: getdents d2/d2a/d54/d5b/d89 0 2024-04-18T21:07:01.916 INFO:tasks.workunit.client.0.smithi096.stdout:4/796: creat d2/dbb/f105 x:0 0 0 2024-04-18T21:07:01.916 INFO:tasks.workunit.client.0.smithi096.stdout:9/885: chown d0/dc/d5f/f93 57 1 2024-04-18T21:07:01.917 INFO:tasks.workunit.client.0.smithi096.stdout:1/807: dwrite d0/df/de5/df8/d95/fbb [0,4194304] 0 2024-04-18T21:07:01.918 INFO:tasks.workunit.client.0.smithi096.stdout:0/748: rename d1/db/dda/de9/deb/db3 to d1/d23/d32/d43/dfb 0 2024-04-18T21:07:01.919 INFO:tasks.workunit.client.0.smithi096.stdout:4/797: mknod d2/d2a/d54/d71/d99/deb/c106 0 2024-04-18T21:07:01.919 INFO:tasks.workunit.client.0.smithi096.stdout:1/808: dread - d0/df/d16/d24/da8/fb7 zero size 2024-04-18T21:07:01.920 INFO:tasks.workunit.client.0.smithi096.stdout:2/925: dwrite f2 [0,4194304] 0 2024-04-18T21:07:01.920 INFO:tasks.workunit.client.0.smithi096.stdout:0/749: mkdir d1/db/d30/d31/d85/dfc 0 2024-04-18T21:07:01.920 INFO:tasks.workunit.client.0.smithi096.stdout:9/886: read d0/d28/d7a/ff6 [219673,1626] 0 2024-04-18T21:07:01.920 INFO:tasks.workunit.client.0.smithi096.stdout:6/787: dwrite d1/d5/da/d46/d71/d7c/f8f [0,4194304] 0 2024-04-18T21:07:01.921 INFO:tasks.workunit.client.0.smithi096.stdout:1/809: write d0/df/de5/df8/d9b/fb5 [640360,71614] 0 2024-04-18T21:07:01.923 INFO:tasks.workunit.client.0.smithi096.stdout:1/810: creat d0/df/d62/db1/f10c x:0 0 0 2024-04-18T21:07:01.924 INFO:tasks.workunit.client.0.smithi096.stdout:6/788: read d1/f30 [857471,114302] 0 2024-04-18T21:07:01.925 INFO:tasks.workunit.client.0.smithi096.stdout:6/789: readlink d1/d3a/le6 0 2024-04-18T21:07:01.925 INFO:tasks.workunit.client.0.smithi096.stdout:1/811: creat d0/df/d16/d24/dac/dd2/f10d x:0 0 0 2024-04-18T21:07:01.927 INFO:tasks.workunit.client.0.smithi096.stdout:1/812: creat d0/dd0/df6/f10e x:0 0 0 2024-04-18T21:07:01.928 INFO:tasks.workunit.client.0.smithi096.stdout:0/750: dwrite d1/db/d30/f6c [0,4194304] 0 2024-04-18T21:07:01.928 INFO:tasks.workunit.client.0.smithi096.stdout:6/790: symlink d1/d5/da/d46/d71/l103 0 2024-04-18T21:07:01.928 INFO:tasks.workunit.client.0.smithi096.stdout:4/798: dwrite d2/d1d/fb5 [0,4194304] 0 2024-04-18T21:07:01.929 INFO:tasks.workunit.client.0.smithi096.stdout:2/926: dwrite d11/d13/f7b [0,4194304] 0 2024-04-18T21:07:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:1/813: getdents d0/dd0 0 2024-04-18T21:07:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/799: chown d2/d2f/d33/d55/d59/d5f/dcd 126069 1 2024-04-18T21:07:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:7/726: sync 2024-04-18T21:07:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:5/767: sync 2024-04-18T21:07:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:8/813: sync 2024-04-18T21:07:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:1/814: fdatasync d0/df/d30/f94 0 2024-04-18T21:07:01.932 INFO:tasks.workunit.client.0.smithi096.stdout:8/814: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/ff9 zero size 2024-04-18T21:07:01.932 INFO:tasks.workunit.client.0.smithi096.stdout:6/791: getdents d1/d5/da/d44/d97/da0 0 2024-04-18T21:07:01.933 INFO:tasks.workunit.client.0.smithi096.stdout:4/800: rmdir d2/d2f/d33/d55/d57/d88 39 2024-04-18T21:07:01.933 INFO:tasks.workunit.client.0.smithi096.stdout:1/815: stat d0/df/d16/f37 0 2024-04-18T21:07:01.934 INFO:tasks.workunit.client.0.smithi096.stdout:7/727: creat d0/d20/fe4 x:0 0 0 2024-04-18T21:07:01.935 INFO:tasks.workunit.client.0.smithi096.stdout:5/768: link d2/d11/d28/d64/d7e/cda d2/d11/d28/d64/dba/c117 0 2024-04-18T21:07:01.935 INFO:tasks.workunit.client.0.smithi096.stdout:1/816: stat d0/df/d16/d24/dac/c80 0 2024-04-18T21:07:01.935 INFO:tasks.workunit.client.0.smithi096.stdout:6/792: creat d1/d3a/d57/de3/f104 x:0 0 0 2024-04-18T21:07:01.936 INFO:tasks.workunit.client.0.smithi096.stdout:8/815: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/dfe/d114 0 2024-04-18T21:07:01.937 INFO:tasks.workunit.client.0.smithi096.stdout:1/817: write d0/df/ddc/ff7 [75354,36607] 0 2024-04-18T21:07:01.938 INFO:tasks.workunit.client.0.smithi096.stdout:4/801: rename d2/d2a/d54/d5b/d89/cda to d2/dbb/c107 0 2024-04-18T21:07:01.938 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:01.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:01.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:14354 4.8 4:10901305:::10000003178.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-18T21:07:01.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:01.931353+0000", 2024-04-18T21:07:01.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0085812939999999997, 2024-04-18T21:07:01.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086037960000000004, 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 14354 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.931353+0000", 2024-04-18T21:07:01.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.931353+0000", 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.931354+0000", 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.322e-06 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939216+0000", 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078618799999999999 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939224+0000", 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6750000000000008e-06 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939229+0000", 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5530000000000003e-06 2024-04-18T21:07:01.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939295+0000", 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5751000000000001e-05 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939401+0000", 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106012 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939605+0000", 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000203807 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:14351 4.31 4:8dfc94b7:::10000003310.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:01.915859+0000", 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.024074407999999999, 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.024158293000000001, 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:01.943 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 14351 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.915859+0000", 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.915859+0000", 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.915860+0000", 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4000000000000002e-07 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923187+0000", 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073271710000000004 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923200+0000", 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2455e-05 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923208+0000", 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9619999999999993e-06 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:01.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923301+0000", 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3055999999999998e-05 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923371+0000", 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0011000000000004e-05 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923479+0000", 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108458 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.934549+0000", 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011070214 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:14352 4.27 4:e75b72a1:::100000032e8.00000000:head [write 0~3670016 in=3670016b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:01.923231+0000", 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.016703160000000002, 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016848233000000001, 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:01.948 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 14352 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923231+0000", 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923231+0000", 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.923232+0000", 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.012e-06 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929692+0000", 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0064605180000000002 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929705+0000", 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3089e-05 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929711+0000", 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7880000000000003e-06 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929808+0000", 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6984000000000005e-05 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929920+0000", 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111439 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.930048+0000", 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012834599999999999 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.934791+0000", 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047426179999999997 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:14353 4.27 4:e75b72a1:::100000032e8.00000000:head [write 3670016~524288 in=524288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:01.929727+0000", 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010206786000000001, 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010409448, 2024-04-18T21:07:01.953 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 14353 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929727+0000", 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929727+0000", 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.929728+0000", 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7599999999999996e-07 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.931298+0000", 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001569672 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.931313+0000", 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5656999999999999e-05 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.931327+0000", 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3558e-05 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.933498+0000", 2024-04-18T21:07:01.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021717080000000001 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.933578+0000", 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9921999999999998e-05 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.933675+0000", 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6995000000000002e-05 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.935166+0000", 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014908670000000001 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:2276 3.8 3:17051619:::200.0000000f:head [write 3592010~12684 [fadvise_dontneed] in=12684b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:01.939124+0000", 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00081018699999999997, 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001060896, 2024-04-18T21:07:01.958 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939124+0000", 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939124+0000", 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:01.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939125+0000", 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.601e-06 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939146+0000", 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0775e-05 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939160+0000", 2024-04-18T21:07:01.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4351e-05 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939169+0000", 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2730000000000002e-06 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939220+0000", 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1413999999999999e-05 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939267+0000", 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6842999999999999e-05 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:01.939351+0000", 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3629999999999997e-05 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 5 2024-04-18T21:07:01.962 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:01.964 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:7/728: creat d0/d20/d39/d8a/db4/fe5 x:0 0 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:0/751: dwrite d1/d23/d32/d43/d6f/f8b [0,4194304] 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:2/927: dwrite d11/d13/d1a/d1e/d28/d4e/d63/d10a/fef [0,4194304] 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:5/769: rename d2/d11/l2f to d2/d18/d9d/da0/dcb/l118 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:4/802: mknod d2/d2f/d39/def/c108 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:5/770: mkdir d2/d38/d119 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:9/887: dwrite d0/dc/f26 [0,4194304] 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:8/816: rename d0/d3/db to d0/d3/d1d/d102/d115 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:4/803: mkdir d2/d2f/d33/d55/d59/d5f/dcd/d109 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi096.stdout:5/771: write d2/d11/d28/d4a/d69/fad [140509,35018] 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:5/772: rmdir d2/d11/d28/d64/d7e 39 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:4/804: mkdir d2/d2f/d33/d55/d10a 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:4/805: truncate d2/d1d/f7e 4034159 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:5/773: mknod d2/d18/d9d/de8/c11a 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:7/729: dwrite d0/d7/d8/f1a [0,4194304] 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:4/806: write d2/d2a/d54/d5b/d89/fd3 [1358551,38461] 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:5/774: getdents d2/d6a/df0 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:4/807: mkdir d2/dbb/dde/d10b 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:9/888: dwrite d0/d28/d2f/de6/f52 [0,4194304] 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:5/775: creat d2/d18/d61/d6f/f11b x:0 0 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:5/776: write f0 [108966,98087] 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:4/808: mkdir d2/d2a/d54/d71/d99/d10c 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi096.stdout:9/889: symlink d0/d28/l11c 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:5/777: fdatasync d2/d11/d28/d4a/fea 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:8/817: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d 19424921 1 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:9/890: unlink d0/d8/d11/d48/ffa 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:5/778: creat d2/d6a/df0/f11c x:0 0 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:8/818: mkdir d0/d64/d43/d116 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:5/779: truncate d2/d11/d28/d64/ff3 192538 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:5/780: write d2/d18/d9d/da0/dab/fc9 [675038,73573] 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:8/819: truncate d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/fe5 824285 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:8/820: chown d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/lb6 6807 1 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:4/809: dwrite d2/d2a/d54/d5b/fea [0,4194304] 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:8/821: unlink d0/d3/d1d/d102/d115/f2d 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:2/928: read d11/f39 [3069448,74274] 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:2/929: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/d94/f113 [59064,71786] 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi096.stdout:2/930: symlink d11/d50/d5b/l130 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi096.stdout:8/822: dwrite d0/d64/f6d [0,4194304] 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi096.stdout:4/810: dwrite d2/d2f/d33/d55/d59/d5f/dcd/fcf [0,4194304] 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi096.stdout:4/811: unlink d2/d2a/d54/d5b/fc5 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi096.stdout:4/812: mknod d2/d2a/d54/d5b/d89/d90/c10d 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi096.stdout:4/813: write d2/d2f/d33/d55/d59/db9/fc2 [308083,25055] 0 2024-04-18T21:07:01.972 INFO:tasks.workunit.client.0.smithi096.stdout:8/823: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d1b/db3/fd6 [0,4194304] 0 2024-04-18T21:07:01.972 INFO:tasks.workunit.client.0.smithi096.stdout:2/931: dwrite d11/d13/d1a/d1e/de7/f12e [0,4194304] 0 2024-04-18T21:07:01.972 INFO:tasks.workunit.client.0.smithi096.stdout:8/824: creat d0/d64/d43/d116/f117 x:0 0 0 2024-04-18T21:07:01.972 INFO:tasks.workunit.client.0.smithi096.stdout:2/932: getdents d11/d13/d1a/d1e/d28/d4e/d40/d51 0 2024-04-18T21:07:01.973 INFO:tasks.workunit.client.0.smithi096.stdout:4/814: dwrite d2/f5 [0,4194304] 0 2024-04-18T21:07:01.973 INFO:tasks.workunit.client.0.smithi096.stdout:2/933: stat d11/d13/d1a/l3c 0 2024-04-18T21:07:01.974 INFO:tasks.workunit.client.0.smithi096.stdout:2/934: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/c131 0 2024-04-18T21:07:01.975 INFO:tasks.workunit.client.0.smithi096.stdout:2/935: rmdir d11/d13/d1a/d1e/d28/d4e/d63/d10a 39 2024-04-18T21:07:01.978 INFO:tasks.workunit.client.0.smithi096.stdout:8/825: dwrite d0/d3/d1d/d83/dcd/d7f/dac/f8f [0,4194304] 0 2024-04-18T21:07:01.979 INFO:tasks.workunit.client.0.smithi096.stdout:8/826: chown d0/d3/d1d/d83/dcd/d7f/dac/d1b/lb5 14809239 1 2024-04-18T21:07:01.987 INFO:tasks.workunit.client.0.smithi096.stdout:8/827: truncate d0/d3/d1d/d83/dcd/dd1/f107 1425308 0 2024-04-18T21:07:01.988 INFO:tasks.workunit.client.0.smithi096.stdout:8/828: write d0/d64/f6d [296922,55469] 0 2024-04-18T21:07:01.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:01.986+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:02.012 INFO:tasks.workunit.client.0.smithi096.stdout:9/891: read d0/d28/da1/f6e [633035,109333] 0 2024-04-18T21:07:02.012 INFO:tasks.workunit.client.0.smithi096.stdout:9/892: chown d0/dc/d5f/d76 17 1 2024-04-18T21:07:02.013 INFO:tasks.workunit.client.0.smithi096.stdout:9/893: fdatasync d0/d28/d3d/ffd 0 2024-04-18T21:07:02.017 INFO:tasks.workunit.client.0.smithi096.stdout:9/894: dread d0/d28/d7a/faa [0,4194304] 0 2024-04-18T21:07:02.018 INFO:tasks.workunit.client.0.smithi096.stdout:4/815: dread d2/d2a/fe2 [0,4194304] 0 2024-04-18T21:07:02.025 INFO:tasks.workunit.client.0.smithi096.stdout:3/663: dread d4/d6/d1b/d2c/f53 [0,4194304] 0 2024-04-18T21:07:02.026 INFO:tasks.workunit.client.0.smithi096.stdout:3/664: truncate d4/d6/d22/d20/f3f 4732845 0 2024-04-18T21:07:02.027 INFO:tasks.workunit.client.0.smithi096.stdout:6/793: dread d1/d5/da/d46/d71/f7f [0,4194304] 0 2024-04-18T21:07:02.027 INFO:tasks.workunit.client.0.smithi096.stdout:3/665: creat d4/d6/d7/db8/fc1 x:0 0 0 2024-04-18T21:07:02.028 INFO:tasks.workunit.client.0.smithi096.stdout:6/794: write d1/d61/d91/dd1/ff5 [281705,1524] 0 2024-04-18T21:07:02.029 INFO:tasks.workunit.client.0.smithi096.stdout:6/795: mkdir d1/d5/da/d46/d105 0 2024-04-18T21:07:02.030 INFO:tasks.workunit.client.0.smithi096.stdout:4/816: dread d2/d2f/d33/d55/d59/d5f/fce [0,4194304] 0 2024-04-18T21:07:02.031 INFO:tasks.workunit.client.0.smithi096.stdout:4/817: stat d2/d2a/d54/d6d 0 2024-04-18T21:07:02.032 INFO:tasks.workunit.client.0.smithi096.stdout:4/818: unlink d2/d2f/d33/d55/d59/d5f/fb6 0 2024-04-18T21:07:02.034 INFO:tasks.workunit.client.0.smithi096.stdout:3/666: dwrite d4/d6/d22/d20/f44 [0,4194304] 0 2024-04-18T21:07:02.037 INFO:tasks.workunit.client.0.smithi096.stdout:3/667: mknod d4/d8/d49/dad/cc2 0 2024-04-18T21:07:02.038 INFO:tasks.workunit.client.0.smithi096.stdout:3/668: dread - d4/d6/d1b/d2c/d31/d4e/fb6 zero size 2024-04-18T21:07:02.039 INFO:tasks.workunit.client.0.smithi096.stdout:4/819: dwrite d2/d2f/d39/fb3 [0,4194304] 0 2024-04-18T21:07:02.039 INFO:tasks.workunit.client.0.smithi096.stdout:4/820: fsync d2/f31 0 2024-04-18T21:07:02.041 INFO:tasks.workunit.client.0.smithi096.stdout:4/821: creat d2/d2f/d33/d55/d59/d5f/dcd/f10e x:0 0 0 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi096.stdout:0/752: dread d1/db/d30/d31/d85/fa [0,4194304] 0 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi096.stdout:1/818: sync 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi096.stdout:5/781: sync 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi096.stdout:8/829: sync 2024-04-18T21:07:02.046 INFO:tasks.workunit.client.0.smithi096.stdout:3/669: dwrite d4/d8/f48 [4194304,4194304] 0 2024-04-18T21:07:02.046 INFO:tasks.workunit.client.0.smithi096.stdout:7/730: dread d0/d7/f5f [4194304,4194304] 0 2024-04-18T21:07:02.046 INFO:tasks.workunit.client.0.smithi096.stdout:5/782: readlink d2/d11/d28/d4a/l113 0 2024-04-18T21:07:02.047 INFO:tasks.workunit.client.0.smithi096.stdout:7/731: chown d0/d11/d18/faf 201460504 1 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi096.stdout:4/822: write d2/d2f/d39/d43/fc1 [4172733,30567] 0 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi096.stdout:0/753: getdents d1/db/dda/de9/deb/d5d/d60 0 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi096.stdout:8/830: fsync d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 0 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi096.stdout:7/732: symlink d0/d20/d4b/d7f/d9b/le6 0 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi096.stdout:5/783: mkdir d2/d18/d11d 0 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi096.stdout:4/823: rmdir d2 39 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi096.stdout:3/670: rename d4/d6/d22/d20/c72 to d4/d6/d1b/d1d/cc3 0 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi096.stdout:0/754: chown d1/d23/d32/d43/f4f 79744 1 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi096.stdout:7/733: mknod d0/d7/d2f/ce7 0 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi096.stdout:5/784: truncate d2/d11/ff8 891595 0 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi096.stdout:8/831: chown d0/d3/d3a/dab/d46/dc5/ffd 3 1 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi096.stdout:5/785: stat d2/f10 0 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi096.stdout:4/824: link d2/f31 d2/d2f/d33/d55/de0/f10f 0 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi096.stdout:3/671: creat d4/d6/d1b/d2c/d31/d85/fc4 x:0 0 0 2024-04-18T21:07:02.052 INFO:tasks.workunit.client.0.smithi096.stdout:5/786: chown d2/d9b/ccc 11253654 1 2024-04-18T21:07:02.052 INFO:tasks.workunit.client.0.smithi096.stdout:3/672: stat d4/d6/d22/l6e 0 2024-04-18T21:07:02.053 INFO:tasks.workunit.client.0.smithi096.stdout:5/787: dread - d2/d18/d61/d6f/d7a/f10c zero size 2024-04-18T21:07:02.053 INFO:tasks.workunit.client.0.smithi096.stdout:1/819: dread d0/dd0/df6/f103 [0,4194304] 0 2024-04-18T21:07:02.053 INFO:tasks.workunit.client.0.smithi096.stdout:2/936: dread d11/d50/f83 [4194304,4194304] 0 2024-04-18T21:07:02.054 INFO:tasks.workunit.client.0.smithi096.stdout:1/820: mknod d0/df/d16/d6c/c10f 0 2024-04-18T21:07:02.054 INFO:tasks.workunit.client.0.smithi096.stdout:5/788: getdents d2/d18/d61/d6f/d88 0 2024-04-18T21:07:02.055 INFO:tasks.workunit.client.0.smithi096.stdout:1/821: write d0/dd0/df6/f103 [862630,62476] 0 2024-04-18T21:07:02.055 INFO:tasks.workunit.client.0.smithi096.stdout:2/937: rmdir d11/d13/d1a/d1e/d28/d4e/d5c/d121/d123 0 2024-04-18T21:07:02.055 INFO:tasks.workunit.client.0.smithi096.stdout:5/789: chown d2/d18/d61/d6d/f102 5 1 2024-04-18T21:07:02.056 INFO:tasks.workunit.client.0.smithi096.stdout:5/790: creat d2/d18/d9d/da0/f11e x:0 0 0 2024-04-18T21:07:02.056 INFO:tasks.workunit.client.0.smithi096.stdout:1/822: mkdir d0/df/d62/d110 0 2024-04-18T21:07:02.057 INFO:tasks.workunit.client.0.smithi096.stdout:5/791: chown d2/f16 332196 1 2024-04-18T21:07:02.057 INFO:tasks.workunit.client.0.smithi096.stdout:1/823: rmdir d0/df/d30/d53/da2 39 2024-04-18T21:07:02.058 INFO:tasks.workunit.client.0.smithi096.stdout:7/734: dwrite d0/d20/d4b/fc0 [0,4194304] 0 2024-04-18T21:07:02.059 INFO:tasks.workunit.client.0.smithi096.stdout:7/735: stat d0/d20/d6c/fdb 0 2024-04-18T21:07:02.059 INFO:tasks.workunit.client.0.smithi096.stdout:7/736: dread - d0/d20/d39/d8a/db4/fe5 zero size 2024-04-18T21:07:02.060 INFO:tasks.workunit.client.0.smithi096.stdout:1/824: stat d0/df/d16/d24/dac/dd2/ld5 0 2024-04-18T21:07:02.061 INFO:tasks.workunit.client.0.smithi096.stdout:2/938: write d11/d13/d1a/d1e/d28/d4e/f53 [944838,99767] 0 2024-04-18T21:07:02.061 INFO:tasks.workunit.client.0.smithi096.stdout:1/825: write d0/df/d16/d24/dc0/d5f/f51 [5048097,29334] 0 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi096.stdout:6/796: dread d1/d5/da/fc [0,4194304] 0 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi096.stdout:1/826: chown d0/l75 3 1 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi096.stdout:2/939: creat d11/d50/d5b/dcb/deb/f132 x:0 0 0 2024-04-18T21:07:02.063 INFO:tasks.workunit.client.0.smithi096.stdout:6/797: dread - d1/d3a/d57/d26/ffc zero size 2024-04-18T21:07:02.064 INFO:tasks.workunit.client.0.smithi096.stdout:6/798: unlink d1/d3a/d57/de3/laa 0 2024-04-18T21:07:02.064 INFO:tasks.workunit.client.0.smithi096.stdout:2/940: creat d11/d13/d1a/d1e/d28/d4e/d89/f133 x:0 0 0 2024-04-18T21:07:02.065 INFO:tasks.workunit.client.0.smithi096.stdout:6/799: write d1/d3a/d36/d7a/fb2 [588440,80021] 0 2024-04-18T21:07:02.066 INFO:tasks.workunit.client.0.smithi096.stdout:2/941: rename ff to d11/d13/d1a/d1e/d28/d4e/d12d/f134 0 2024-04-18T21:07:02.068 INFO:tasks.workunit.client.0.smithi096.stdout:7/737: dwrite d0/f89 [0,4194304] 0 2024-04-18T21:07:02.068 INFO:tasks.workunit.client.0.smithi096.stdout:2/942: creat d11/d13/d1a/d1e/d28/d4e/d40/dbe/f135 x:0 0 0 2024-04-18T21:07:02.069 INFO:tasks.workunit.client.0.smithi096.stdout:1/827: dwrite d0/df/d16/d24/dac/d65/fbf [0,4194304] 0 2024-04-18T21:07:02.069 INFO:tasks.workunit.client.0.smithi096.stdout:2/943: write d11/d13/d1a/d1e/d28/d4e/d40/d51/f120 [545053,2536] 0 2024-04-18T21:07:02.070 INFO:tasks.workunit.client.0.smithi096.stdout:2/944: fdatasync d11/d13/d1a/d1e/ff3 0 2024-04-18T21:07:02.072 INFO:tasks.workunit.client.0.smithi096.stdout:9/895: sync 2024-04-18T21:07:02.072 INFO:tasks.workunit.client.0.smithi096.stdout:7/738: sync 2024-04-18T21:07:02.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/945: creat d11/d13/d1a/d1e/d28/d4e/d63/d10a/dd2/f136 x:0 0 0 2024-04-18T21:07:02.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/739: symlink d0/d20/le8 0 2024-04-18T21:07:02.074 INFO:tasks.workunit.client.0.smithi096.stdout:7/740: chown d0/l5b 0 1 2024-04-18T21:07:02.074 INFO:tasks.workunit.client.0.smithi096.stdout:2/946: dread - d11/d13/d1a/d1e/d28/d4e/d5c/f11b zero size 2024-04-18T21:07:02.074 INFO:tasks.workunit.client.0.smithi096.stdout:9/896: truncate d0/dc/d5f/d76/dc1/fcf 251963 0 2024-04-18T21:07:02.075 INFO:tasks.workunit.client.0.smithi096.stdout:2/947: mkdir d11/d137 0 2024-04-18T21:07:02.076 INFO:tasks.workunit.client.0.smithi096.stdout:7/741: link d0/d7/d8/f9c d0/d20/d39/dda/fe9 0 2024-04-18T21:07:02.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/897: truncate d0/d28/d2f/de6/ddb/f115 758283 0 2024-04-18T21:07:02.077 INFO:tasks.workunit.client.0.smithi096.stdout:7/742: write d0/d20/d62/dca/dd6/fdc [180680,101725] 0 2024-04-18T21:07:02.077 INFO:tasks.workunit.client.0.smithi096.stdout:1/828: dwrite d0/df/d16/d6c/d106/fa5 [4194304,4194304] 0 2024-04-18T21:07:02.078 INFO:tasks.workunit.client.0.smithi096.stdout:9/898: chown d0/d8/d11/f90 2 1 2024-04-18T21:07:02.078 INFO:tasks.workunit.client.0.smithi096.stdout:1/829: dread - d0/df/fbe zero size 2024-04-18T21:07:02.082 INFO:tasks.workunit.client.0.smithi096.stdout:7/743: mknod d0/d7/d2f/d63/dd3/cea 0 2024-04-18T21:07:02.083 INFO:tasks.workunit.client.0.smithi096.stdout:1/830: symlink d0/df/d62/l111 0 2024-04-18T21:07:02.084 INFO:tasks.workunit.client.0.smithi096.stdout:9/899: dwrite d0/f4 [4194304,4194304] 0 2024-04-18T21:07:02.085 INFO:tasks.workunit.client.0.smithi096.stdout:9/900: chown d0/d8/d11/d39/fca 1829198907 1 2024-04-18T21:07:02.087 INFO:tasks.workunit.client.0.smithi096.stdout:7/744: dread d0/d7/f5f [4194304,4194304] 0 2024-04-18T21:07:02.088 INFO:tasks.workunit.client.0.smithi096.stdout:7/745: dread - d0/d7/d2f/d53/f84 zero size 2024-04-18T21:07:02.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:02.086+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:02.089 INFO:tasks.workunit.client.0.smithi096.stdout:7/746: dread - d0/d20/d39/d8a/db4/fbc zero size 2024-04-18T21:07:02.091 INFO:tasks.workunit.client.0.smithi096.stdout:3/673: dread d4/d6/f92 [0,4194304] 0 2024-04-18T21:07:02.091 INFO:tasks.workunit.client.0.smithi096.stdout:1/831: dwrite d0/df/d16/d24/dac/d6a/fdf [8388608,4194304] 0 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi096.stdout:9/901: dwrite d0/d28/d7a/dc3/d43/fa2 [0,4194304] 0 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi096.stdout:7/747: rename d0/d20/le8 to d0/d20/d62/leb 0 2024-04-18T21:07:02.095 INFO:tasks.workunit.client.0.smithi096.stdout:9/902: symlink d0/d28/d3d/l11d 0 2024-04-18T21:07:02.095 INFO:tasks.workunit.client.0.smithi096.stdout:7/748: creat d0/d7/d2f/d63/dd3/dd8/fec x:0 0 0 2024-04-18T21:07:02.095 INFO:tasks.workunit.client.0.smithi096.stdout:1/832: rename d0/df/de5/ce7 to d0/df/d16/d24/dc0/c112 0 2024-04-18T21:07:02.095 INFO:tasks.workunit.client.0.smithi096.stdout:7/749: chown d0/c54 947606 1 2024-04-18T21:07:02.095 INFO:tasks.workunit.client.0.smithi096.stdout:9/903: mknod d0/dc/d5f/d76/dc1/c11e 0 2024-04-18T21:07:02.095 INFO:tasks.workunit.client.0.smithi096.stdout:1/833: chown d0/df/d16/d24/dac/d65 2737040 1 2024-04-18T21:07:02.096 INFO:tasks.workunit.client.0.smithi096.stdout:9/904: mknod d0/d28/d7a/dc3/dc6/da3/c11f 0 2024-04-18T21:07:02.097 INFO:tasks.workunit.client.0.smithi096.stdout:3/674: truncate d4/d8/f48 3871219 0 2024-04-18T21:07:02.097 INFO:tasks.workunit.client.0.smithi096.stdout:1/834: creat d0/df/d16/d6c/d9d/f113 x:0 0 0 2024-04-18T21:07:02.097 INFO:tasks.workunit.client.0.smithi096.stdout:3/675: fdatasync d4/d6/f92 0 2024-04-18T21:07:02.097 INFO:tasks.workunit.client.0.smithi096.stdout:1/835: write d0/df/d16/d24/dc0/f3c [13235,50288] 0 2024-04-18T21:07:02.099 INFO:tasks.workunit.client.0.smithi096.stdout:3/676: truncate d4/d6/d1b/d2c/f5a 1908022 0 2024-04-18T21:07:02.100 INFO:tasks.workunit.client.0.smithi096.stdout:1/836: rename d0/df/d16/d6c/f9a to d0/df/d62/f114 0 2024-04-18T21:07:02.101 INFO:tasks.workunit.client.0.smithi096.stdout:1/837: chown d0/df/d62 0 1 2024-04-18T21:07:02.101 INFO:tasks.workunit.client.0.smithi096.stdout:8/832: dread d0/d3/d1d/d83/dcd/d7f/dac/d33/f92 [0,4194304] 0 2024-04-18T21:07:02.101 INFO:tasks.workunit.client.0.smithi096.stdout:7/750: dwrite d0/d20/d39/f4c [4194304,4194304] 0 2024-04-18T21:07:02.102 INFO:tasks.workunit.client.0.smithi096.stdout:5/792: dread d2/fd [0,4194304] 0 2024-04-18T21:07:02.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/677: symlink d4/d6/d1b/d2c/d31/d11/lc5 0 2024-04-18T21:07:02.103 INFO:tasks.workunit.client.0.smithi096.stdout:1/838: mknod d0/dd0/ddb/c115 0 2024-04-18T21:07:02.103 INFO:tasks.workunit.client.0.smithi096.stdout:7/751: dread - d0/d7/d2f/d63/fa8 zero size 2024-04-18T21:07:02.104 INFO:tasks.workunit.client.0.smithi096.stdout:3/678: write d4/d6/d22/d20/f3f [5701547,31223] 0 2024-04-18T21:07:02.104 INFO:tasks.workunit.client.0.smithi096.stdout:7/752: write d0/fdf [102094,87539] 0 2024-04-18T21:07:02.105 INFO:tasks.workunit.client.0.smithi096.stdout:3/679: write d4/d6/f92 [1868688,77466] 0 2024-04-18T21:07:02.107 INFO:tasks.workunit.client.0.smithi096.stdout:9/905: dwrite d0/dc/d5f/d76/fe9 [0,4194304] 0 2024-04-18T21:07:02.109 INFO:tasks.workunit.client.0.smithi096.stdout:0/755: sync 2024-04-18T21:07:02.109 INFO:tasks.workunit.client.0.smithi096.stdout:2/948: sync 2024-04-18T21:07:02.109 INFO:tasks.workunit.client.0.smithi096.stdout:8/833: sync 2024-04-18T21:07:02.109 INFO:tasks.workunit.client.0.smithi096.stdout:6/800: dread d1/d3a/d57/de3/f8c [0,4194304] 0 2024-04-18T21:07:02.110 INFO:tasks.workunit.client.0.smithi096.stdout:7/753: rename d0/d20/d62/l6d to d0/d7/d2f/led 0 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi096.stdout:0/756: creat d1/de8/ffd x:0 0 0 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi096.stdout:4/825: dread d2/d2a/f7b [0,4194304] 0 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi096.stdout:5/793: dwrite d2/f3a [0,4194304] 0 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi096.stdout:4/826: sync 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi096.stdout:3/680: getdents d4 0 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi096.stdout:2/949: symlink d11/d13/l138 0 2024-04-18T21:07:02.112 INFO:tasks.workunit.client.0.smithi096.stdout:1/839: dwrite d0/df/ddc/ff7 [0,4194304] 0 2024-04-18T21:07:02.112 INFO:tasks.workunit.client.0.smithi096.stdout:6/801: fsync d1/d3a/d57/d66/d9b/d9f/fb0 0 2024-04-18T21:07:02.112 INFO:tasks.workunit.client.0.smithi096.stdout:9/906: creat d0/d8/d11/f120 x:0 0 0 2024-04-18T21:07:02.113 INFO:tasks.workunit.client.0.smithi096.stdout:4/827: creat d2/dbb/db0/f110 x:0 0 0 2024-04-18T21:07:02.113 INFO:tasks.workunit.client.0.smithi096.stdout:3/681: mknod d4/d6/d1b/d63/cc6 0 2024-04-18T21:07:02.113 INFO:tasks.workunit.client.0.smithi096.stdout:0/757: creat d1/ffe x:0 0 0 2024-04-18T21:07:02.114 INFO:tasks.workunit.client.0.smithi096.stdout:1/840: write d0/dd0/ffb [765326,3193] 0 2024-04-18T21:07:02.114 INFO:tasks.workunit.client.0.smithi096.stdout:7/754: write d0/d20/d39/d8a/db4/fbc [377999,37502] 0 2024-04-18T21:07:02.114 INFO:tasks.workunit.client.0.smithi096.stdout:2/950: creat d11/d13/d1a/d1e/de7/f139 x:0 0 0 2024-04-18T21:07:02.114 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:02.115 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:02.115 INFO:tasks.workunit.client.0.smithi096.stdout:8/834: truncate d0/d3/d3a/dab/d46/d78/f80 1769648 0 2024-04-18T21:07:02.115 INFO:tasks.workunit.client.0.smithi096.stdout:3/682: mknod d4/d8/d7f/cc7 0 2024-04-18T21:07:02.115 INFO:tasks.workunit.client.0.smithi096.stdout:7/755: fdatasync d0/d7/d8/f1e 0 2024-04-18T21:07:02.116 INFO:tasks.workunit.client.0.smithi096.stdout:8/835: truncate d0/f94 1518619 0 2024-04-18T21:07:02.117 INFO:tasks.workunit.client.0.smithi096.stdout:7/756: truncate d0/d20/d39/dda/fe9 8780615 0 2024-04-18T21:07:02.117 INFO:tasks.workunit.client.0.smithi096.stdout:8/836: creat d0/d3/d3a/dab/f118 x:0 0 0 2024-04-18T21:07:02.118 INFO:tasks.workunit.client.0.smithi096.stdout:0/758: rename d1/fcd to d1/d23/d32/d43/fff 0 2024-04-18T21:07:02.119 INFO:tasks.workunit.client.0.smithi096.stdout:7/757: mkdir d0/d20/d62/d7d/dee 0 2024-04-18T21:07:02.120 INFO:tasks.workunit.client.0.smithi096.stdout:7/758: mknod d0/d11/d18/cef 0 2024-04-18T21:07:02.121 INFO:tasks.workunit.client.0.smithi096.stdout:5/794: dwrite d2/d18/d9d/da0/dab/fc9 [0,4194304] 0 2024-04-18T21:07:02.121 INFO:tasks.workunit.client.0.smithi096.stdout:8/837: read - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/f10f zero size 2024-04-18T21:07:02.123 INFO:tasks.workunit.client.0.smithi096.stdout:8/838: creat d0/d3/d1d/d83/dcd/dd1/dda/f119 x:0 0 0 2024-04-18T21:07:02.123 INFO:tasks.workunit.client.0.smithi096.stdout:3/683: dwrite d4/d8/f74 [4194304,4194304] 0 2024-04-18T21:07:02.125 INFO:tasks.workunit.client.0.smithi096.stdout:2/951: dwrite d11/d13/d1a/d1e/d28/d4e/f62 [0,4194304] 0 2024-04-18T21:07:02.125 INFO:tasks.workunit.client.0.smithi096.stdout:3/684: mknod d4/d6/d1b/d63/cc8 0 2024-04-18T21:07:02.126 INFO:tasks.workunit.client.0.smithi096.stdout:3/685: readlink d4/l2d 0 2024-04-18T21:07:02.127 INFO:tasks.workunit.client.0.smithi096.stdout:8/839: write d0/d3/d1d/d83/dcd/d7f/dac/d33/f92 [2038989,27467] 0 2024-04-18T21:07:02.129 INFO:tasks.workunit.client.0.smithi096.stdout:3/686: readlink d4/d6/d1b/d63/la5 0 2024-04-18T21:07:02.131 INFO:tasks.workunit.client.0.smithi096.stdout:0/759: dwrite d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/f93 [0,4194304] 0 2024-04-18T21:07:02.131 INFO:tasks.workunit.client.0.smithi096.stdout:2/952: creat d11/d13/d1a/d1e/d28/d4e/d63/f13a x:0 0 0 2024-04-18T21:07:02.132 INFO:tasks.workunit.client.0.smithi096.stdout:7/759: dwrite d0/d20/d4b/fc0 [4194304,4194304] 0 2024-04-18T21:07:02.132 INFO:tasks.workunit.client.0.smithi096.stdout:5/795: dwrite d2/d18/fd1 [0,4194304] 0 2024-04-18T21:07:02.133 INFO:tasks.workunit.client.0.smithi096.stdout:2/953: unlink d11/d50/d5b/dcb/cd1 0 2024-04-18T21:07:02.134 INFO:tasks.workunit.client.0.smithi096.stdout:3/687: truncate d4/d6/d1b/d2c/d31/d4e/fb6 525508 0 2024-04-18T21:07:02.134 INFO:tasks.workunit.client.0.smithi096.stdout:6/802: dwrite d1/d3a/d57/de3/f59 [0,4194304] 0 2024-04-18T21:07:02.134 INFO:tasks.workunit.client.0.smithi096.stdout:7/760: symlink d0/lf0 0 2024-04-18T21:07:02.134 INFO:tasks.workunit.client.0.smithi096.stdout:0/760: chown d1/d23/d32/d43/d6f/d8a/d91/dba/dee/ff9 162792443 1 2024-04-18T21:07:02.135 INFO:tasks.workunit.client.0.smithi096.stdout:3/688: chown d4/d6/d1b/d2c/d31/d4e 1770 1 2024-04-18T21:07:02.135 INFO:tasks.workunit.client.0.smithi096.stdout:5/796: symlink d2/d11/d28/d4a/d55/d81/dbe/l11f 0 2024-04-18T21:07:02.135 INFO:tasks.workunit.client.0.smithi096.stdout:2/954: creat d11/d50/d108/f13b x:0 0 0 2024-04-18T21:07:02.135 INFO:tasks.workunit.client.0.smithi096.stdout:5/797: sync 2024-04-18T21:07:02.136 INFO:tasks.workunit.client.0.smithi096.stdout:6/803: creat d1/d3a/d57/f106 x:0 0 0 2024-04-18T21:07:02.137 INFO:tasks.workunit.client.0.smithi096.stdout:2/955: fsync d11/d13/d1a/d1e/d28/f86 0 2024-04-18T21:07:02.138 INFO:tasks.workunit.client.0.smithi096.stdout:4/828: read d2/d2f/d33/f3b [3610268,90542] 0 2024-04-18T21:07:02.138 INFO:tasks.workunit.client.0.smithi096.stdout:8/840: dwrite d0/d3/f49 [0,4194304] 0 2024-04-18T21:07:02.139 INFO:tasks.workunit.client.0.smithi096.stdout:5/798: symlink d2/d8f/l120 0 2024-04-18T21:07:02.139 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:02.140 INFO:tasks.workunit.client.0.smithi096.stdout:7/761: getdents d0/d7/d2f 0 2024-04-18T21:07:02.140 INFO:tasks.workunit.client.0.smithi096.stdout:6/804: mkdir d1/d3a/d36/d107 0 2024-04-18T21:07:02.140 INFO:tasks.workunit.client.0.smithi096.stdout:7/762: sync 2024-04-18T21:07:02.140 INFO:tasks.workunit.client.0.smithi096.stdout:2/956: truncate d11/d13/d1a/d1e/d9f/fa8 979708 0 2024-04-18T21:07:02.140 INFO:tasks.workunit.client.0.smithi096.stdout:6/805: mknod d1/d17/c108 0 2024-04-18T21:07:02.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/799: write d2/d18/d61/d6d/f102 [124715,82148] 0 2024-04-18T21:07:02.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/800: chown d2/d18/d61/d6d 264102 1 2024-04-18T21:07:02.142 INFO:tasks.workunit.client.0.smithi096.stdout:7/763: link d0/d20/d4b/f91 d0/d20/d62/dca/dae/ff1 0 2024-04-18T21:07:02.143 INFO:tasks.workunit.client.0.smithi096.stdout:2/957: creat d11/f13c x:0 0 0 2024-04-18T21:07:02.143 INFO:tasks.workunit.client.0.smithi096.stdout:6/806: rename d1/d5/da/d55/f6c to d1/d3a/d57/d66/d80/dfb/d94/f109 0 2024-04-18T21:07:02.143 INFO:tasks.workunit.client.0.smithi096.stdout:3/689: dwrite d4/f73 [0,4194304] 0 2024-04-18T21:07:02.144 INFO:tasks.workunit.client.0.smithi096.stdout:5/801: write d2/d11/d28/d4a/d87/fcf [5879663,56867] 0 2024-04-18T21:07:02.144 INFO:tasks.workunit.client.0.smithi096.stdout:6/807: unlink d1/fd9 0 2024-04-18T21:07:02.144 INFO:tasks.workunit.client.0.smithi096.stdout:7/764: mkdir d0/d20/d39/d8a/df2 0 2024-04-18T21:07:02.144 INFO:tasks.workunit.client.0.smithi096.stdout:5/802: rename d2/d38/c3c to d2/d18/d9d/da0/c121 0 2024-04-18T21:07:02.145 INFO:tasks.workunit.client.0.smithi096.stdout:6/808: chown d1/d3a/d57/d26/f3c 7740793 1 2024-04-18T21:07:02.145 INFO:tasks.workunit.client.0.smithi096.stdout:2/958: getdents d11/d13/d1a/d1e/d28/d4e/d89/d8b 0 2024-04-18T21:07:02.145 INFO:tasks.workunit.client.0.smithi096.stdout:2/959: write f2 [4137272,32269] 0 2024-04-18T21:07:02.146 INFO:tasks.workunit.client.0.smithi096.stdout:7/765: rename d0/d20/d4b/d7f/fbe to d0/d20/d39/d8a/ff3 0 2024-04-18T21:07:02.146 INFO:tasks.workunit.client.0.smithi096.stdout:5/803: write d2/d18/d9d/da0/dcb/f10e [144199,9446] 0 2024-04-18T21:07:02.146 INFO:tasks.workunit.client.0.smithi096.stdout:6/809: rmdir d1/d3a/d57/d66/d80/dfb/dbb 39 2024-04-18T21:07:02.147 INFO:tasks.workunit.client.0.smithi096.stdout:7/766: truncate d0/d7/d49/f9f 116139 0 2024-04-18T21:07:02.147 INFO:tasks.workunit.client.0.smithi096.stdout:2/960: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/f87 [3184766,37335] 0 2024-04-18T21:07:02.148 INFO:tasks.workunit.client.0.smithi096.stdout:6/810: creat d1/d3a/d57/d66/d9b/f10a x:0 0 0 2024-04-18T21:07:02.149 INFO:tasks.workunit.client.0.smithi096.stdout:3/690: dwrite d4/d6/d1b/d2c/f43 [0,4194304] 0 2024-04-18T21:07:02.150 INFO:tasks.workunit.client.0.smithi096.stdout:6/811: rename d1/d3a/d36/d7a/d102/ccb to d1/d3a/d57/de3/c10b 0 2024-04-18T21:07:02.150 INFO:tasks.workunit.client.0.smithi096.stdout:6/812: chown d1/d61/d91 52430 1 2024-04-18T21:07:02.151 INFO:tasks.workunit.client.0.smithi096.stdout:3/691: rename d4/d6/f96 to d4/d8/d7f/fc9 0 2024-04-18T21:07:02.152 INFO:tasks.workunit.client.0.smithi096.stdout:6/813: truncate d1/d5/da/f2a 4655676 0 2024-04-18T21:07:02.152 INFO:tasks.workunit.client.0.smithi096.stdout:3/692: dread - d4/d6/d1b/d2c/d6b/d99/da6/f69 zero size 2024-04-18T21:07:02.152 INFO:tasks.workunit.client.0.smithi096.stdout:6/814: fsync d1/d5/da/f21 0 2024-04-18T21:07:02.153 INFO:tasks.workunit.client.0.smithi096.stdout:4/829: write d2/d2f/d33/d55/de0/f10f [1916070,56305] 0 2024-04-18T21:07:02.154 INFO:tasks.workunit.client.0.smithi096.stdout:3/693: creat d4/d6/d1b/d2c/d5c/fca x:0 0 0 2024-04-18T21:07:02.154 INFO:tasks.workunit.client.0.smithi096.stdout:2/961: dwrite d11/d13/d1a/d1e/d28/d4e/fb4 [0,4194304] 0 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi096.stdout:4/830: symlink d2/d2a/d54/d6d/l111 0 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi096.stdout:6/815: rename d1/d17/c72 to d1/d3a/d57/d26/c10c 0 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi096.stdout:4/831: mkdir d2/dbb/dde/d112 0 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi096.stdout:6/816: dread - d1/d3a/dec/fe2 zero size 2024-04-18T21:07:02.156 INFO:tasks.workunit.client.0.smithi096.stdout:8/841: truncate d0/d64/f42 3301716 0 2024-04-18T21:07:02.156 INFO:tasks.workunit.client.0.smithi096.stdout:4/832: sync 2024-04-18T21:07:02.156 INFO:tasks.workunit.client.0.smithi096.stdout:6/817: chown d1/d5/c50 20476 1 2024-04-18T21:07:02.156 INFO:tasks.workunit.client.0.smithi096.stdout:4/833: truncate d2/d1d/fae 567458 0 2024-04-18T21:07:02.157 INFO:tasks.workunit.client.0.smithi096.stdout:2/962: creat d11/d13/d1a/d1e/d28/d4e/d5c/d121/d125/d129/f13d x:0 0 0 2024-04-18T21:07:02.157 INFO:tasks.workunit.client.0.smithi096.stdout:8/842: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/f11a x:0 0 0 2024-04-18T21:07:02.157 INFO:tasks.workunit.client.0.smithi096.stdout:0/761: dread d1/d23/d32/d43/d6f/ff0 [0,4194304] 0 2024-04-18T21:07:02.158 INFO:tasks.workunit.client.0.smithi096.stdout:2/963: write d11/d50/d5b/dcb/deb/f132 [69976,125464] 0 2024-04-18T21:07:02.158 INFO:tasks.workunit.client.0.smithi096.stdout:4/834: truncate d2/d2f/d33/d55/d57/d88/ff5 112159 0 2024-04-18T21:07:02.158 INFO:tasks.workunit.client.0.smithi096.stdout:8/843: stat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc 0 2024-04-18T21:07:02.159 INFO:tasks.workunit.client.0.smithi096.stdout:8/844: write d0/d3/d1d/d83/dcd/d7f/dac/d1b/fe0 [240254,118410] 0 2024-04-18T21:07:02.159 INFO:tasks.workunit.client.0.smithi096.stdout:4/835: rename d2/d1d/f7e to d2/d2f/d33/d55/d104/f113 0 2024-04-18T21:07:02.160 INFO:tasks.workunit.client.0.smithi096.stdout:0/762: rmdir d1/db/dd4 0 2024-04-18T21:07:02.161 INFO:tasks.workunit.client.0.smithi096.stdout:8/845: fdatasync d0/d3/d3a/f75 0 2024-04-18T21:07:02.161 INFO:tasks.workunit.client.0.smithi096.stdout:8/846: sync 2024-04-18T21:07:02.161 INFO:tasks.workunit.client.0.smithi096.stdout:2/964: getdents d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f 0 2024-04-18T21:07:02.161 INFO:tasks.workunit.client.0.smithi096.stdout:4/836: chown d2/d2f/d33/d55/da3/faa 968 1 2024-04-18T21:07:02.161 INFO:tasks.workunit.client.0.smithi096.stdout:0/763: symlink d1/db/dda/de9/deb/d5d/l100 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi096.stdout:0/764: chown d1/da3 6932531 1 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi096.stdout:4/837: mknod d2/d2f/d33/d55/d59/d5f/dcd/c114 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi096.stdout:2/965: symlink d11/d13/d1a/d1e/d28/d4e/d40/l13e 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi096.stdout:8/847: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/f11a zero size 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi096.stdout:8/848: symlink d0/d3/l11b 0 2024-04-18T21:07:02.163 INFO:tasks.workunit.client.0.smithi096.stdout:2/966: write d11/f16 [3897560,10509] 0 2024-04-18T21:07:02.164 INFO:tasks.workunit.client.0.smithi096.stdout:8/849: fsync d0/d3/d1d/d83/dcd/d7f/dac/d1b/db3/fd6 0 2024-04-18T21:07:02.164 INFO:tasks.workunit.client.0.smithi096.stdout:0/765: link d1/d23/d32/d43/d6f/fab d1/db/dda/de9/deb/f101 0 2024-04-18T21:07:02.165 INFO:tasks.workunit.client.0.smithi096.stdout:8/850: mknod d0/d64/d43/d116/c11c 0 2024-04-18T21:07:02.168 INFO:tasks.workunit.client.0.smithi096.stdout:4/838: dwrite d2/d2f/d33/d55/d57/f5c [4194304,4194304] 0 2024-04-18T21:07:02.169 INFO:tasks.workunit.client.0.smithi096.stdout:8/851: truncate d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 1610552 0 2024-04-18T21:07:02.169 INFO:tasks.workunit.client.0.smithi096.stdout:4/839: truncate d2/d2f/d33/d55/f9f 221368 0 2024-04-18T21:07:02.169 INFO:tasks.workunit.client.0.smithi096.stdout:8/852: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/f50 1007166 1 2024-04-18T21:07:02.172 INFO:tasks.workunit.client.0.smithi096.stdout:9/907: dread d0/d28/d3d/faf [0,4194304] 0 2024-04-18T21:07:02.174 INFO:tasks.workunit.client.0.smithi096.stdout:9/908: symlink d0/d28/d7a/dc3/dc6/da3/l121 0 2024-04-18T21:07:02.174 INFO:tasks.workunit.client.0.smithi096.stdout:0/766: read d1/f2d [4190858,6594] 0 2024-04-18T21:07:02.174 INFO:tasks.workunit.client.0.smithi096.stdout:0/767: mknod d1/d23/d32/d43/c102 0 2024-04-18T21:07:02.175 INFO:tasks.workunit.client.0.smithi096.stdout:4/840: dwrite d2/d2a/f7b [0,4194304] 0 2024-04-18T21:07:02.175 INFO:tasks.workunit.client.0.smithi096.stdout:0/768: write d1/d23/d32/f76 [253665,105925] 0 2024-04-18T21:07:02.176 INFO:tasks.workunit.client.0.smithi096.stdout:9/909: truncate d0/dc/d5f/d76/f84 3702652 0 2024-04-18T21:07:02.176 INFO:tasks.workunit.client.0.smithi096.stdout:4/841: write d2/d2a/d54/d5b/d89/d90/fe9 [106922,77869] 0 2024-04-18T21:07:02.176 INFO:tasks.workunit.client.0.smithi096.stdout:0/769: unlink d1/d23/d32/d7d/f8d 0 2024-04-18T21:07:02.178 INFO:tasks.workunit.client.0.smithi096.stdout:4/842: creat d2/dbb/f115 x:0 0 0 2024-04-18T21:07:02.178 INFO:tasks.workunit.client.0.smithi096.stdout:0/770: mknod d1/db/d30/d31/d85/dfc/c103 0 2024-04-18T21:07:02.179 INFO:tasks.workunit.client.0.smithi096.stdout:6/818: write d1/d3a/d57/d26/fa9 [1688291,38801] 0 2024-04-18T21:07:02.180 INFO:tasks.workunit.client.0.smithi096.stdout:0/771: rmdir d1/d23/d32/d43/d6f/d8a/d91/dba/d7e 39 2024-04-18T21:07:02.181 INFO:tasks.workunit.client.0.smithi096.stdout:6/819: mkdir d1/d10d 0 2024-04-18T21:07:02.181 INFO:tasks.workunit.client.0.smithi096.stdout:0/772: dread - d1/db/d25/fb0 zero size 2024-04-18T21:07:02.182 INFO:tasks.workunit.client.0.smithi096.stdout:3/694: dwrite d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:07:02.182 INFO:tasks.workunit.client.0.smithi096.stdout:6/820: unlink d1/d3a/d57/de3/f5e 0 2024-04-18T21:07:02.183 INFO:tasks.workunit.client.0.smithi096.stdout:9/910: dwrite d0/d44/fcb [0,4194304] 0 2024-04-18T21:07:02.183 INFO:tasks.workunit.client.0.smithi096.stdout:0/773: rename d1/db/d30/d4a/d67/ca6 to d1/db/dda/de9/deb/d5d/c104 0 2024-04-18T21:07:02.184 INFO:tasks.workunit.client.0.smithi096.stdout:9/911: chown d0/d28/d2f/c3e 337159 1 2024-04-18T21:07:02.184 INFO:tasks.workunit.client.0.smithi096.stdout:0/774: stat d1/db/d30/d4a/d67/ff5 0 2024-04-18T21:07:02.185 INFO:tasks.workunit.client.0.smithi096.stdout:9/912: stat d0/d8/d11/d39/c8b 0 2024-04-18T21:07:02.185 INFO:tasks.workunit.client.0.smithi096.stdout:0/775: unlink d1/d23/d32/f78 0 2024-04-18T21:07:02.185 INFO:tasks.workunit.client.0.smithi096.stdout:9/913: mkdir d0/d8/d11/d48/d122 0 2024-04-18T21:07:02.186 INFO:tasks.workunit.client.0.smithi096.stdout:9/914: fdatasync d0/dc/f86 0 2024-04-18T21:07:02.187 INFO:tasks.workunit.client.0.smithi096.stdout:9/915: chown d0/d28/d3d/f6b 0 1 2024-04-18T21:07:02.189 INFO:tasks.workunit.client.0.smithi096.stdout:9/916: chown d0/d28/da1/f118 721148950 1 2024-04-18T21:07:02.190 INFO:tasks.workunit.client.0.smithi096.stdout:9/917: mknod d0/d28/d2f/c123 0 2024-04-18T21:07:02.190 INFO:tasks.workunit.client.0.smithi096.stdout:3/695: dwrite d4/d6/d22/d20/d46/f56 [0,4194304] 0 2024-04-18T21:07:02.190 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:02.191+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:02.191 INFO:tasks.workunit.client.0.smithi096.stdout:9/918: dread - d0/d8/d89/fd9 zero size 2024-04-18T21:07:02.192 INFO:tasks.workunit.client.0.smithi096.stdout:2/967: dread d11/d13/d1a/d1e/d9f/fa8 [0,4194304] 0 2024-04-18T21:07:02.192 INFO:tasks.workunit.client.0.smithi096.stdout:0/776: dwrite d1/db/d30/f5b [0,4194304] 0 2024-04-18T21:07:02.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/968: write d11/d13/d1a/d1e/de7/f12e [1776981,29036] 0 2024-04-18T21:07:02.194 INFO:tasks.workunit.client.0.smithi096.stdout:9/919: rename d0/dc/d5f/f61 to d0/d28/d7a/dc3/f124 0 2024-04-18T21:07:02.194 INFO:tasks.workunit.client.0.smithi096.stdout:0/777: symlink d1/db/l105 0 2024-04-18T21:07:02.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/969: fdatasync d11/d13/d1a/d1e/d28/d4e/f53 0 2024-04-18T21:07:02.195 INFO:tasks.workunit.client.0.smithi096.stdout:9/920: readlink d0/d28/d7a/dc3/led 0 2024-04-18T21:07:02.196 INFO:tasks.workunit.client.0.smithi096.stdout:9/921: write d0/d28/d2f/fc7 [2901182,45511] 0 2024-04-18T21:07:02.196 INFO:tasks.workunit.client.0.smithi096.stdout:0/778: write d1/d23/d32/d43/d6f/d8a/d96/db4/fd7 [3755460,19680] 0 2024-04-18T21:07:02.197 INFO:tasks.workunit.client.0.smithi096.stdout:2/970: mkdir d11/d13/d1a/d1e/d28/d4e/d13f 0 2024-04-18T21:07:02.199 INFO:tasks.workunit.client.0.smithi096.stdout:9/922: write d0/d8/d11/d39/d63/f110 [400645,56855] 0 2024-04-18T21:07:02.199 INFO:tasks.workunit.client.0.smithi096.stdout:2/971: rmdir d11/d50/d5b 39 2024-04-18T21:07:02.200 INFO:tasks.workunit.client.0.smithi096.stdout:3/696: dwrite d4/d6/d22/d20/f44 [0,4194304] 0 2024-04-18T21:07:02.201 INFO:tasks.workunit.client.0.smithi096.stdout:2/972: creat d11/d13/d1d/d5d/d97/dfb/f140 x:0 0 0 2024-04-18T21:07:02.202 INFO:tasks.workunit.client.0.smithi096.stdout:3/697: creat d4/d6/d1b/d2c/d31/d93/fcb x:0 0 0 2024-04-18T21:07:02.202 INFO:tasks.workunit.client.0.smithi096.stdout:9/923: getdents d0/d28/d7a/dc3/dc6 0 2024-04-18T21:07:02.202 INFO:tasks.workunit.client.0.smithi096.stdout:3/698: mkdir d4/d6/dcc 0 2024-04-18T21:07:02.202 INFO:tasks.workunit.client.0.smithi096.stdout:9/924: chown d0/d28/d66/dd8/cf3 889938 1 2024-04-18T21:07:02.203 INFO:tasks.workunit.client.0.smithi096.stdout:2/973: write d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f56 [794891,97831] 0 2024-04-18T21:07:02.203 INFO:tasks.workunit.client.0.smithi096.stdout:3/699: creat d4/d6/d1b/d2c/d31/d11/fcd x:0 0 0 2024-04-18T21:07:02.204 INFO:tasks.workunit.client.0.smithi096.stdout:0/779: dread d1/d23/d32/d43/d6f/d8a/d96/db4/fc4 [0,4194304] 0 2024-04-18T21:07:02.205 INFO:tasks.workunit.client.0.smithi096.stdout:3/700: mknod d4/d6/d1b/d2c/d5c/cce 0 2024-04-18T21:07:02.205 INFO:tasks.workunit.client.0.smithi096.stdout:0/780: symlink d1/db/dda/l106 0 2024-04-18T21:07:02.206 INFO:tasks.workunit.client.0.smithi096.stdout:3/701: symlink d4/d6/d1b/d2c/d31/lcf 0 2024-04-18T21:07:02.207 INFO:tasks.workunit.client.0.smithi096.stdout:0/781: creat d1/db/dda/de9/deb/d6d/f107 x:0 0 0 2024-04-18T21:07:02.207 INFO:tasks.workunit.client.0.smithi096.stdout:3/702: write d4/d6/d1b/d2c/d6b/d99/da6/f78 [190400,26070] 0 2024-04-18T21:07:02.208 INFO:tasks.workunit.client.0.smithi096.stdout:8/853: write d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 [2505234,76935] 0 2024-04-18T21:07:02.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/782: dread - d1/db/dda/de9/deb/d6d/db1/fdb zero size 2024-04-18T21:07:02.209 INFO:tasks.workunit.client.0.smithi096.stdout:3/703: readlink d4/d6/l4b 0 2024-04-18T21:07:02.211 INFO:tasks.workunit.client.0.smithi096.stdout:2/974: dwrite d11/d50/d5b/dcb/f111 [0,4194304] 0 2024-04-18T21:07:02.211 INFO:tasks.workunit.client.0.smithi096.stdout:9/925: dwrite d0/d8/f3b [0,4194304] 0 2024-04-18T21:07:02.212 INFO:tasks.workunit.client.0.smithi096.stdout:9/926: sync 2024-04-18T21:07:02.213 INFO:tasks.workunit.client.0.smithi096.stdout:3/704: rename d4/d6/d1b/d2c/d31/d4e/fb6 to d4/d6/d1b/d2c/d31/d11/fd0 0 2024-04-18T21:07:02.214 INFO:tasks.workunit.client.0.smithi096.stdout:3/705: chown d4/d6/d7/db8 91371694 1 2024-04-18T21:07:02.216 INFO:tasks.workunit.client.0.smithi096.stdout:3/706: fdatasync d4/d6/d1b/d2c/d31/d11/f5b 0 2024-04-18T21:07:02.217 INFO:tasks.workunit.client.0.smithi096.stdout:1/841: dread d0/df/d16/f68 [0,4194304] 0 2024-04-18T21:07:02.217 INFO:tasks.workunit.client.0.smithi096.stdout:0/783: dwrite d1/db/d30/d31/f4c [0,4194304] 0 2024-04-18T21:07:02.219 INFO:tasks.workunit.client.0.smithi096.stdout:2/975: dwrite d11/d13/f32 [0,4194304] 0 2024-04-18T21:07:02.219 INFO:tasks.workunit.client.0.smithi096.stdout:3/707: mknod d4/d6/d1b/d2c/d31/d11/cd1 0 2024-04-18T21:07:02.221 INFO:tasks.workunit.client.0.smithi096.stdout:1/842: creat d0/df/d62/d110/f116 x:0 0 0 2024-04-18T21:07:02.221 INFO:tasks.workunit.client.0.smithi096.stdout:0/784: creat d1/db/dda/de9/deb/d5d/d60/df6/f108 x:0 0 0 2024-04-18T21:07:02.221 INFO:tasks.workunit.client.0.smithi096.stdout:3/708: link d4/d8/f1f d4/d6/d1b/d63/fd2 0 2024-04-18T21:07:02.221 INFO:tasks.workunit.client.0.smithi096.stdout:2/976: creat d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/f141 x:0 0 0 2024-04-18T21:07:02.222 INFO:tasks.workunit.client.0.smithi096.stdout:1/843: truncate d0/df/d16/fc9 692628 0 2024-04-18T21:07:02.224 INFO:tasks.workunit.client.0.smithi096.stdout:5/804: dread d2/d18/d9d/da0/fac [0,4194304] 0 2024-04-18T21:07:02.224 INFO:tasks.workunit.client.0.smithi096.stdout:0/785: rmdir d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd 39 2024-04-18T21:07:02.224 INFO:tasks.workunit.client.0.smithi096.stdout:1/844: creat d0/df/d16/d6c/d106/f117 x:0 0 0 2024-04-18T21:07:02.224 INFO:tasks.workunit.client.0.smithi096.stdout:2/977: rename d11/d13/d1a/d1e/d28/d4e/d63/dce/d11f to d11/d13/d1a/d1e/d28/d4e/d12d/d142 0 2024-04-18T21:07:02.225 INFO:tasks.workunit.client.0.smithi096.stdout:5/805: fsync d2/f16 0 2024-04-18T21:07:02.226 INFO:tasks.workunit.client.0.smithi096.stdout:5/806: write d2/d11/d28/f78 [5111868,68305] 0 2024-04-18T21:07:02.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/845: rename d0/df/d16/d24/dc0/f7c to d0/df/d30/d53/da2/f118 0 2024-04-18T21:07:02.227 INFO:tasks.workunit.client.0.smithi096.stdout:5/807: write d2/d18/d61/d6d/f102 [416029,84167] 0 2024-04-18T21:07:02.227 INFO:tasks.workunit.client.0.smithi096.stdout:5/808: sync 2024-04-18T21:07:02.228 INFO:tasks.workunit.client.0.smithi096.stdout:5/809: rmdir d2/d11/d28/d4a/d69 39 2024-04-18T21:07:02.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/846: rename d0/df/d16/d24/dac/dd2/ld5 to d0/df/l119 0 2024-04-18T21:07:02.229 INFO:tasks.workunit.client.0.smithi096.stdout:5/810: unlink d2/lc3 0 2024-04-18T21:07:02.231 INFO:tasks.workunit.client.0.smithi096.stdout:1/847: write d0/df/d16/d24/dac/d65/fbf [336556,130853] 0 2024-04-18T21:07:02.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/767: dread d0/d7/d8/f56 [0,4194304] 0 2024-04-18T21:07:02.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/768: readlink d0/d7/d8/l37 0 2024-04-18T21:07:02.233 INFO:tasks.workunit.client.0.smithi096.stdout:1/848: fdatasync d0/df/d62/f83 0 2024-04-18T21:07:02.233 INFO:tasks.workunit.client.0.smithi096.stdout:0/786: dwrite d1/db/d30/d31/d85/fa [0,4194304] 0 2024-04-18T21:07:02.234 INFO:tasks.workunit.client.0.smithi096.stdout:3/709: dwrite d4/d8/f3d [0,4194304] 0 2024-04-18T21:07:02.235 INFO:tasks.workunit.client.0.smithi096.stdout:7/769: truncate d0/d20/d62/dca/dd6/fdc 661071 0 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi096.stdout:0/787: mkdir d1/db/d30/d31/d85/dfc/d109 0 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi096.stdout:1/849: rename d0/df/d16/d6c/d9d/f113 to d0/df/de5/f11a 0 2024-04-18T21:07:02.237 INFO:tasks.workunit.client.0.smithi096.stdout:5/811: dwrite d2/f79 [0,4194304] 0 2024-04-18T21:07:02.237 INFO:tasks.workunit.client.0.smithi096.stdout:7/770: write d0/d7/d8/f1a [3735166,78705] 0 2024-04-18T21:07:02.238 INFO:tasks.workunit.client.0.smithi096.stdout:1/850: write d0/ffd [163183,940] 0 2024-04-18T21:07:02.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/771: write d0/d20/d39/d8a/db4/fbc [1131174,48206] 0 2024-04-18T21:07:02.239 INFO:tasks.workunit.client.0.smithi096.stdout:3/710: unlink d4/d6/d1b/d2c/d6b/d99/da6/c95 0 2024-04-18T21:07:02.241 INFO:tasks.workunit.client.0.smithi096.stdout:4/843: dread d2/f4c [4194304,4194304] 0 2024-04-18T21:07:02.241 INFO:tasks.workunit.client.0.smithi096.stdout:0/788: link d1/d23/d32/d43/d6f/c8f d1/da5/c10a 0 2024-04-18T21:07:02.241 INFO:tasks.workunit.client.0.smithi096.stdout:3/711: fdatasync d4/f35 0 2024-04-18T21:07:02.242 INFO:tasks.workunit.client.0.smithi096.stdout:4/844: rename d2/d2f/d33/d55/d57/c6e to d2/dbb/dde/c116 0 2024-04-18T21:07:02.244 INFO:tasks.workunit.client.0.smithi096.stdout:5/812: dwrite d2/d11/d28/f78 [4194304,4194304] 0 2024-04-18T21:07:02.246 INFO:tasks.workunit.client.0.smithi096.stdout:7/772: dwrite d0/d7/d42/f74 [0,4194304] 0 2024-04-18T21:07:02.247 INFO:tasks.workunit.client.0.smithi096.stdout:1/851: write d0/df/d30/d53/da2/f10a [3469161,8726] 0 2024-04-18T21:07:02.248 INFO:tasks.workunit.client.0.smithi096.stdout:4/845: write d2/d2f/d33/d55/d59/db9/fca [3004204,85369] 0 2024-04-18T21:07:02.249 INFO:tasks.workunit.client.0.smithi096.stdout:7/773: unlink d0/d7/d2f/d63/fa8 0 2024-04-18T21:07:02.250 INFO:tasks.workunit.client.0.smithi096.stdout:0/789: dwrite d1/db/d30/d4a/ffa [0,4194304] 0 2024-04-18T21:07:02.250 INFO:tasks.workunit.client.0.smithi096.stdout:1/852: symlink d0/df/de5/df8/d95/l11b 0 2024-04-18T21:07:02.252 INFO:tasks.workunit.client.0.smithi096.stdout:0/790: write d1/f75 [85255,43603] 0 2024-04-18T21:07:02.252 INFO:tasks.workunit.client.0.smithi096.stdout:3/712: dwrite d4/d6/d1b/d2c/d31/d93/fcb [0,4194304] 0 2024-04-18T21:07:02.252 INFO:tasks.workunit.client.0.smithi096.stdout:4/846: rename d2/d2f/d33/f72 to d2/d2f/d39/d43/f117 0 2024-04-18T21:07:02.252 INFO:tasks.workunit.client.0.smithi096.stdout:5/813: dwrite d2/fe7 [0,4194304] 0 2024-04-18T21:07:02.253 INFO:tasks.workunit.client.0.smithi096.stdout:7/774: rename d0/d20/d4b/f91 to d0/d20/d4b/d7f/da1/ff4 0 2024-04-18T21:07:02.253 INFO:tasks.workunit.client.0.smithi096.stdout:0/791: write d1/d23/fc7 [968658,103502] 0 2024-04-18T21:07:02.254 INFO:tasks.workunit.client.0.smithi096.stdout:7/775: write d0/d7/d2f/d63/f9a [1396056,18731] 0 2024-04-18T21:07:02.254 INFO:tasks.workunit.client.0.smithi096.stdout:0/792: dread - d1/db/dda/de9/deb/d82/ff2 zero size 2024-04-18T21:07:02.254 INFO:tasks.workunit.client.0.smithi096.stdout:4/847: mkdir d2/d2f/d39/d43/d103/d118 0 2024-04-18T21:07:02.255 INFO:tasks.workunit.client.0.smithi096.stdout:5/814: mkdir d2/d11/d28/d122 0 2024-04-18T21:07:02.255 INFO:tasks.workunit.client.0.smithi096.stdout:7/776: mknod d0/d20/d62/dca/cf5 0 2024-04-18T21:07:02.256 INFO:tasks.workunit.client.0.smithi096.stdout:1/853: rename d0/df/d30/lb2 to d0/df/d30/d53/l11c 0 2024-04-18T21:07:02.256 INFO:tasks.workunit.client.0.smithi096.stdout:0/793: getdents d1/db/d30/d4a/d67 0 2024-04-18T21:07:02.256 INFO:tasks.workunit.client.0.smithi096.stdout:5/815: symlink d2/d11/d28/d4a/d87/da7/l123 0 2024-04-18T21:07:02.257 INFO:tasks.workunit.client.0.smithi096.stdout:4/848: rename d2/d2a/d54/d71/d99/deb to d2/d2f/d39/d43/d103/d119 0 2024-04-18T21:07:02.257 INFO:tasks.workunit.client.0.smithi096.stdout:0/794: chown d1/db/dda/de9 91232932 1 2024-04-18T21:07:02.257 INFO:tasks.workunit.client.0.smithi096.stdout:3/713: rename d4/d6/d1b/d2c/f43 to d4/d8/fd3 0 2024-04-18T21:07:02.257 INFO:tasks.workunit.client.0.smithi096.stdout:7/777: getdents d0/d20/d4b/d7f/d9b/dde 0 2024-04-18T21:07:02.260 INFO:tasks.workunit.client.0.smithi096.stdout:4/849: symlink d2/d2f/d33/d55/d59/l11a 0 2024-04-18T21:07:02.260 INFO:tasks.workunit.client.0.smithi096.stdout:5/816: stat d2/d11/d28/d4a/d55/d81/c10b 0 2024-04-18T21:07:02.260 INFO:tasks.workunit.client.0.smithi096.stdout:0/795: mknod d1/db/dda/de9/deb/d6d/db1/c10b 0 2024-04-18T21:07:02.260 INFO:tasks.workunit.client.0.smithi096.stdout:3/714: chown d4/d6/l23 1 1 2024-04-18T21:07:02.260 INFO:tasks.workunit.client.0.smithi096.stdout:7/778: symlink d0/d20/d39/da2/lf6 0 2024-04-18T21:07:02.261 INFO:tasks.workunit.client.0.smithi096.stdout:4/850: fdatasync d2/d2f/fdc 0 2024-04-18T21:07:02.261 INFO:tasks.workunit.client.0.smithi096.stdout:3/715: stat d4/d6/d1b/laf 0 2024-04-18T21:07:02.262 INFO:tasks.workunit.client.0.smithi096.stdout:4/851: symlink d2/d2f/d33/d55/d100/l11b 0 2024-04-18T21:07:02.262 INFO:tasks.workunit.client.0.smithi096.stdout:7/779: link d0/lf0 d0/d11/d18/lf7 0 2024-04-18T21:07:02.263 INFO:tasks.workunit.client.0.smithi096.stdout:5/817: getdents d2/d18/d9d/da0 0 2024-04-18T21:07:02.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/796: write d1/db/dda/de9/deb/d5d/d60/f1f [1899570,67333] 0 2024-04-18T21:07:02.263 INFO:tasks.workunit.client.0.smithi096.stdout:4/852: readlink d2/d2a/d54/lfb 0 2024-04-18T21:07:02.263 INFO:tasks.workunit.client.0.smithi096.stdout:7/780: readlink d0/d20/d6c/la7 0 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:5/818: write d2/d6a/d112/feb [873077,39608] 0 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:3/716: dread - d4/d6/d1b/d2c/d31/d11/fcd zero size 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:7/781: mknod d0/d7/d2f/cf8 0 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:0/797: rmdir d1/d23/d32/d43/d6f/d8a/d91 39 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:4/853: write d2/d2f/d39/d43/fc1 [1662588,11011] 0 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:5/819: rmdir d2/d11/d28/d4a/d55 39 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:7/782: creat d0/d20/d39/d59/ff9 x:0 0 0 2024-04-18T21:07:02.265 INFO:tasks.workunit.client.0.smithi096.stdout:4/854: dread - d2/d2f/fdc zero size 2024-04-18T21:07:02.265 INFO:tasks.workunit.client.0.smithi096.stdout:0/798: truncate d1/db/dda/de9/deb/d82/ff2 690626 0 2024-04-18T21:07:02.266 INFO:tasks.workunit.client.0.smithi096.stdout:0/799: stat d1/db/f92 0 2024-04-18T21:07:02.266 INFO:tasks.workunit.client.0.smithi096.stdout:7/783: mkdir d0/d20/d62/dca/dd6/dfa 0 2024-04-18T21:07:02.266 INFO:tasks.workunit.client.0.smithi096.stdout:3/717: getdents d4/d6/d22 0 2024-04-18T21:07:02.266 INFO:tasks.workunit.client.0.smithi096.stdout:4/855: creat d2/d2a/d54/d5b/d89/f11c x:0 0 0 2024-04-18T21:07:02.266 INFO:tasks.workunit.client.0.smithi096.stdout:0/800: mkdir d1/db/d30/d31/d65/d10c 0 2024-04-18T21:07:02.267 INFO:tasks.workunit.client.0.smithi096.stdout:3/718: write d4/d8/fb9 [794953,120838] 0 2024-04-18T21:07:02.267 INFO:tasks.workunit.client.0.smithi096.stdout:3/719: dread - d4/d6/d7/d90/fa4 zero size 2024-04-18T21:07:02.271 INFO:tasks.workunit.client.0.smithi096.stdout:7/784: dwrite d0/d20/d39/f64 [0,4194304] 0 2024-04-18T21:07:02.272 INFO:tasks.workunit.client.0.smithi096.stdout:7/785: dread - d0/d20/d62/dca/f79 zero size 2024-04-18T21:07:02.273 INFO:tasks.workunit.client.0.smithi096.stdout:3/720: dwrite d4/d8/d49/d9e/fb7 [0,4194304] 0 2024-04-18T21:07:02.279 INFO:tasks.workunit.client.0.smithi096.stdout:5/820: write d2/f2b [2464851,30517] 0 2024-04-18T21:07:02.279 INFO:tasks.workunit.client.0.smithi096.stdout:3/721: dwrite d4/d6/d1b/d2c/d31/f9b [4194304,4194304] 0 2024-04-18T21:07:02.280 INFO:tasks.workunit.client.0.smithi096.stdout:5/821: write d2/d8f/ff5 [866447,106645] 0 2024-04-18T21:07:02.281 INFO:tasks.workunit.client.0.smithi096.stdout:5/822: write d2/d11/d28/d4a/f80 [458569,91779] 0 2024-04-18T21:07:02.281 INFO:tasks.workunit.client.0.smithi096.stdout:3/722: symlink d4/d6/d1b/d2c/d31/d11/ld4 0 2024-04-18T21:07:02.284 INFO:tasks.workunit.client.0.smithi096.stdout:4/856: dread d2/d2f/d33/d55/f6f [0,4194304] 0 2024-04-18T21:07:02.284 INFO:tasks.workunit.client.0.smithi096.stdout:6/821: dread d1/d3a/d57/f9 [4194304,4194304] 0 2024-04-18T21:07:02.285 INFO:tasks.workunit.client.0.smithi096.stdout:4/857: write d2/d2f/fac [4788843,44358] 0 2024-04-18T21:07:02.285 INFO:tasks.workunit.client.0.smithi096.stdout:4/858: chown d2/d1d/f5e 52331 1 2024-04-18T21:07:02.286 INFO:tasks.workunit.client.0.smithi096.stdout:6/822: rename d1/d3a/d57/d26/dda to d1/d5/da/d46/d71/d7c/d8b/d10e 0 2024-04-18T21:07:02.286 INFO:tasks.workunit.client.0.smithi096.stdout:4/859: symlink d2/d2a/d54/l11d 0 2024-04-18T21:07:02.287 INFO:tasks.workunit.client.0.smithi096.stdout:6/823: mkdir d1/d3a/dec/d10f 0 2024-04-18T21:07:02.287 INFO:tasks.workunit.client.0.smithi096.stdout:4/860: mkdir d2/d11e 0 2024-04-18T21:07:02.287 INFO:tasks.workunit.client.0.smithi096.stdout:4/861: chown d2/f97 1 1 2024-04-18T21:07:02.288 INFO:tasks.workunit.client.0.smithi096.stdout:4/862: write d2/f2c [4737780,51017] 0 2024-04-18T21:07:02.288 INFO:tasks.workunit.client.0.smithi096.stdout:2/978: dread d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/f56 [0,4194304] 0 2024-04-18T21:07:02.289 INFO:tasks.workunit.client.0.smithi096.stdout:1/854: dread d0/df/d16/d24/da8/fd1 [0,4194304] 0 2024-04-18T21:07:02.290 INFO:tasks.workunit.client.0.smithi096.stdout:6/824: link d1/d3a/d57/d66/d80/dfb/fdb d1/d3a/d57/d66/d80/dfb/f110 0 2024-04-18T21:07:02.290 INFO:tasks.workunit.client.0.smithi096.stdout:2/979: symlink d11/l143 0 2024-04-18T21:07:02.290 INFO:tasks.workunit.client.0.smithi096.stdout:4/863: mknod d2/d11e/c11f 0 2024-04-18T21:07:02.290 INFO:tasks.workunit.client.0.smithi096.stdout:1/855: sync 2024-04-18T21:07:02.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:02.286+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:02.290 INFO:tasks.workunit.client.0.smithi096.stdout:2/980: write d11/d50/d108/f13b [364691,85899] 0 2024-04-18T21:07:02.291 INFO:tasks.workunit.client.0.smithi096.stdout:7/786: truncate d0/d7/fb9 926363 0 2024-04-18T21:07:02.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/825: creat d1/d5/da/d46/f111 x:0 0 0 2024-04-18T21:07:02.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/826: sync 2024-04-18T21:07:02.292 INFO:tasks.workunit.client.0.smithi096.stdout:4/864: creat d2/d2a/d54/d71/d99/dad/d101/f120 x:0 0 0 2024-04-18T21:07:02.292 INFO:tasks.workunit.client.0.smithi096.stdout:1/856: write d0/df/de5/df8/d9b/dca/dde/fc4 [630197,7666] 0 2024-04-18T21:07:02.292 INFO:tasks.workunit.client.0.smithi096.stdout:9/927: dread d0/d28/d7a/f9b [0,4194304] 0 2024-04-18T21:07:02.292 INFO:tasks.workunit.client.0.smithi096.stdout:7/787: write d0/d7/d42/fcd [284249,36022] 0 2024-04-18T21:07:02.292 INFO:tasks.workunit.client.0.smithi096.stdout:6/827: creat d1/d3a/d57/d66/f112 x:0 0 0 2024-04-18T21:07:02.293 INFO:tasks.workunit.client.0.smithi096.stdout:5/823: dread d2/d11/ff8 [0,4194304] 0 2024-04-18T21:07:02.293 INFO:tasks.workunit.client.0.smithi096.stdout:4/865: chown d2/d2f/d33/d55/d59/db9/fca 50 1 2024-04-18T21:07:02.294 INFO:tasks.workunit.client.0.smithi096.stdout:7/788: symlink d0/d20/d39/dda/lfb 0 2024-04-18T21:07:02.294 INFO:tasks.workunit.client.0.smithi096.stdout:5/824: truncate d2/d11/d28/d4a/fd6 305895 0 2024-04-18T21:07:02.295 INFO:tasks.workunit.client.0.smithi096.stdout:6/828: truncate d1/d3a/d57/d26/fa9 2157263 0 2024-04-18T21:07:02.297 INFO:tasks.workunit.client.0.smithi096.stdout:3/723: truncate d4/d6/f92 2619176 0 2024-04-18T21:07:02.297 INFO:tasks.workunit.client.0.smithi096.stdout:8/854: dread d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 [0,4194304] 0 2024-04-18T21:07:02.298 INFO:tasks.workunit.client.0.smithi096.stdout:5/825: unlink d2/d11/d28/d64/dba/c117 0 2024-04-18T21:07:02.298 INFO:tasks.workunit.client.0.smithi096.stdout:7/789: truncate d0/d20/d4b/d7f/fa5 8979118 0 2024-04-18T21:07:02.298 INFO:tasks.workunit.client.0.smithi096.stdout:6/829: unlink d1/d5/c98 0 2024-04-18T21:07:02.300 INFO:tasks.workunit.client.0.smithi096.stdout:5/826: creat d2/d9b/f124 x:0 0 0 2024-04-18T21:07:02.300 INFO:tasks.workunit.client.0.smithi096.stdout:7/790: read d0/f52 [669287,34352] 0 2024-04-18T21:07:02.301 INFO:tasks.workunit.client.0.smithi096.stdout:6/830: symlink d1/d3a/dec/d10f/l113 0 2024-04-18T21:07:02.302 INFO:tasks.workunit.client.0.smithi096.stdout:8/855: chown d0/d3/d1d/d83/dcd/d7f/dac/d33/cfc 0 1 2024-04-18T21:07:02.304 INFO:tasks.workunit.client.0.smithi096.stdout:5/827: mknod d2/d11/d28/d4a/d55/c125 0 2024-04-18T21:07:02.304 INFO:tasks.workunit.client.0.smithi096.stdout:1/857: dwrite d0/df/d30/f94 [0,4194304] 0 2024-04-18T21:07:02.305 INFO:tasks.workunit.client.0.smithi096.stdout:4/866: dwrite d2/d2f/d33/f34 [4194304,4194304] 0 2024-04-18T21:07:02.305 INFO:tasks.workunit.client.0.smithi096.stdout:2/981: dwrite d11/d13/d1a/d1e/d28/d4e/d89/dc0/fe9 [0,4194304] 0 2024-04-18T21:07:02.306 INFO:tasks.workunit.client.0.smithi096.stdout:1/858: write d0/df/d16/d6c/d9d/fa4 [3079117,76464] 0 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi096.stdout:5/828: creat d2/d18/d9d/da0/dcb/f126 x:0 0 0 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi096.stdout:7/791: symlink d0/d20/d4b/d7f/lfc 0 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi096.stdout:4/867: creat d2/d2f/d33/d55/d100/f121 x:0 0 0 2024-04-18T21:07:02.309 INFO:tasks.workunit.client.0.smithi096.stdout:2/982: link d11/d13/d1a/d1e/d28/d4e/fb4 d11/d13/d1d/d5d/d97/dfb/f144 0 2024-04-18T21:07:02.309 INFO:tasks.workunit.client.0.smithi096.stdout:1/859: write d0/df/fb9 [3349493,117105] 0 2024-04-18T21:07:02.310 INFO:tasks.workunit.client.0.smithi096.stdout:5/829: chown d2/d18/d61/d6f/d7a/l8c 0 1 2024-04-18T21:07:02.310 INFO:tasks.workunit.client.0.smithi096.stdout:2/983: mknod d11/d50/d5b/c145 0 2024-04-18T21:07:02.311 INFO:tasks.workunit.client.0.smithi096.stdout:4/868: dread - d2/d2a/d54/d71/d99/dad/d101/f120 zero size 2024-04-18T21:07:02.311 INFO:tasks.workunit.client.0.smithi096.stdout:7/792: truncate d0/d20/d4b/d7f/da1/fc5 1036590 0 2024-04-18T21:07:02.312 INFO:tasks.workunit.client.0.smithi096.stdout:5/830: rmdir d2/d18/d9d 39 2024-04-18T21:07:02.312 INFO:tasks.workunit.client.0.smithi096.stdout:9/928: dwrite d0/d8/d11/d39/fca [0,4194304] 0 2024-04-18T21:07:02.312 INFO:tasks.workunit.client.0.smithi096.stdout:6/831: dwrite d1/d5/f87 [0,4194304] 0 2024-04-18T21:07:02.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/793: mknod d0/d20/d4b/d7f/da1/cfd 0 2024-04-18T21:07:02.313 INFO:tasks.workunit.client.0.smithi096.stdout:4/869: rmdir d2/d2f/d33/d55/d10a 0 2024-04-18T21:07:02.313 INFO:tasks.workunit.client.0.smithi096.stdout:9/929: fdatasync d0/d28/d7a/faa 0 2024-04-18T21:07:02.314 INFO:tasks.workunit.client.0.smithi096.stdout:6/832: mkdir d1/d3a/d57/d66/d114 0 2024-04-18T21:07:02.314 INFO:tasks.workunit.client.0.smithi096.stdout:7/794: dread - d0/d20/d39/d8a/db4/fe5 zero size 2024-04-18T21:07:02.315 INFO:tasks.workunit.client.0.smithi096.stdout:4/870: rename d2/d2a/d54/d6d/d78/ffc to d2/d2a/d54/d71/d99/dad/f122 0 2024-04-18T21:07:02.315 INFO:tasks.workunit.client.0.smithi096.stdout:6/833: write d1/d3a/d57/de3/f8c [581707,112607] 0 2024-04-18T21:07:02.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/795: link d0/d7/f4d d0/d20/d39/ffe 0 2024-04-18T21:07:02.316 INFO:tasks.workunit.client.0.smithi096.stdout:9/930: link d0/dc/d5f/fe8 d0/d28/d7a/dc3/f125 0 2024-04-18T21:07:02.316 INFO:tasks.workunit.client.0.smithi096.stdout:5/831: dread - d2/d18/d61/d6f/f11b zero size 2024-04-18T21:07:02.317 INFO:tasks.workunit.client.0.smithi096.stdout:4/871: fdatasync d2/d2a/d54/d71/f102 0 2024-04-18T21:07:02.317 INFO:tasks.workunit.client.0.smithi096.stdout:8/856: write d0/d3/d1d/d83/dcd/fcf [6983806,107357] 0 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:02.319 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.710331375999999, 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:02.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.706822119999998, 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:02.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:02.331 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.693628918000002, 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:02.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:02.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.676441713999999, 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:02.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:02.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.673027600000001, 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.344 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.350 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.672174085000002, 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:02.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:02.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.356 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.669637402999999, 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.654905187000001, 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:02.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.652445356000001, 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:02.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.64652633, 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.374 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:02.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:02.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.639797435999998, 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.380 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:02.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:02.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:02.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:02.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.585115386999998, 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.386 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:02.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:02.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.555528934000002, 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:02.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.544344805000001, 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.398 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:02.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:02.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:02.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.544050614, 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:02.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:02.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:02.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.541410085999999, 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.409 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:02.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:02.414 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.533128490999999, 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:02.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:02.419 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.346211165, 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.424 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.345223397, 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:02.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:02.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:02.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:02.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:02.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.340918952999999, 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:02.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:02.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:02.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:02.435 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:02.437 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:02.444 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:02.435+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:6/834: creat d1/d5/da/d55/f115 x:0 0 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:5/832: mknod d2/d9b/c127 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:8/857: write d0/d5d/f77 [1597139,90578] 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:1/860: dwrite d0/df/d16/d24/dac/d65/fbf [0,4194304] 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:7/796: link d0/d7/l13 d0/d20/d62/d7d/lff 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:6/835: rmdir d1/d5/da/d46/d71/dbc/df6 39 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:2/984: dwrite d11/d13/d1a/d1e/d28/d4e/d89/ff9 [0,4194304] 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:2/985: write d11/f16 [2651759,36525] 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:6/836: unlink d1/d3a/d57/f106 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:8/858: mknod d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b/c11d 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:2/986: mknod d11/d13/d1a/d1e/de7/df7/c146 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:7/797: link d0/lf0 d0/d20/d62/l100 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:8/859: symlink d0/d3/d1d/d83/l11e 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:7/798: write d0/d20/d39/f64 [360436,52963] 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:0/801: dread d1/db/d30/d31/d85/fd [0,4194304] 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:0/802: sync 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:7/799: chown d0/d7/d2f/l8d 302433 1 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:0/803: creat d1/d23/d32/f10d x:0 0 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:2/987: mknod d11/d13/d1a/d1e/d28/d4e/d40/d51/d57/d6d/d6f/d82/c147 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:7/800: symlink d0/d7/d2f/d63/dd3/dd8/l101 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:0/804: write d1/db/d30/d31/d85/f16 [4627546,43147] 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:6/837: dwrite d1/d5/f69 [0,4194304] 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:7/801: mkdir d0/d20/d39/d8a/d102 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:0/805: mkdir d1/db/d30/d31/d85/d58/d10e 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:7/802: stat d0/d20/d39/d8a/db4/fbc 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:6/838: rename d1/d3a/d57/de3/f104 to d1/d3a/d57/f116 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi096.stdout:8/860: dwrite d0/d64/f6d [0,4194304] 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/988: rename d11/d13/d1a/d1e/d28/d4e/d40/dbe/dc5 to d11/d13/d1a/d1e/dbf/d148 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:7/803: mknod d0/d7/d2f/d63/c103 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:6/839: mkdir d1/d5/da/d44/d117 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:0/806: mknod d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/c10f 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:8/861: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 zero size 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:6/840: symlink d1/d3a/d57/d66/l118 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/989: write d11/d13/d1a/d1e/f68 [29378,68892] 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:7/804: rename d0/d20/d4b/d7f/d9b to d0/d7/d2f/d63/dc4/d104 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:0/807: mkdir d1/db/d30/d4a/dae/dcf/d110 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:7/805: symlink d0/d20/d62/l105 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:6/841: creat d1/d5/da/d46/d71/dbc/f119 x:0 0 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/990: mkdir d11/d13/d1a/d1e/d28/d4e/d63/d149 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:6/842: creat d1/d5/da/d55/f11a x:0 0 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:0/808: read - d1/d23/fa4 zero size 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/991: stat d11/d13/d1a/d1e/de7/df7 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:2/992: sync 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:8/862: creat d0/d3/d3a/dab/d61/f11f x:0 0 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:6/843: mkdir d1/d5/da/d44/d97/d11b 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:0/809: dread - d1/d23/fa4 zero size 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:7/806: dwrite d0/f1d [0,4194304] 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:0/810: symlink d1/d23/d32/d43/dfb/l111 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:8/863: mkdir d0/d3/d1d/d66/d10a/d120 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/872: truncate d2/d2f/d33/d55/de0/f10f 3747884 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:5/833: dread d2/d18/d9d/da0/dcb/fdb [0,4194304] 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:2/993: rmdir d11/d13/d1a/d1e/d28/d4e/d12d/d142 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:7/807: mkdir d0/d20/d4b/d7f/d106 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:6/844: dwrite d1/f34 [0,4194304] 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:2/994: stat d11/l7d 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:5/834: chown d2/d38/d4c/c4f 326 1 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/873: rmdir d2/d2f/d33/d55 39 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/835: fsync d2/d11/f68 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:2/995: write d11/d13/f32 [4000927,120456] 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/845: dread - d1/d3a/d57/de3/f95 zero size 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:8/864: getdents d0/d3/d1d/d102/d115 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/846: sync 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:4/874: rmdir d2/d2a/d54/d6d 39 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:2/996: mknod d11/d13/d1a/d1e/d28/d4e/d89/d8b/c14a 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/847: creat d1/d61/d91/f11c x:0 0 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/848: rename d1/f4a to d1/d5/da/d46/d105/f11d 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/849: sync 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/850: symlink d1/d3a/d57/d66/d114/l11e 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:7/808: dwrite d0/d20/d6c/fdb [0,4194304] 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:9/931: fdatasync d0/d8/d11/d39/fca 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:8/865: dwrite d0/d3/d3a/d81/f106 [0,4194304] 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:7/809: write d0/d20/d62/dca/fcc [2266495,99021] 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:9/932: mknod d0/d44/d103/c126 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/851: creat d1/d3a/d36/d7a/f11f x:0 0 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:6/852: sync 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:7/810: symlink d0/d7/d2f/d63/l107 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/997: dwrite d11/d13/d1a/d1e/ff3 [0,4194304] 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:6/853: mknod d1/d5/da/d46/c120 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:7/811: fdatasync d0/d20/f5d 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:7/812: sync 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/998: fdatasync d11/d13/d1a/d1e/d28/d4e/d63/d10a/ff2 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:6/854: rmdir d1/d3a/d36 39 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/999: chown d11/d13/d1d/l74 4 1 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:7/813: rename d0/d11/c1f to d0/d11/c108 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:6/855: chown d1/d3a/d57/de3 44982421 1 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:3/724: dread d4/d6/d1b/d1d/f2e [0,4194304] 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi096.stdout:7/814: mknod d0/d7/d2f/c109 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:3/725: dread - d4/d6/d1b/d2c/d6b/d99/da6/f69 zero size 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:9/933: dwrite d0/d28/d7a/de5/f107 [0,4194304] 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/815: mknod d0/c10a 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:9/934: creat d0/dc/d5f/f127 x:0 0 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:3/726: mknod d4/d6/d22/d20/d46/d50/daa/cd5 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/816: read - d0/d20/d4b/d7f/da1/ff4 zero size 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:9/935: mknod d0/dc/d5f/d76/dd5/c128 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/817: unlink d0/d20/d39/cd9 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:1/861: dread d0/df/de5/df8/d9b/dca/dde/fc4 [0,4194304] 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:4/875: truncate d2/d2f/d33/d55/f9f 77853 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:9/936: mknod d0/d28/d66/c129 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:1/862: chown d0/df/de5/df8/d9b 6 1 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/818: symlink d0/d20/d62/d7d/dee/l10b 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:8/866: truncate d0/d64/d43/f4a 2858877 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:4/876: write d2/d2f/d39/f4b [860577,107823] 0 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi096.stdout:9/937: getdents d0/d8/d89 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:8/867: stat d0/d3/fd 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/877: readlink d2/d1d/l4d 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:7/819: symlink d0/d20/d39/d8a/db4/l10c 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:9/938: creat d0/d28/d66/db2/f12a x:0 0 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:5/836: dwrite d2/d11/ff8 [0,4194304] 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/878: symlink d2/d2f/d33/d55/d59/db9/l123 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/879: write d2/d2f/d33/d55/d59/d5f/dcd/f10e [832845,120621] 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/880: chown d2/d2f/d33/d55/d59/d5f/dcd/fcf 2917 1 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:0/811: dread d1/d23/fc7 [0,4194304] 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:8/868: rename d0/d3/d3a/dab/d46/dc5/fa7 to d0/d3/d1d/d83/f121 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:9/939: symlink d0/d28/d66/db2/l12b 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:5/837: rmdir d2/d18/d9d/da0 39 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:7/820: rename d0/d7/d49/c66 to d0/d7/d2f/d63/dc4/d104/c10d 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:0/812: mkdir d1/db/d30/d31/d85/d112 0 2024-04-18T21:07:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:9/940: rmdir d0/d28/d2f/de6/ddb/d108 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/941: write d0/d28/d66/dd8/fff [746409,24793] 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:0/813: rename d1/db/dda/de9/deb/d5d/d60/l27 to d1/da3/dde/l113 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/942: mkdir d0/d8/d11/d39/d63/d12c 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/943: sync 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:0/814: mknod d1/db/dda/de9/c114 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/863: read d0/df/f2e [246086,129785] 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/864: rmdir d0/df 39 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/944: symlink d0/d8/d11/d39/d63/l12d 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:0/815: creat d1/db/dda/de9/deb/d6d/db1/f115 x:0 0 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:7/821: truncate d0/d20/f5d 5390091 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/945: creat d0/d28/d3d/f12e x:0 0 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:5/838: dread d2/d6a/f70 [0,4194304] 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:5/839: dread - d2/d38/f115 zero size 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/946: creat d0/d8/d89/f12f x:0 0 0 2024-04-18T21:07:02.465 INFO:tasks.workunit.client.0.smithi096.stdout:0/816: link d1/d23/d32/cf8 d1/d23/d32/daf/c116 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:9/947: mkdir d0/d28/d7a/dc3/d43/d130 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:0/817: creat d1/db/dda/de9/deb/d6d/f117 x:0 0 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:9/948: creat d0/d28/d7a/dc3/f131 x:0 0 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:4/881: read f0 [3788505,38185] 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:0/818: mkdir d1/db/d30/d31/d118 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:9/949: unlink d0/dc/d5f/f127 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:4/882: chown d2/d1d/d3a/f52 56612 1 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:7/822: dwrite d0/d11/d18/faf [4194304,4194304] 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:1/865: dread d0/ffd [0,4194304] 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:4/883: rmdir d2/d2f/d33/d55/da3 39 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:7/823: chown d0/d7/d8/f1e 402671 1 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:4/884: mkdir d2/d124 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:1/866: chown d0/df/d16/d6c/d106/d90/fd3 1436 1 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:0/819: rename d1/db/dda/de9/deb/d5d/d60/df6/f108 to d1/d23/d32/d43/f119 0 2024-04-18T21:07:02.466 INFO:tasks.workunit.client.0.smithi096.stdout:5/840: dwrite d2/d18/d9d/da0/dcb/f126 [0,4194304] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:8/869: dwrite d0/d5d/ff8 [0,4194304] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:7/824: chown d0/d7/d8/f16 1 1 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:4/885: mkdir d2/d2f/d33/d55/de0/d125 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:0/820: write d1/db/d30/d31/d65/f94 [118958,79990] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/867: write d0/df/d16/f19 [2526098,85447] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:9/950: dwrite d0/d28/d7a/f8a [0,4194304] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:4/886: fsync d2/d2f/d33/f3b 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/856: dread d1/d3a/d57/d66/d80/fbf [0,4194304] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/857: fsync d1/d5/da/d55/f11a 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/858: write d1/d5/da/d44/fed [1726287,10289] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:7/825: rename d0/d20/d62/l100 to d0/d20/d62/d7d/dee/l10e 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/859: fsync d1/d61/d91/fd6 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:5/841: dwrite d2/d18/d9d/da0/dcb/f10e [0,4194304] 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:4/887: rename d2/d2f/d39/d43/fc1 to d2/d2f/d39/d43/d103/d119/f126 0 2024-04-18T21:07:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:5/842: write d2/f106 [3222100,11397] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/843: fsync d2/d6a/faa 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:8/870: dwrite d0/d3/d1d/d83/dcd/d7f/f112 [0,4194304] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:9/951: dwrite d0/d28/d3d/fcc [0,4194304] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/821: dwrite d1/db/d30/d31/f71 [0,4194304] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/844: mkdir d2/d18/d9d/da0/d128 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:8/871: creat d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b/f122 x:0 0 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/822: chown d1/de8/ffd 1 1 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:7/826: dread d0/d7/d42/f74 [0,4194304] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/845: dread - d2/d18/d61/d6f/d7a/f10c zero size 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:9/952: mkdir d0/dc/d5f/d76/d132 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:7/827: write d0/d7/d8/f1a [3788640,51063] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/823: chown d1/db/d30/d31/d85/c61 5979463 1 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:1/868: dread d0/df/de5/df8/d95/fbd [0,4194304] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:6/860: dwrite d1/d3a/d36/f51 [4194304,4194304] 0 2024-04-18T21:07:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/824: write d1/db/d30/d31/f3b [3701169,19690] 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:1/869: creat d0/df/d16/d24/dac/d6a/df4/f11d x:0 0 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:6/861: creat d1/d61/f121 x:0 0 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:1/870: chown d0/df/d16/d24 0 1 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:3/727: dread d4/d6/d22/d20/f3f [0,4194304] 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:1/871: mknod d0/df/d16/d24/dac/d6a/df4/c11e 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:6/862: dwrite d1/d5/f5f [0,4194304] 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:9/953: dwrite d0/d28/d7a/dc3/d43/fa2 [0,4194304] 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:9/954: write d0/d8/f71 [846816,102627] 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:1/872: dwrite d0/df/d16/d24/dc0/d5f/f51 [4194304,4194304] 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:6/863: mkdir d1/d5/da/d46/d71/d7c/d8b/d10e/d122 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:4/888: truncate d2/d1d/d3a/fbc 742145 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:8/872: truncate d0/d3/d1d/d83/dcd/d7f/dac/d1b/f87 30163 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:3/728: truncate d4/d8/f74 3887856 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:6/864: creat d1/d5/da/d46/f123 x:0 0 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:3/729: stat d4/d6/d1b/d63/fd2 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi096.stdout:8/873: write d0/d3/f49 [1035535,92394] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:6/865: write d1/d3a/d57/d66/d9b/d9f/fb0 [4319606,4698] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:8/874: creat d0/d3/d3a/dab/d46/d78/f123 x:0 0 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:3/730: truncate d4/d6/d1b/d1d/f7a 1227828 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:6/866: mknod d1/c124 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:3/731: unlink d4/d6/d1b/d1d/l30 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:6/867: mkdir d1/d61/d91/d125 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:1/873: dwrite d0/f44 [0,4194304] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:3/732: rename d4/d6/d1b/d2c/d31/d85/fb5 to d4/d6/d1b/d2c/d31/d11/fd6 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:3/733: chown d4/d6/d1b/d63/la5 2 1 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:1/874: creat d0/df/de5/df8/f11f x:0 0 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:3/734: write d4/d6/d1b/d2c/d31/d11/f55 [4042636,130094] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:5/846: dread d2/d18/d9d/da0/fc7 [0,4194304] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:9/955: write d0/dc/d5f/fe8 [652603,129750] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:5/847: dread - d2/d6a/f105 zero size 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:9/956: creat d0/d44/f133 x:0 0 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/875: dwrite d0/df/d62/f114 [0,4194304] 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/876: mkdir d0/df/de5/d120 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:3/735: dwrite d4/d6/d1b/d2c/d6b/d99/da6/f78 [0,4194304] 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/877: mkdir d0/df/d16/d24/d121 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:3/736: creat d4/d8/d49/d9e/fd7 x:0 0 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/878: dread - d0/df/d16/d24/dc0/d5f/fcd zero size 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:8/875: dread d0/d3/fd [0,4194304] 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/879: rename d0/df/d62/c8a to d0/dd0/df6/c122 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:8/876: stat d0/d3/d1d 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:9/957: dwrite d0/dc/d5f/d76/fe9 [0,4194304] 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:1/880: symlink d0/df/d16/d24/dc0/l123 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:9/958: dread d0/d28/da1/f6e [0,4194304] 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:3/737: truncate d4/d6/d1b/d2c/f57 2084193 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:9/959: creat d0/d8/d9/f134 x:0 0 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:7/828: dread d0/d11/f17 [4194304,4194304] 0 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/960: fdatasync d0/d28/d66/db2/f12a 0 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:8/877: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d1b/f1f [0,4194304] 0 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:1/881: dwrite d0/df/d62/f83 [0,4194304] 0 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:1/882: mknod d0/df/d62/db1/c124 0 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:1/883: mknod d0/df/de5/d120/c125 0 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:3/738: dwrite d4/d6/d7/f10 [0,4194304] 0 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi096.stdout:8/878: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d33/de2/ff5 [0,4194304] 0 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi096.stdout:4/889: dread d2/d2f/d33/d55/d59/d5f/dcd/fcf [0,4194304] 0 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi096.stdout:4/890: fsync d2/f2c 0 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi096.stdout:8/879: link d0/d3/d1d/d83/dcd/d7f/dac/f2a d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b/f124 0 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi096.stdout:8/880: chown d0/d3/f49 1898496923 1 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi096.stdout:8/881: creat d0/d3/d1d/dca/f125 x:0 0 0 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:6/868: sync 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:1/884: sync 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:8/882: creat d0/d3/d1d/d102/f126 x:0 0 0 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:1/885: mknod d0/dd0/c126 0 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:6/869: dread - d1/d3a/d57/d66/d80/fce zero size 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:8/883: chown d0/d3/d1d/dca 593 1 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:0/825: dread d1/f75 [0,4194304] 0 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:6/870: readlink d1/d3a/d57/d66/d114/l11e 0 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:0/826: chown d1/d23/d32/d43/d6f/d8a/d91/fc2 0 1 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:8/884: link d0/d3/d1d/dca/f125 d0/d3/d3a/f127 0 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:0/827: chown d1/d23/d32/d43/d6f/cd6 110 1 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:3/739: sync 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:7/829: sync 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/886: sync 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:8/885: getdents d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/d10e 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/740: creat d4/d6/d22/d20/d46/d50/daa/fd8 x:0 0 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/887: write d0/df/de5/df8/d9b/dca/ff5 [3228572,57595] 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/741: creat d4/d6/dbb/fd9 x:0 0 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/888: write d0/df/f64 [2520975,47722] 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/742: dread - d4/d6/d1b/d2c/d6b/d99/da6/f9f zero size 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:6/871: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:6/872: sync 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/889: write d0/df/d16/d24/dac/d6a/df4/f11d [180653,91923] 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/743: creat d4/d8/d7f/d94/fda x:0 0 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:6/873: rmdir d1/d5/da/d46 39 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/890: creat d0/df/d16/d24/dc0/f127 x:0 0 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:6/874: mknod d1/d3a/d36/d107/c126 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:1/891: mknod d0/df/d16/d6c/dab/c128 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/744: write d4/d6/d1b/d2c/d31/d11/f40 [166539,56430] 0 2024-04-18T21:07:02.478 INFO:tasks.workunit.client.0.smithi096.stdout:6/875: fdatasync d1/d3a/d36/d7a/f11f 0 2024-04-18T21:07:02.478 INFO:tasks.workunit.client.0.smithi096.stdout:8/886: dwrite d0/d3/d1d/d83/dcd/dc6/fc8 [0,4194304] 0 2024-04-18T21:07:02.478 INFO:tasks.workunit.client.0.smithi096.stdout:3/745: write d4/d6/d1b/d2c/d31/d11/f40 [768365,37435] 0 2024-04-18T21:07:02.482 INFO:tasks.workunit.client.0.smithi096.stdout:3/746: truncate d4/d6/d1b/d2c/f5a 2759288 0 2024-04-18T21:07:02.482 INFO:tasks.workunit.client.0.smithi096.stdout:1/892: dwrite d0/df/d16/f50 [0,4194304] 0 2024-04-18T21:07:02.484 INFO:tasks.workunit.client.0.smithi096.stdout:8/887: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 [0,4194304] 0 2024-04-18T21:07:02.485 INFO:tasks.workunit.client.0.smithi096.stdout:6/876: dwrite d1/d3a/f53 [0,4194304] 0 2024-04-18T21:07:02.486 INFO:tasks.workunit.client.0.smithi096.stdout:6/877: write d1/d5/f5d [629670,120408] 0 2024-04-18T21:07:02.486 INFO:tasks.workunit.client.0.smithi096.stdout:8/888: getdents d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b 0 2024-04-18T21:07:02.487 INFO:tasks.workunit.client.0.smithi096.stdout:6/878: symlink d1/d3a/d36/d7a/l127 0 2024-04-18T21:07:02.489 INFO:tasks.workunit.client.0.smithi096.stdout:6/879: write d1/d61/d91/dd1/fd4 [175376,6873] 0 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi096.stdout:6/880: write d1/d3a/d57/de3/fa6 [1591546,73140] 0 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi096.stdout:3/747: dwrite d4/d6/d1b/d2c/d31/d85/fc4 [0,4194304] 0 2024-04-18T21:07:02.494 INFO:tasks.workunit.client.0.smithi096.stdout:8/889: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d1b/f20 [4194304,4194304] 0 2024-04-18T21:07:02.497 INFO:tasks.workunit.client.0.smithi096.stdout:6/881: dwrite d1/d3a/d36/f8e [4194304,4194304] 0 2024-04-18T21:07:02.499 INFO:tasks.workunit.client.0.smithi096.stdout:3/748: dwrite d4/d6/d1b/d2c/d5c/f91 [0,4194304] 0 2024-04-18T21:07:02.499 INFO:tasks.workunit.client.0.smithi096.stdout:3/749: readlink d4/d6/l51 0 2024-04-18T21:07:02.501 INFO:tasks.workunit.client.0.smithi096.stdout:3/750: mkdir d4/d6/d1b/d2c/d5c/ddb 0 2024-04-18T21:07:02.502 INFO:tasks.workunit.client.0.smithi096.stdout:3/751: mkdir d4/d6/d1b/d2c/d31/d85/ddc 0 2024-04-18T21:07:02.503 INFO:tasks.workunit.client.0.smithi096.stdout:8/890: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/fbc [0,4194304] 0 2024-04-18T21:07:02.503 INFO:tasks.workunit.client.0.smithi096.stdout:3/752: mknod d4/d8/d49/cdd 0 2024-04-18T21:07:02.503 INFO:tasks.workunit.client.0.smithi096.stdout:3/753: fsync d4/d6/d7/fac 0 2024-04-18T21:07:02.504 INFO:tasks.workunit.client.0.smithi096.stdout:8/891: write d0/d3/d3a/dab/f118 [727771,50878] 0 2024-04-18T21:07:02.504 INFO:tasks.workunit.client.0.smithi096.stdout:3/754: readlink d4/d6/d1b/d2c/d31/d11/l7c 0 2024-04-18T21:07:02.504 INFO:tasks.workunit.client.0.smithi096.stdout:3/755: stat d4/d6/d22 0 2024-04-18T21:07:02.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/756: truncate d4/d6/d1b/d2c/f53 546991 0 2024-04-18T21:07:02.506 INFO:tasks.workunit.client.0.smithi096.stdout:3/757: chown d4/l9d 1273867 1 2024-04-18T21:07:02.517 INFO:tasks.workunit.client.0.smithi096.stdout:1/893: read d0/f7 [4626114,101606] 0 2024-04-18T21:07:02.518 INFO:tasks.workunit.client.0.smithi096.stdout:1/894: readlink d0/df/d16/d24/da8/lce 0 2024-04-18T21:07:02.519 INFO:tasks.workunit.client.0.smithi096.stdout:1/895: dread d0/dd0/df6/fd4 [0,4194304] 0 2024-04-18T21:07:02.525 INFO:tasks.workunit.client.0.smithi096.stdout:1/896: dwrite d0/df/de5/df8/d95/fba [0,4194304] 0 2024-04-18T21:07:02.526 INFO:tasks.workunit.client.0.smithi096.stdout:1/897: chown d0/df/d16/d24 1565 1 2024-04-18T21:07:02.527 INFO:tasks.workunit.client.0.smithi096.stdout:1/898: rmdir d0/df/de5/df8/d9b/dca/dde 39 2024-04-18T21:07:02.528 INFO:tasks.workunit.client.0.smithi096.stdout:1/899: stat d0/df/d16/d24/da8/f108 0 2024-04-18T21:07:02.528 INFO:tasks.workunit.client.0.smithi096.stdout:0/828: dread d1/da3/fc5 [0,4194304] 0 2024-04-18T21:07:02.529 INFO:tasks.workunit.client.0.smithi096.stdout:0/829: stat d1/d23/d32/d43/d6f/dd3/ced 0 2024-04-18T21:07:02.530 INFO:tasks.workunit.client.0.smithi096.stdout:0/830: creat d1/da3/dde/f11a x:0 0 0 2024-04-18T21:07:02.530 INFO:tasks.workunit.client.0.smithi096.stdout:1/900: truncate d0/df/d16/d24/dac/dd2/fe8 579355 0 2024-04-18T21:07:02.530 INFO:tasks.workunit.client.0.smithi096.stdout:1/901: write d0/df/d30/f4e [2497396,88656] 0 2024-04-18T21:07:02.531 INFO:tasks.workunit.client.0.smithi096.stdout:0/831: getdents d1/db/dda/de9/deb/d6d 0 2024-04-18T21:07:02.533 INFO:tasks.workunit.client.0.smithi096.stdout:7/830: dread d0/d20/f34 [0,4194304] 0 2024-04-18T21:07:02.533 INFO:tasks.workunit.client.0.smithi096.stdout:0/832: stat d1/d23/d32/d43/d6f/d8a/d96/c9c 0 2024-04-18T21:07:02.534 INFO:tasks.workunit.client.0.smithi096.stdout:0/833: rename d1/db/dda/de9/cea to d1/d23/d32/d43/d6f/dd3/c11b 0 2024-04-18T21:07:02.535 INFO:tasks.workunit.client.0.smithi096.stdout:0/834: sync 2024-04-18T21:07:02.536 INFO:tasks.workunit.client.0.smithi096.stdout:0/835: readlink d1/d23/d32/d7d/l9a 0 2024-04-18T21:07:02.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:02.534+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:02.537 INFO:tasks.workunit.client.0.smithi096.stdout:0/836: rename d1/db/d30/d4a/d67/ca2 to d1/d23/d32/d43/d6f/d8a/d96/db4/c11c 0 2024-04-18T21:07:02.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/831: dwrite d0/d20/d62/dca/fbb [0,4194304] 0 2024-04-18T21:07:02.538 INFO:tasks.workunit.client.0.smithi096.stdout:0/837: fsync d1/db/d25/f99 0 2024-04-18T21:07:02.539 INFO:tasks.workunit.client.0.smithi096.stdout:0/838: chown d1/db/d30/f87 34892 1 2024-04-18T21:07:02.539 INFO:tasks.workunit.client.0.smithi096.stdout:7/832: mkdir d0/d20/d62/dca/dae/d10f 0 2024-04-18T21:07:02.539 INFO:tasks.workunit.client.0.smithi096.stdout:0/839: creat d1/d23/f11d x:0 0 0 2024-04-18T21:07:02.540 INFO:tasks.workunit.client.0.smithi096.stdout:7/833: mknod d0/d11/d18/c110 0 2024-04-18T21:07:02.540 INFO:tasks.workunit.client.0.smithi096.stdout:0/840: creat d1/db/dda/de9/deb/d5d/d60/f11e x:0 0 0 2024-04-18T21:07:02.540 INFO:tasks.workunit.client.0.smithi096.stdout:7/834: mkdir d0/d7/d2f/d63/dc4/d104/d111 0 2024-04-18T21:07:02.541 INFO:tasks.workunit.client.0.smithi096.stdout:3/758: truncate d4/d6/d1b/d2c/f53 369266 0 2024-04-18T21:07:02.541 INFO:tasks.workunit.client.0.smithi096.stdout:0/841: fdatasync d1/d23/d32/d43/d6f/d8a/d96/db4/fc4 0 2024-04-18T21:07:02.542 INFO:tasks.workunit.client.0.smithi096.stdout:3/759: creat d4/d6/d1b/d2c/d31/d85/ddc/fde x:0 0 0 2024-04-18T21:07:02.544 INFO:tasks.workunit.client.0.smithi096.stdout:3/760: write d4/d6/d22/d20/d46/d50/daa/fd8 [400649,87834] 0 2024-04-18T21:07:02.544 INFO:tasks.workunit.client.0.smithi096.stdout:3/761: symlink d4/d6/d7/db8/ldf 0 2024-04-18T21:07:02.548 INFO:tasks.workunit.client.0.smithi096.stdout:6/882: read d1/d5/da/d46/d71/f7f [406952,115476] 0 2024-04-18T21:07:02.549 INFO:tasks.workunit.client.0.smithi096.stdout:3/762: dwrite d4/d6/d1b/d2c/d31/f9b [4194304,4194304] 0 2024-04-18T21:07:02.549 INFO:tasks.workunit.client.0.smithi096.stdout:6/883: write d1/d3a/f53 [3085132,117625] 0 2024-04-18T21:07:02.550 INFO:tasks.workunit.client.0.smithi096.stdout:6/884: chown d1/d3a/d36/f8e 79 1 2024-04-18T21:07:02.550 INFO:tasks.workunit.client.0.smithi096.stdout:9/961: dread d0/d8/d11/f79 [0,4194304] 0 2024-04-18T21:07:02.551 INFO:tasks.workunit.client.0.smithi096.stdout:5/848: dread d2/d18/d61/fbf [0,4194304] 0 2024-04-18T21:07:02.551 INFO:tasks.workunit.client.0.smithi096.stdout:6/885: unlink d1/d3a/d36/d7a/fb2 0 2024-04-18T21:07:02.551 INFO:tasks.workunit.client.0.smithi096.stdout:3/763: link d4/d6/d1b/d2c/d6b/d99/da6/f69 d4/d6/d1b/d2c/d31/d93/fe0 0 2024-04-18T21:07:02.552 INFO:tasks.workunit.client.0.smithi096.stdout:5/849: mkdir d2/d11/d129 0 2024-04-18T21:07:02.552 INFO:tasks.workunit.client.0.smithi096.stdout:9/962: mknod d0/dc/d5f/c135 0 2024-04-18T21:07:02.552 INFO:tasks.workunit.client.0.smithi096.stdout:3/764: creat d4/d6/d1b/d2c/d31/d93/fe1 x:0 0 0 2024-04-18T21:07:02.552 INFO:tasks.workunit.client.0.smithi096.stdout:5/850: write d2/d11/d28/d64/ff3 [609448,77619] 0 2024-04-18T21:07:02.553 INFO:tasks.workunit.client.0.smithi096.stdout:5/851: write d2/d11/d28/d4a/d55/d81/f9c [1278172,31776] 0 2024-04-18T21:07:02.553 INFO:tasks.workunit.client.0.smithi096.stdout:6/886: link d1/d5/da/d46/d71/d7c/l86 d1/d3a/d36/d7a/d102/l128 0 2024-04-18T21:07:02.554 INFO:tasks.workunit.client.0.smithi096.stdout:6/887: sync 2024-04-18T21:07:02.554 INFO:tasks.workunit.client.0.smithi096.stdout:5/852: mkdir d2/d18/d11d/d12a 0 2024-04-18T21:07:02.554 INFO:tasks.workunit.client.0.smithi096.stdout:6/888: rmdir d1/d3a/d36 39 2024-04-18T21:07:02.555 INFO:tasks.workunit.client.0.smithi096.stdout:5/853: mkdir d2/d18/d9d/d12b 0 2024-04-18T21:07:02.555 INFO:tasks.workunit.client.0.smithi096.stdout:6/889: creat d1/d61/f129 x:0 0 0 2024-04-18T21:07:02.555 INFO:tasks.workunit.client.0.smithi096.stdout:1/902: truncate d0/df/d16/f54 1089374 0 2024-04-18T21:07:02.556 INFO:tasks.workunit.client.0.smithi096.stdout:7/835: getdents d0/d7/d2f/d63/dc4/d104 0 2024-04-18T21:07:02.556 INFO:tasks.workunit.client.0.smithi096.stdout:7/836: readlink d0/d7/d2f/d63/l107 0 2024-04-18T21:07:02.556 INFO:tasks.workunit.client.0.smithi096.stdout:6/890: mkdir d1/d5/da/d44/d12a 0 2024-04-18T21:07:02.557 INFO:tasks.workunit.client.0.smithi096.stdout:5/854: write d2/d11/d28/d4a/d55/d81/ddf/de5/f114 [270150,18140] 0 2024-04-18T21:07:02.557 INFO:tasks.workunit.client.0.smithi096.stdout:7/837: chown d0/d20/f34 10496352 1 2024-04-18T21:07:02.557 INFO:tasks.workunit.client.0.smithi096.stdout:6/891: write d1/f41 [5689949,66240] 0 2024-04-18T21:07:02.558 INFO:tasks.workunit.client.0.smithi096.stdout:5/855: stat d2/d11/d28/d4a/d55/l8e 0 2024-04-18T21:07:02.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/838: write d0/d7/d8/f1e [2642324,80] 0 2024-04-18T21:07:02.558 INFO:tasks.workunit.client.0.smithi096.stdout:5/856: rename d2/l1e to d2/l12c 0 2024-04-18T21:07:02.558 INFO:tasks.workunit.client.0.smithi096.stdout:7/839: symlink d0/d20/d62/dca/l112 0 2024-04-18T21:07:02.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/857: mknod d2/d18/d9d/da0/c12d 0 2024-04-18T21:07:02.559 INFO:tasks.workunit.client.0.smithi096.stdout:7/840: chown d0/fc 6392 1 2024-04-18T21:07:02.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/841: write d0/d20/d39/d59/fba [1302198,28670] 0 2024-04-18T21:07:02.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/842: mknod d0/d7/c113 0 2024-04-18T21:07:02.561 INFO:tasks.workunit.client.0.smithi096.stdout:7/843: creat d0/d20/d62/d7d/dee/f114 x:0 0 0 2024-04-18T21:07:02.561 INFO:tasks.workunit.client.0.smithi096.stdout:0/842: write d1/db/dda/de9/deb/f101 [1928947,77033] 0 2024-04-18T21:07:02.562 INFO:tasks.workunit.client.0.smithi096.stdout:0/843: mkdir d1/de8/d11f 0 2024-04-18T21:07:02.562 INFO:tasks.workunit.client.0.smithi096.stdout:7/844: mknod d0/d20/c115 0 2024-04-18T21:07:02.562 INFO:tasks.workunit.client.0.smithi096.stdout:0/844: fsync d1/db/d25/fb0 0 2024-04-18T21:07:02.564 INFO:tasks.workunit.client.0.smithi096.stdout:0/845: link d1/db/d30/d4a/dae/dcf/fdc d1/d23/d32/d43/dfb/f120 0 2024-04-18T21:07:02.566 INFO:tasks.workunit.client.0.smithi096.stdout:0/846: dread d1/db/dda/de9/deb/d82/ff2 [0,4194304] 0 2024-04-18T21:07:02.566 INFO:tasks.workunit.client.0.smithi096.stdout:8/892: dread d0/d3/d1d/d83/dcd/d7f/dac/d1b/fe0 [0,4194304] 0 2024-04-18T21:07:02.567 INFO:tasks.workunit.client.0.smithi096.stdout:8/893: creat d0/d3/d3a/d81/f128 x:0 0 0 2024-04-18T21:07:02.567 INFO:tasks.workunit.client.0.smithi096.stdout:0/847: getdents d1/d23/d32/d43/d6f/d8a/d91/dba/dee 0 2024-04-18T21:07:02.568 INFO:tasks.workunit.client.0.smithi096.stdout:8/894: mkdir d0/d3/d1d/d66/d10a/d129 0 2024-04-18T21:07:02.569 INFO:tasks.workunit.client.0.smithi096.stdout:0/848: creat d1/da5/f121 x:0 0 0 2024-04-18T21:07:02.570 INFO:tasks.workunit.client.0.smithi096.stdout:8/895: write d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/f50 [2974966,45908] 0 2024-04-18T21:07:02.571 INFO:tasks.workunit.client.0.smithi096.stdout:8/896: chown d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b/f124 362918 1 2024-04-18T21:07:02.571 INFO:tasks.workunit.client.0.smithi096.stdout:3/765: dread d4/d6/d1b/d2c/d6b/d99/da6/f83 [0,4194304] 0 2024-04-18T21:07:02.572 INFO:tasks.workunit.client.0.smithi096.stdout:8/897: symlink d0/d3/d3a/dab/d46/l12a 0 2024-04-18T21:07:02.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/898: chown d0/la 18333 1 2024-04-18T21:07:02.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/899: sync 2024-04-18T21:07:02.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/963: dread d0/dc/d5f/d76/dc1/dee/f10e [0,4194304] 0 2024-04-18T21:07:02.574 INFO:tasks.workunit.client.0.smithi096.stdout:9/964: chown d0/d44/ld6 1227172 1 2024-04-18T21:07:02.575 INFO:tasks.workunit.client.0.smithi096.stdout:4/891: dread d2/f31 [0,4194304] 0 2024-04-18T21:07:02.575 INFO:tasks.workunit.client.0.smithi096.stdout:4/892: readlink d2/d2f/d39/le1 0 2024-04-18T21:07:02.578 INFO:tasks.workunit.client.0.smithi096.stdout:7/845: write d0/d7/f4d [2178265,1293] 0 2024-04-18T21:07:02.582 INFO:tasks.workunit.client.0.smithi096.stdout:3/766: write d4/d6/d1b/d63/fd2 [4077140,10725] 0 2024-04-18T21:07:02.583 INFO:tasks.workunit.client.0.smithi096.stdout:6/892: dwrite d1/d61/d91/fb1 [0,4194304] 0 2024-04-18T21:07:02.583 INFO:tasks.workunit.client.0.smithi096.stdout:7/846: link d0/d7/d2f/d63/l107 d0/l116 0 2024-04-18T21:07:02.583 INFO:tasks.workunit.client.0.smithi096.stdout:8/900: truncate d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 1791339 0 2024-04-18T21:07:02.583 INFO:tasks.workunit.client.0.smithi096.stdout:5/858: dwrite d2/d11/f52 [0,4194304] 0 2024-04-18T21:07:02.583 INFO:tasks.workunit.client.0.smithi096.stdout:9/965: dwrite d0/d28/d66/db2/f12a [0,4194304] 0 2024-04-18T21:07:02.583 INFO:tasks.workunit.client.0.smithi096.stdout:6/893: rmdir d1/d3a 39 2024-04-18T21:07:02.584 INFO:tasks.workunit.client.0.smithi096.stdout:1/903: dread d0/df/d16/d24/dc0/d5f/f51 [0,4194304] 0 2024-04-18T21:07:02.584 INFO:tasks.workunit.client.0.smithi096.stdout:9/966: chown d0/dc/f26 14 1 2024-04-18T21:07:02.585 INFO:tasks.workunit.client.0.smithi096.stdout:1/904: chown d0/df/de5/df8/d95/fbd 424827899 1 2024-04-18T21:07:02.585 INFO:tasks.workunit.client.0.smithi096.stdout:1/905: stat d0/df/d16/d24/f31 0 2024-04-18T21:07:02.585 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:02.585 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:02.586 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:02.586 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:02.586 INFO:tasks.workunit.client.0.smithi096.stdout:7/847: creat d0/d20/d62/dca/f117 x:0 0 0 2024-04-18T21:07:02.586 INFO:tasks.workunit.client.0.smithi096.stdout:8/901: mknod d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/c12b 0 2024-04-18T21:07:02.586 INFO:tasks.workunit.client.0.smithi096.stdout:3/767: creat d4/d6/d1b/d2c/d31/d11/d8c/fe2 x:0 0 0 2024-04-18T21:07:02.586 INFO:tasks.workunit.client.0.smithi096.stdout:9/967: rename d0/d8/fc2 to d0/d28/d7a/f136 0 2024-04-18T21:07:02.587 INFO:tasks.workunit.client.0.smithi096.stdout:3/768: stat d4/d6/d1b/d2c/c65 0 2024-04-18T21:07:02.587 INFO:tasks.workunit.client.0.smithi096.stdout:7/848: write d0/d7/f48 [1858774,66862] 0 2024-04-18T21:07:02.588 INFO:tasks.workunit.client.0.smithi096.stdout:9/968: truncate d0/d28/d66/db2/f11a 1001081 0 2024-04-18T21:07:02.588 INFO:tasks.workunit.client.0.smithi096.stdout:3/769: mknod d4/d8/d7f/ce3 0 2024-04-18T21:07:02.588 INFO:tasks.workunit.client.0.smithi096.stdout:1/906: getdents d0 0 2024-04-18T21:07:02.588 INFO:tasks.workunit.client.0.smithi096.stdout:5/859: getdents d2/d18/d9d/da0/dab/ded 0 2024-04-18T21:07:02.589 INFO:tasks.workunit.client.0.smithi096.stdout:9/969: rmdir d0/d8/d11/d48/d122 0 2024-04-18T21:07:02.590 INFO:tasks.workunit.client.0.smithi096.stdout:9/970: mkdir d0/dc/d5f/d76/dd5/d137 0 2024-04-18T21:07:02.593 INFO:tasks.workunit.client.0.smithi096.stdout:0/849: dread d1/db/dda/de9/deb/f101 [0,4194304] 0 2024-04-18T21:07:02.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/770: dwrite d4/d8/f3d [4194304,4194304] 0 2024-04-18T21:07:02.595 INFO:tasks.workunit.client.0.smithi096.stdout:0/850: link d1/f6a d1/db/d30/d31/d85/f122 0 2024-04-18T21:07:02.596 INFO:tasks.workunit.client.0.smithi096.stdout:3/771: symlink d4/d6/d7/d90/le4 0 2024-04-18T21:07:02.597 INFO:tasks.workunit.client.0.smithi096.stdout:0/851: mknod d1/d23/d32/d43/d6f/d8a/d96/c123 0 2024-04-18T21:07:02.599 INFO:tasks.workunit.client.0.smithi096.stdout:5/860: write d2/d38/d4c/f9f [1040844,86711] 0 2024-04-18T21:07:02.599 INFO:tasks.workunit.client.0.smithi096.stdout:0/852: readlink d1/db/d30/d31/d85/d58/l8c 0 2024-04-18T21:07:02.600 INFO:tasks.workunit.client.0.smithi096.stdout:7/849: dwrite d0/d20/d39/dda/fe9 [0,4194304] 0 2024-04-18T21:07:02.600 INFO:tasks.workunit.client.0.smithi096.stdout:8/902: dwrite d0/d3/d3a/f127 [0,4194304] 0 2024-04-18T21:07:02.600 INFO:tasks.workunit.client.0.smithi096.stdout:5/861: chown d2/d11/d28/d64/f6c 214 1 2024-04-18T21:07:02.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/853: mkdir d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/d124 0 2024-04-18T21:07:02.602 INFO:tasks.workunit.client.0.smithi096.stdout:5/862: truncate d2/d18/d61/d6f/d7a/ffd 592734 0 2024-04-18T21:07:02.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/850: getdents d0/d11/d18 0 2024-04-18T21:07:02.603 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:02.604 INFO:tasks.workunit.client.0.smithi096.stdout:7/851: mkdir d0/d7/d42/d118 0 2024-04-18T21:07:02.604 INFO:tasks.workunit.client.0.smithi096.stdout:7/852: rename d0/d11/d18/c110 to d0/d7/d2f/d63/dd3/c119 0 2024-04-18T21:07:02.606 INFO:tasks.workunit.client.0.smithi096.stdout:7/853: symlink d0/d20/d62/dca/dd6/l11a 0 2024-04-18T21:07:02.608 INFO:tasks.workunit.client.0.smithi096.stdout:0/854: dwrite d1/db/d25/fe6 [0,4194304] 0 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/854: read d0/d7/d49/f4e [2167102,105156] 0 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi096.stdout:5/863: dwrite d2/d18/d61/d6f/d7a/ffd [0,4194304] 0 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/855: write d1/db/dda/de9/deb/fbb [841765,79012] 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:7/855: readlink d0/d20/d39/dda/lfb 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:0/856: readlink d1/db/d30/d31/d65/lbe 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:7/856: fsync d0/d20/d62/fc1 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/864: rename d2/d38/d4c/f5e to d2/d18/d9d/de8/f12e 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:0/857: mknod d1/db/c125 0 2024-04-18T21:07:02.611 INFO:tasks.workunit.client.0.smithi096.stdout:0/858: truncate d1/d23/d32/f76 1234848 0 2024-04-18T21:07:02.612 INFO:tasks.workunit.client.0.smithi096.stdout:5/865: rename d2/d9b/c127 to d2/d11/d28/d4a/d69/c12f 0 2024-04-18T21:07:02.612 INFO:tasks.workunit.client.0.smithi096.stdout:7/857: rename d0/d20/d62/d7d/dee/l10b to d0/d7/d2f/d63/dc4/d104/d111/l11b 0 2024-04-18T21:07:02.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/858: creat d0/d7/d42/f11c x:0 0 0 2024-04-18T21:07:02.613 INFO:tasks.workunit.client.0.smithi096.stdout:5/866: rename d2/d11/d28/d4a/d55/d81/c10b to d2/d38/d4c/c130 0 2024-04-18T21:07:02.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/859: truncate d0/d20/d62/fd0 769294 0 2024-04-18T21:07:02.615 INFO:tasks.workunit.client.0.smithi096.stdout:7/860: mknod d0/d20/d62/c11d 0 2024-04-18T21:07:02.618 INFO:tasks.workunit.client.0.smithi096.stdout:4/893: dread d2/f9 [0,4194304] 0 2024-04-18T21:07:02.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/867: fsync d2/d18/d9d/de8/f12e 0 2024-04-18T21:07:02.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/859: dwrite d1/d23/d32/d43/d6f/d8a/d91/dba/dee/ff9 [0,4194304] 0 2024-04-18T21:07:02.619 INFO:tasks.workunit.client.0.smithi096.stdout:4/894: fdatasync d2/d1d/fb5 0 2024-04-18T21:07:02.619 INFO:tasks.workunit.client.0.smithi096.stdout:5/868: chown d2/d11/l30 2641 1 2024-04-18T21:07:02.622 INFO:tasks.workunit.client.0.smithi096.stdout:0/860: getdents d1/db/d30/d31 0 2024-04-18T21:07:02.639 INFO:tasks.workunit.client.0.smithi096.stdout:9/971: dread d0/dc/d5f/d76/f84 [0,4194304] 0 2024-04-18T21:07:02.639 INFO:tasks.workunit.client.0.smithi096.stdout:9/972: mkdir d0/d28/da1/d138 0 2024-04-18T21:07:02.640 INFO:tasks.workunit.client.0.smithi096.stdout:9/973: fdatasync d0/dc/d5f/f68 0 2024-04-18T21:07:02.644 INFO:tasks.workunit.client.0.smithi096.stdout:6/894: dread d1/d5/da/fc [0,4194304] 0 2024-04-18T21:07:02.646 INFO:tasks.workunit.client.0.smithi096.stdout:9/974: read d0/d8/d11/d48/f4a [2974751,5944] 0 2024-04-18T21:07:02.646 INFO:tasks.workunit.client.0.smithi096.stdout:7/861: dread d0/d20/d62/dca/dd6/fdc [0,4194304] 0 2024-04-18T21:07:02.646 INFO:tasks.workunit.client.0.smithi096.stdout:3/772: dread d4/d6/d1b/d2c/d31/f41 [0,4194304] 0 2024-04-18T21:07:02.647 INFO:tasks.workunit.client.0.smithi096.stdout:9/975: creat d0/dc/d5f/f139 x:0 0 0 2024-04-18T21:07:02.647 INFO:tasks.workunit.client.0.smithi096.stdout:1/907: dread d0/df/d16/f19 [0,4194304] 0 2024-04-18T21:07:02.648 INFO:tasks.workunit.client.0.smithi096.stdout:7/862: creat d0/d7/d49/f11e x:0 0 0 2024-04-18T21:07:02.648 INFO:tasks.workunit.client.0.smithi096.stdout:0/861: dread d1/d23/d32/d43/fb5 [0,4194304] 0 2024-04-18T21:07:02.648 INFO:tasks.workunit.client.0.smithi096.stdout:9/976: dread - d0/d28/d7a/fc8 zero size 2024-04-18T21:07:02.648 INFO:tasks.workunit.client.0.smithi096.stdout:4/895: dread d2/f1f [4194304,4194304] 0 2024-04-18T21:07:02.649 INFO:tasks.workunit.client.0.smithi096.stdout:1/908: rmdir d0/df/d16 39 2024-04-18T21:07:02.649 INFO:tasks.workunit.client.0.smithi096.stdout:3/773: mknod d4/d6/d1b/d2c/d31/d11/d8c/ce5 0 2024-04-18T21:07:02.649 INFO:tasks.workunit.client.0.smithi096.stdout:0/862: mkdir d1/d23/d126 0 2024-04-18T21:07:02.650 INFO:tasks.workunit.client.0.smithi096.stdout:7/863: write d0/d20/d39/d8a/db4/fbc [1877249,86375] 0 2024-04-18T21:07:02.651 INFO:tasks.workunit.client.0.smithi096.stdout:3/774: read d4/d6/d22/d20/f3f [906690,113448] 0 2024-04-18T21:07:02.651 INFO:tasks.workunit.client.0.smithi096.stdout:1/909: dread - d0/df/d16/d24/dc0/d5f/fcd zero size 2024-04-18T21:07:02.652 INFO:tasks.workunit.client.0.smithi096.stdout:4/896: link d2/d2a/c8d d2/d2f/d39/d43/c127 0 2024-04-18T21:07:02.652 INFO:tasks.workunit.client.0.smithi096.stdout:6/895: dwrite d1/d61/fc5 [0,4194304] 0 2024-04-18T21:07:02.653 INFO:tasks.workunit.client.0.smithi096.stdout:1/910: fdatasync d0/df/d16/d24/dc0/f73 0 2024-04-18T21:07:02.653 INFO:tasks.workunit.client.0.smithi096.stdout:8/903: dread d0/d3/d1d/d102/d115/f36 [0,4194304] 0 2024-04-18T21:07:02.655 INFO:tasks.workunit.client.0.smithi096.stdout:6/896: unlink d1/d17/lff 0 2024-04-18T21:07:02.655 INFO:tasks.workunit.client.0.smithi096.stdout:1/911: mknod d0/dd0/ddb/c129 0 2024-04-18T21:07:02.655 INFO:tasks.workunit.client.0.smithi096.stdout:4/897: creat d2/dbb/dde/d112/f128 x:0 0 0 2024-04-18T21:07:02.656 INFO:tasks.workunit.client.0.smithi096.stdout:8/904: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/f12c x:0 0 0 2024-04-18T21:07:02.656 INFO:tasks.workunit.client.0.smithi096.stdout:1/912: creat d0/df/d62/d110/f12a x:0 0 0 2024-04-18T21:07:02.656 INFO:tasks.workunit.client.0.smithi096.stdout:8/905: write d0/d64/f6d [4047129,1765] 0 2024-04-18T21:07:02.657 INFO:tasks.workunit.client.0.smithi096.stdout:4/898: chown d2/d2f/d33/d55/d57/f5c 0 1 2024-04-18T21:07:02.657 INFO:tasks.workunit.client.0.smithi096.stdout:8/906: rmdir d0/d3/d3a/dab/d46 39 2024-04-18T21:07:02.658 INFO:tasks.workunit.client.0.smithi096.stdout:6/897: dread d1/d3a/d36/fcc [0,4194304] 0 2024-04-18T21:07:02.658 INFO:tasks.workunit.client.0.smithi096.stdout:8/907: fdatasync d0/d3/d3a/dab/d61/f11f 0 2024-04-18T21:07:02.658 INFO:tasks.workunit.client.0.smithi096.stdout:4/899: write d2/f60 [1489261,2449] 0 2024-04-18T21:07:02.659 INFO:tasks.workunit.client.0.smithi096.stdout:6/898: mkdir d1/d3a/d57/d66/d9b/d9f/d12b 0 2024-04-18T21:07:02.659 INFO:tasks.workunit.client.0.smithi096.stdout:8/908: dread - d0/d3/d3a/dab/d46/dc5/f8b zero size 2024-04-18T21:07:02.659 INFO:tasks.workunit.client.0.smithi096.stdout:6/899: chown d1/d5/da/l24 1750682 1 2024-04-18T21:07:02.660 INFO:tasks.workunit.client.0.smithi096.stdout:8/909: unlink d0/d3/d1d/dca/le3 0 2024-04-18T21:07:02.661 INFO:tasks.workunit.client.0.smithi096.stdout:6/900: getdents d1/d61/d91/dd1 0 2024-04-18T21:07:02.661 INFO:tasks.workunit.client.0.smithi096.stdout:8/910: truncate d0/d64/f42 736816 0 2024-04-18T21:07:02.663 INFO:tasks.workunit.client.0.smithi096.stdout:6/901: creat d1/d3a/d57/d66/d80/dfb/dbb/f12c x:0 0 0 2024-04-18T21:07:02.663 INFO:tasks.workunit.client.0.smithi096.stdout:8/911: symlink d0/d3/d3a/dab/d61/l12d 0 2024-04-18T21:07:02.664 INFO:tasks.workunit.client.0.smithi096.stdout:8/912: write d0/d3/d3a/dab/d46/d78/f123 [532051,36520] 0 2024-04-18T21:07:02.664 INFO:tasks.workunit.client.0.smithi096.stdout:4/900: dwrite d2/d2f/d39/f4b [0,4194304] 0 2024-04-18T21:07:02.665 INFO:tasks.workunit.client.0.smithi096.stdout:6/902: rename d1/d3a/d57/d66/d67 to d1/d5/da/d46/d71/dbc/d12d 0 2024-04-18T21:07:02.665 INFO:tasks.workunit.client.0.smithi096.stdout:8/913: symlink d0/d3/d3a/l12e 0 2024-04-18T21:07:02.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/901: mknod d2/d2f/d33/d55/de0/d125/c129 0 2024-04-18T21:07:02.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/914: write d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/dd9/fe6 [901452,822] 0 2024-04-18T21:07:02.667 INFO:tasks.workunit.client.0.smithi096.stdout:3/775: read d4/d6/d1b/d1d/f2e [2134847,18569] 0 2024-04-18T21:07:02.668 INFO:tasks.workunit.client.0.smithi096.stdout:4/902: symlink d2/d2f/d39/d98/l12a 0 2024-04-18T21:07:02.668 INFO:tasks.workunit.client.0.smithi096.stdout:8/915: truncate d0/d3/d3a/d81/f128 551558 0 2024-04-18T21:07:02.668 INFO:tasks.workunit.client.0.smithi096.stdout:3/776: rmdir d4/d6/d7 39 2024-04-18T21:07:02.668 INFO:tasks.workunit.client.0.smithi096.stdout:8/916: chown d0/d3/d1d/d83/dcd/d7f/dac/d1b 24239213 1 2024-04-18T21:07:02.669 INFO:tasks.workunit.client.0.smithi096.stdout:3/777: fdatasync d4/d6/d1b/d1d/f7a 0 2024-04-18T21:07:02.669 INFO:tasks.workunit.client.0.smithi096.stdout:8/917: readlink d0/d3/d1d/d83/l11e 0 2024-04-18T21:07:02.670 INFO:tasks.workunit.client.0.smithi096.stdout:5/869: dread d2/d11/d28/f78 [0,4194304] 0 2024-04-18T21:07:02.670 INFO:tasks.workunit.client.0.smithi096.stdout:3/778: readlink d4/d6/d22/d20/d46/l71 0 2024-04-18T21:07:02.670 INFO:tasks.workunit.client.0.smithi096.stdout:8/918: mknod d0/d3/d3a/dab/c12f 0 2024-04-18T21:07:02.671 INFO:tasks.workunit.client.0.smithi096.stdout:3/779: mkdir d4/d8/d49/db3/db4/de6 0 2024-04-18T21:07:02.671 INFO:tasks.workunit.client.0.smithi096.stdout:8/919: fdatasync d0/d3/d1d/d83/dcd/dd1/dda/f119 0 2024-04-18T21:07:02.671 INFO:tasks.workunit.client.0.smithi096.stdout:8/920: chown d0/d3/fd 891374181 1 2024-04-18T21:07:02.671 INFO:tasks.workunit.client.0.smithi096.stdout:3/780: symlink d4/d8/d7f/d94/le7 0 2024-04-18T21:07:02.672 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:02.672 INFO:tasks.workunit.client.0.smithi096.stdout:8/921: truncate d0/d64/d43/f103 662317 0 2024-04-18T21:07:02.672 INFO:tasks.workunit.client.0.smithi096.stdout:3/781: dread - d4/d6/d1b/d2c/d31/d93/fe1 zero size 2024-04-18T21:07:02.674 INFO:tasks.workunit.client.0.smithi096.stdout:8/922: write d0/d3/d1d/d83/dcd/dc6/fc8 [2537226,93022] 0 2024-04-18T21:07:02.675 INFO:tasks.workunit.client.0.smithi096.stdout:4/903: truncate d2/d2f/d33/d55/d59/d5f/fce 96089 0 2024-04-18T21:07:02.675 INFO:tasks.workunit.client.0.smithi096.stdout:3/782: getdents d4/d6/d1b/d2c/d6b/d99/da6 0 2024-04-18T21:07:02.675 INFO:tasks.workunit.client.0.smithi096.stdout:8/923: readlink d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/lb6 0 2024-04-18T21:07:02.676 INFO:tasks.workunit.client.0.smithi096.stdout:8/924: fsync d0/d3/d1d/d83/dcd/d7f/f112 0 2024-04-18T21:07:02.676 INFO:tasks.workunit.client.0.smithi096.stdout:3/783: chown d4/d6/d7/db8 6 1 2024-04-18T21:07:02.676 INFO:tasks.workunit.client.0.smithi096.stdout:5/870: dwrite d2/d38/fa9 [0,4194304] 0 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi096.stdout:4/904: creat d2/d2f/d33/d55/d59/d5f/dcd/f12b x:0 0 0 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi096.stdout:3/784: mkdir d4/d6/d1b/d2c/d31/d4e/de8 0 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi096.stdout:5/871: read - d2/d18/d9d/da0/f11e zero size 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi096.stdout:3/785: stat d4/d6/d7/d90 0 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi096.stdout:5/872: stat d2/d18/d61 0 2024-04-18T21:07:02.679 INFO:tasks.workunit.client.0.smithi096.stdout:5/873: readlink d2/d11/d28/d4a/d55/d81/dbe/l11f 0 2024-04-18T21:07:02.679 INFO:tasks.workunit.client.0.smithi096.stdout:5/874: readlink d2/d11/d28/d4a/d69/l101 0 2024-04-18T21:07:02.680 INFO:tasks.workunit.client.0.smithi096.stdout:8/925: mknod d0/d3/d1d/d83/dcd/d7f/dac/d56/c130 0 2024-04-18T21:07:02.682 INFO:tasks.workunit.client.0.smithi096.stdout:8/926: chown d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b 17 1 2024-04-18T21:07:02.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/905: dwrite d2/d2f/d33/d55/de0/f10f [4194304,4194304] 0 2024-04-18T21:07:02.699 INFO:tasks.workunit.client.0.smithi096.stdout:4/906: dread d2/d2a/d54/d5b/d89/d90/ffa [0,4194304] 0 2024-04-18T21:07:02.705 INFO:tasks.workunit.client.0.smithi096.stdout:4/907: dwrite d2/d2f/d33/d55/da3/fa7 [0,4194304] 0 2024-04-18T21:07:02.706 INFO:tasks.workunit.client.0.smithi096.stdout:4/908: truncate d2/f19 1010263 0 2024-04-18T21:07:02.707 INFO:tasks.workunit.client.0.smithi096.stdout:4/909: write d2/d2f/d33/d55/d100/f121 [496111,33874] 0 2024-04-18T21:07:02.707 INFO:tasks.workunit.client.0.smithi096.stdout:4/910: chown d2/dbb/dde 3239 1 2024-04-18T21:07:02.712 INFO:tasks.workunit.client.0.smithi096.stdout:4/911: read d2/f18 [4970846,92391] 0 2024-04-18T21:07:02.713 INFO:tasks.workunit.client.0.smithi096.stdout:4/912: stat d2/d2f/d33/d55/d59/f96 0 2024-04-18T21:07:02.713 INFO:tasks.workunit.client.0.smithi096.stdout:4/913: truncate d2/d2f/fdd 826487 0 2024-04-18T21:07:02.715 INFO:tasks.workunit.client.0.smithi096.stdout:4/914: link d2/d2f/d33/c94 d2/d2f/d39/d98/c12c 0 2024-04-18T21:07:02.715 INFO:tasks.workunit.client.0.smithi096.stdout:4/915: stat d2/d2a/d54/l11d 0 2024-04-18T21:07:02.716 INFO:tasks.workunit.client.0.smithi096.stdout:4/916: truncate d2/d1d/fb5 1937739 0 2024-04-18T21:07:02.719 INFO:tasks.workunit.client.0.smithi096.stdout:5/875: dread d2/f44 [0,4194304] 0 2024-04-18T21:07:02.720 INFO:tasks.workunit.client.0.smithi096.stdout:5/876: rename d2/d18/d9d to d2/d11/d28/d4a/d131 0 2024-04-18T21:07:02.721 INFO:tasks.workunit.client.0.smithi096.stdout:4/917: dread d2/d2f/fb1 [0,4194304] 0 2024-04-18T21:07:02.722 INFO:tasks.workunit.client.0.smithi096.stdout:4/918: getdents d2/d2f/d33/d55/da3 0 2024-04-18T21:07:02.722 INFO:tasks.workunit.client.0.smithi096.stdout:4/919: chown d2/d2a/d54/d71/d99/dad 74939 1 2024-04-18T21:07:02.723 INFO:tasks.workunit.client.0.smithi096.stdout:4/920: write d2/d2f/d33/d55/d100/f121 [416682,97305] 0 2024-04-18T21:07:02.728 INFO:tasks.workunit.client.0.smithi096.stdout:4/921: dwrite d2/d2f/d33/d55/d59/db9/fc2 [0,4194304] 0 2024-04-18T21:07:02.730 INFO:tasks.workunit.client.0.smithi096.stdout:4/922: fsync d2/d2f/d33/fa0 0 2024-04-18T21:07:02.730 INFO:tasks.workunit.client.0.smithi096.stdout:4/923: read - d2/d2a/d54/fa1 zero size 2024-04-18T21:07:02.731 INFO:tasks.workunit.client.0.smithi096.stdout:4/924: write d2/f1f [4935301,27098] 0 2024-04-18T21:07:02.732 INFO:tasks.workunit.client.0.smithi096.stdout:4/925: creat d2/d2f/d39/d43/d103/f12d x:0 0 0 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:02.739 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:02.635+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:02.739 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:02.739+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:02.752 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:02.754 INFO:tasks.workunit.client.0.smithi096.stdout:4/926: dread d2/f21 [0,4194304] 0 2024-04-18T21:07:02.754 INFO:tasks.workunit.client.0.smithi096.stdout:4/927: mkdir d2/dbb/dde/d10b/d12e 0 2024-04-18T21:07:02.755 INFO:tasks.workunit.client.0.smithi096.stdout:4/928: chown d2/d2f/d39/d43/d103/lbd 3534 1 2024-04-18T21:07:02.755 INFO:tasks.workunit.client.0.smithi096.stdout:4/929: mkdir d2/d2f/d33/d55/d59/d12f 0 2024-04-18T21:07:02.756 INFO:tasks.workunit.client.0.smithi096.stdout:4/930: readlink d2/d2f/d33/d55/d59/l77 0 2024-04-18T21:07:02.756 INFO:tasks.workunit.client.0.smithi096.stdout:4/931: mkdir d2/d2f/d33/d55/d59/d5f/dcd/d109/d130 0 2024-04-18T21:07:02.757 INFO:tasks.workunit.client.0.smithi096.stdout:4/932: write d2/d2f/d33/d55/d59/db9/fc2 [1000970,88351] 0 2024-04-18T21:07:02.758 INFO:tasks.workunit.client.0.smithi096.stdout:4/933: fdatasync d2/d2f/d33/d55/d57/d88/ff5 0 2024-04-18T21:07:02.759 INFO:tasks.workunit.client.0.smithi096.stdout:4/934: chown d2/d2f/d33/d55/d59/db9/fba 1202166868 1 2024-04-18T21:07:02.759 INFO:tasks.workunit.client.0.smithi096.stdout:4/935: truncate d2/d2f/d33/d55/de0/fff 833604 0 2024-04-18T21:07:02.760 INFO:tasks.workunit.client.0.smithi096.stdout:4/936: mknod d2/dc3/c131 0 2024-04-18T21:07:02.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/937: chown d2/d2f/d39/d43/d103/d119/c106 65370 1 2024-04-18T21:07:02.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/938: write d2/d2f/d33/f8a [4920630,116574] 0 2024-04-18T21:07:02.762 INFO:tasks.workunit.client.0.smithi096.stdout:4/939: creat d2/d2f/d33/d55/de0/d125/f132 x:0 0 0 2024-04-18T21:07:02.764 INFO:tasks.workunit.client.0.smithi096.stdout:4/940: getdents d2/dbb/dde/d10b 0 2024-04-18T21:07:02.764 INFO:tasks.workunit.client.0.smithi096.stdout:4/941: symlink d2/d2a/d54/d71/d99/l133 0 2024-04-18T21:07:02.765 INFO:tasks.workunit.client.0.smithi096.stdout:4/942: mknod d2/d2f/d33/d55/d57/d7d/c134 0 2024-04-18T21:07:02.765 INFO:tasks.workunit.client.0.smithi096.stdout:4/943: rmdir d2/d2f/d39/d43/d103/d119 39 2024-04-18T21:07:02.766 INFO:tasks.workunit.client.0.smithi096.stdout:4/944: write d2/d2a/d54/d71/f8e [708550,7348] 0 2024-04-18T21:07:02.767 INFO:tasks.workunit.client.0.smithi096.stdout:4/945: chown d2/d2f/d33/d55/d59/fd7 101378247 1 2024-04-18T21:07:02.767 INFO:tasks.workunit.client.0.smithi096.stdout:4/946: chown d2/d2f/d33/d55/d104/f113 0 1 2024-04-18T21:07:02.768 INFO:tasks.workunit.client.0.smithi096.stdout:0/863: sync 2024-04-18T21:07:02.768 INFO:tasks.workunit.client.0.smithi096.stdout:9/977: sync 2024-04-18T21:07:02.769 INFO:tasks.workunit.client.0.smithi096.stdout:4/947: creat d2/d2a/d54/d71/d99/dad/d101/f135 x:0 0 0 2024-04-18T21:07:02.769 INFO:tasks.workunit.client.0.smithi096.stdout:9/978: creat d0/dc/f13a x:0 0 0 2024-04-18T21:07:02.769 INFO:tasks.workunit.client.0.smithi096.stdout:0/864: write d1/da3/fe3 [925004,32460] 0 2024-04-18T21:07:02.769 INFO:tasks.workunit.client.0.smithi096.stdout:0/865: dread - d1/ffe zero size 2024-04-18T21:07:02.770 INFO:tasks.workunit.client.0.smithi096.stdout:0/866: chown d1/da3/dde/f11a 4794657 1 2024-04-18T21:07:02.770 INFO:tasks.workunit.client.0.smithi096.stdout:4/948: truncate d2/d2f/d39/d43/f117 3242473 0 2024-04-18T21:07:02.770 INFO:tasks.workunit.client.0.smithi096.stdout:4/949: creat d2/d2f/d33/d55/da3/f136 x:0 0 0 2024-04-18T21:07:02.772 INFO:tasks.workunit.client.0.smithi096.stdout:4/950: link d2/f38 d2/d2a/d54/d6d/d78/f137 0 2024-04-18T21:07:02.774 INFO:tasks.workunit.client.0.smithi096.stdout:9/979: dwrite d0/d8/d9/f23 [0,4194304] 0 2024-04-18T21:07:02.776 INFO:tasks.workunit.client.0.smithi096.stdout:0/867: dwrite d1/d23/d32/d43/d6f/d8a/d91/fc2 [0,4194304] 0 2024-04-18T21:07:02.777 INFO:tasks.workunit.client.0.smithi096.stdout:0/868: rename d1/db/d25/f28 to d1/d23/d126/f127 0 2024-04-18T21:07:02.783 INFO:tasks.workunit.client.0.smithi096.stdout:0/869: dwrite d1/db/d25/f99 [0,4194304] 0 2024-04-18T21:07:02.783 INFO:tasks.workunit.client.0.smithi096.stdout:0/870: chown d1/d23/d32/d7d/fa0 523069 1 2024-04-18T21:07:02.784 INFO:tasks.workunit.client.0.smithi096.stdout:0/871: unlink d1/db/dda/l106 0 2024-04-18T21:07:02.787 INFO:tasks.workunit.client.0.smithi096.stdout:4/951: dread d2/d1d/f5e [0,4194304] 0 2024-04-18T21:07:02.788 INFO:tasks.workunit.client.0.smithi096.stdout:4/952: readlink d2/d2f/d39/d43/d103/lbd 0 2024-04-18T21:07:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:4/953: dwrite f0 [0,4194304] 0 2024-04-18T21:07:02.795 INFO:tasks.workunit.client.0.smithi096.stdout:4/954: symlink d2/d2f/d33/d55/d59/d5f/l138 0 2024-04-18T21:07:02.796 INFO:tasks.workunit.client.0.smithi096.stdout:4/955: mknod d2/d2f/d39/d43/c139 0 2024-04-18T21:07:02.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/956: getdents d2/d2f/d33/d55/d59/d5f 0 2024-04-18T21:07:02.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/957: readlink d2/l22 0 2024-04-18T21:07:02.803 INFO:tasks.workunit.client.0.smithi096.stdout:4/958: mknod d2/d2f/d33/d55/d104/c13a 0 2024-04-18T21:07:02.810 INFO:tasks.workunit.client.0.smithi096.stdout:9/980: dread d0/d44/fcb [0,4194304] 0 2024-04-18T21:07:02.811 INFO:tasks.workunit.client.0.smithi096.stdout:9/981: mkdir d0/d8/d11/d39/d63/d13b 0 2024-04-18T21:07:02.812 INFO:tasks.workunit.client.0.smithi096.stdout:9/982: link d0/d28/d2f/de6/ddb/f115 d0/d28/d7a/f13c 0 2024-04-18T21:07:02.813 INFO:tasks.workunit.client.0.smithi096.stdout:9/983: getdents d0/d28/d66/db2 0 2024-04-18T21:07:02.813 INFO:tasks.workunit.client.0.smithi096.stdout:9/984: mkdir d0/d28/d66/dd8/d13d 0 2024-04-18T21:07:02.814 INFO:tasks.workunit.client.0.smithi096.stdout:9/985: link d0/d8/l3f d0/d28/d66/dd8/l13e 0 2024-04-18T21:07:02.815 INFO:tasks.workunit.client.0.smithi096.stdout:9/986: rename d0/d8/d11/d48/lbf to d0/d28/d7a/d102/l13f 0 2024-04-18T21:07:02.816 INFO:tasks.workunit.client.0.smithi096.stdout:9/987: unlink d0/d28/d7a/dc3/cc9 0 2024-04-18T21:07:02.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/988: rename d0/d28/da1/c85 to d0/d8/d11/d39/d63/c140 0 2024-04-18T21:07:02.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/989: stat d0/d28/d66/dd8/cf1 0 2024-04-18T21:07:02.818 INFO:tasks.workunit.client.0.smithi096.stdout:9/990: stat d0/d8/d11/d39/d63/f83 0 2024-04-18T21:07:02.819 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:02.819 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:02.820 INFO:tasks.workunit.client.0.smithi096.stdout:0/872: dread d1/d23/d32/d43/d6f/d8a/d96/fa9 [0,4194304] 0 2024-04-18T21:07:02.820 INFO:tasks.workunit.client.0.smithi096.stdout:0/873: mkdir d1/d128 0 2024-04-18T21:07:02.823 INFO:tasks.workunit.client.0.smithi096.stdout:9/991: dwrite d0/dc/d5f/d76/fe4 [0,4194304] 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi096.stdout:9/992: dread d0/d28/d7a/f13c [0,4194304] 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi096.stdout:9/993: write d0/d28/d7a/dc3/dc6/da3/fbe [670368,23324] 0 2024-04-18T21:07:02.838 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:02.837+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:02.840 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:02.840 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:02.841 INFO:tasks.workunit.client.0.smithi096.stdout:9/994: read d0/d28/d7a/dc3/dc6/da3/fbe [651602,71688] 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi096.stdout:9/995: creat d0/d28/d2f/de6/ddb/f141 x:0 0 0 2024-04-18T21:07:02.847 INFO:tasks.workunit.client.0.smithi096.stdout:9/996: dwrite d0/d8/d11/f120 [0,4194304] 0 2024-04-18T21:07:02.848 INFO:tasks.workunit.client.0.smithi096.stdout:9/997: write d0/d8/d11/d48/f7e [5175492,5776] 0 2024-04-18T21:07:02.850 INFO:tasks.workunit.client.0.smithi096.stdout:9/998: truncate d0/d28/d7a/dc3/dc6/da3/fbe 1655456 0 2024-04-18T21:07:02.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/874: dread d1/db/d30/d31/d85/f16 [0,4194304] 0 2024-04-18T21:07:02.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/999: chown d0/dc/d5f/d76/dc1/cf5 12 1 2024-04-18T21:07:02.853 INFO:tasks.workunit.client.0.smithi096.stdout:0/875: fdatasync d1/ffe 0 2024-04-18T21:07:02.854 INFO:tasks.workunit.client.0.smithi096.stdout:0/876: getdents d1/d23/d32 0 2024-04-18T21:07:02.855 INFO:tasks.workunit.client.0.smithi096.stdout:0/877: read - d1/d23/fa4 zero size 2024-04-18T21:07:02.855 INFO:tasks.workunit.client.0.smithi096.stdout:0/878: mknod d1/d23/d32/d7d/c129 0 2024-04-18T21:07:02.865 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:02.865 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:02.868 INFO:tasks.workunit.client.0.smithi096.stdout:0/879: truncate d1/db/dda/de9/deb/f55 1682816 0 2024-04-18T21:07:02.868 INFO:tasks.workunit.client.0.smithi096.stdout:0/880: symlink d1/d23/d32/daf/l12a 0 2024-04-18T21:07:02.869 INFO:tasks.workunit.client.0.smithi096.stdout:0/881: fdatasync d1/db/d30/f5c 0 2024-04-18T21:07:02.869 INFO:tasks.workunit.client.0.smithi096.stdout:0/882: dread - d1/db/d30/d4a/dae/dcf/fdc zero size 2024-04-18T21:07:02.872 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:02.872 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:02.874 INFO:tasks.workunit.client.0.smithi096.stdout:0/883: truncate d1/da3/fc5 1849190 0 2024-04-18T21:07:02.876 INFO:tasks.workunit.client.0.smithi096.stdout:0/884: unlink d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/lc0 0 2024-04-18T21:07:02.876 INFO:tasks.workunit.client.0.smithi096.stdout:0/885: creat d1/d23/d32/d43/d6f/d8a/d91/dba/dee/f12b x:0 0 0 2024-04-18T21:07:02.877 INFO:tasks.workunit.client.0.smithi096.stdout:0/886: read d1/db/d25/fe6 [1491131,124854] 0 2024-04-18T21:07:02.877 INFO:tasks.workunit.client.0.smithi096.stdout:0/887: chown d1/lc 57464351 1 2024-04-18T21:07:02.878 INFO:tasks.workunit.client.0.smithi096.stdout:0/888: mknod d1/db/d30/d4a/c12c 0 2024-04-18T21:07:02.879 INFO:tasks.workunit.client.0.smithi096.stdout:0/889: rename d1/da5 to d1/db/d30/d12d 0 2024-04-18T21:07:02.883 INFO:tasks.workunit.client.0.smithi096.stdout:0/890: truncate d1/d23/d126/f127 216710 0 2024-04-18T21:07:02.886 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:07:02.887 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:02.888 INFO:tasks.workunit.client.0.smithi096.stdout:0/891: dwrite d1/db/d30/d31/d85/f16 [0,4194304] 0 2024-04-18T21:07:02.893 INFO:tasks.workunit.client.0.smithi096.stdout:0/892: write d1/db/dda/de9/deb/d82/ff2 [22266,112609] 0 2024-04-18T21:07:02.893 INFO:tasks.workunit.client.0.smithi096.stdout:0/893: symlink d1/d23/d126/l12e 0 2024-04-18T21:07:02.898 INFO:tasks.workunit.client.0.smithi096.stdout:0/894: dwrite d1/da3/fe3 [0,4194304] 0 2024-04-18T21:07:02.900 INFO:tasks.workunit.client.0.smithi096.stdout:0/895: rename d1/db/d25/f3d to d1/db/d30/d4a/dae/dcf/f12f 0 2024-04-18T21:07:02.900 INFO:tasks.workunit.client.0.smithi096.stdout:0/896: write d1/db/d25/fb0 [784993,2345] 0 2024-04-18T21:07:02.907 INFO:tasks.workunit.client.0.smithi096.stdout:0/897: truncate d1/d23/d32/d43/d6f/f8b 3238122 0 2024-04-18T21:07:02.907 INFO:tasks.workunit.client.0.smithi096.stdout:0/898: chown d1/d23/d32/f76 2410494 1 2024-04-18T21:07:02.908 INFO:tasks.workunit.client.0.smithi096.stdout:0/899: read - d1/d23/d32/f10d zero size 2024-04-18T21:07:02.908 INFO:tasks.workunit.client.0.smithi096.stdout:0/900: unlink d1/d23/d32/f76 0 2024-04-18T21:07:02.913 INFO:tasks.workunit.client.0.smithi096.stdout:0/901: dwrite d1/d23/d32/d43/d6f/d8a/d96/db4/fd7 [4194304,4194304] 0 2024-04-18T21:07:02.922 INFO:tasks.workunit.client.0.smithi096.stdout:7/864: sync 2024-04-18T21:07:02.922 INFO:tasks.workunit.client.0.smithi096.stdout:7/865: dread - d0/d20/d62/dca/f79 zero size 2024-04-18T21:07:02.933 INFO:tasks.workunit.client.0.smithi096.stdout:7/866: write d0/d20/d39/f61 [1044928,47464] 0 2024-04-18T21:07:02.933 INFO:tasks.workunit.client.0.smithi096.stdout:7/867: truncate d0/d7/d49/f11e 280179 0 2024-04-18T21:07:02.934 INFO:tasks.workunit.client.0.smithi096.stdout:7/868: write d0/d20/d39/d8a/fcb [179792,69025] 0 2024-04-18T21:07:02.939 INFO:tasks.workunit.client.0.smithi096.stdout:7/869: dwrite d0/d7/d49/f11e [0,4194304] 0 2024-04-18T21:07:02.939 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:02.937+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:02.941 INFO:tasks.workunit.client.0.smithi096.stdout:7/870: getdents d0/d20/d62/d7d 0 2024-04-18T21:07:02.943 INFO:tasks.workunit.client.0.smithi096.stdout:7/871: creat d0/d20/d62/dca/dd6/dfa/f11f x:0 0 0 2024-04-18T21:07:02.943 INFO:tasks.workunit.client.0.smithi096.stdout:7/872: creat d0/d7/d49/f120 x:0 0 0 2024-04-18T21:07:02.944 INFO:tasks.workunit.client.0.smithi096.stdout:7/873: write d0/d20/d62/dca/f79 [990316,79830] 0 2024-04-18T21:07:02.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/874: dwrite d0/d20/f46 [4194304,4194304] 0 2024-04-18T21:07:02.950 INFO:tasks.workunit.client.0.smithi096.stdout:7/875: creat d0/d20/d39/d59/f121 x:0 0 0 2024-04-18T21:07:02.973 INFO:tasks.workunit.client.0.smithi096.stdout:7/876: dread d0/d20/d4b/fc0 [4194304,4194304] 0 2024-04-18T21:07:02.974 INFO:tasks.workunit.client.0.smithi096.stdout:7/877: link d0/d7/d2f/d63/dc4/d104/c9d d0/d20/d4b/c122 0 2024-04-18T21:07:02.975 INFO:tasks.workunit.client.0.smithi096.stdout:7/878: truncate d0/d7/fb9 1540718 0 2024-04-18T21:07:02.996 INFO:tasks.workunit.client.0.smithi096.stdout:7/879: dread d0/d7/d49/f4e [0,4194304] 0 2024-04-18T21:07:03.014 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:03.014 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:03.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi096.stdout:1/913: sync 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi096.stdout:4/959: sync 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi096.stdout:8/927: sync 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi096.stdout:3/786: sync 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi096.stdout:5/877: sync 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi096.stdout:6/903: sync 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi096.stdout:8/928: chown d0/d3/d3a/d81 43 1 2024-04-18T21:07:03.032 INFO:tasks.workunit.client.0.smithi096.stdout:1/914: write d0/df/d62/db1/f10c [983535,66596] 0 2024-04-18T21:07:03.032 INFO:tasks.workunit.client.0.smithi096.stdout:6/904: mkdir d1/d5/da/d44/d97/da0/d12e 0 2024-04-18T21:07:03.033 INFO:tasks.workunit.client.0.smithi096.stdout:3/787: truncate d4/d6/f92 3418969 0 2024-04-18T21:07:03.033 INFO:tasks.workunit.client.0.smithi096.stdout:4/960: rmdir d2/d2f/d33/d55/d59/d5f/dcd/d109/d130 0 2024-04-18T21:07:03.033 INFO:tasks.workunit.client.0.smithi096.stdout:8/929: creat d0/d3/d1d/d66/d10a/d120/f131 x:0 0 0 2024-04-18T21:07:03.033 INFO:tasks.workunit.client.0.smithi096.stdout:1/915: dread - d0/df/d16/d24/dac/fa0 zero size 2024-04-18T21:07:03.034 INFO:tasks.workunit.client.0.smithi096.stdout:6/905: symlink d1/d3a/d57/d66/d80/dfb/dbb/l12f 0 2024-04-18T21:07:03.034 INFO:tasks.workunit.client.0.smithi096.stdout:4/961: write d2/d2a/f93 [585245,6918] 0 2024-04-18T21:07:03.034 INFO:tasks.workunit.client.0.smithi096.stdout:3/788: mkdir d4/d6/d1b/d2c/d31/d4e/de8/de9 0 2024-04-18T21:07:03.035 INFO:tasks.workunit.client.0.smithi096.stdout:6/906: fdatasync d1/d3a/d57/d66/d80/dfb/dbb/f12c 0 2024-04-18T21:07:03.035 INFO:tasks.workunit.client.0.smithi096.stdout:1/916: rename d0/f49 to d0/df/d30/d53/f12b 0 2024-04-18T21:07:03.035 INFO:tasks.workunit.client.0.smithi096.stdout:4/962: chown d2/d2a/d54/d5b/d89/d90 107711584 1 2024-04-18T21:07:03.036 INFO:tasks.workunit.client.0.smithi096.stdout:3/789: creat d4/d6/d7/d90/fea x:0 0 0 2024-04-18T21:07:03.036 INFO:tasks.workunit.client.0.smithi096.stdout:6/907: mkdir d1/d5/da/d55/d130 0 2024-04-18T21:07:03.036 INFO:tasks.workunit.client.0.smithi096.stdout:3/790: stat d4/d6/d1b/d63 0 2024-04-18T21:07:03.040 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:03.039+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:03.041 INFO:tasks.workunit.client.0.smithi096.stdout:1/917: creat d0/df/de5/d120/f12c x:0 0 0 2024-04-18T21:07:03.047 INFO:tasks.workunit.client.0.smithi096.stdout:8/930: dread d0/d3/d1d/d83/dcd/dd1/dda/fe8 [0,4194304] 0 2024-04-18T21:07:03.048 INFO:tasks.workunit.client.0.smithi096.stdout:8/931: getdents d0/d3/d1d/d83/dcd/dc6 0 2024-04-18T21:07:03.050 INFO:tasks.workunit.client.0.smithi096.stdout:8/932: getdents d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3 0 2024-04-18T21:07:03.050 INFO:tasks.workunit.client.0.smithi096.stdout:5/878: dread d2/d11/d28/d4a/d131/da0/dcb/f10e [0,4194304] 0 2024-04-18T21:07:03.052 INFO:tasks.workunit.client.0.smithi096.stdout:5/879: truncate d2/d18/d61/d6f/f11b 357482 0 2024-04-18T21:07:03.052 INFO:tasks.workunit.client.0.smithi096.stdout:3/791: dread d4/d6/f32 [0,4194304] 0 2024-04-18T21:07:03.053 INFO:tasks.workunit.client.0.smithi096.stdout:8/933: rename d0/d3/d1d/d83/dcd/d7f/dac/d1b/lb5 to d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/d10e/l132 0 2024-04-18T21:07:03.053 INFO:tasks.workunit.client.0.smithi096.stdout:3/792: creat d4/d6/d1b/d2c/feb x:0 0 0 2024-04-18T21:07:03.054 INFO:tasks.workunit.client.0.smithi096.stdout:5/880: getdents d2/d11/d28/d4a/d131/da0/db5 0 2024-04-18T21:07:03.054 INFO:tasks.workunit.client.0.smithi096.stdout:3/793: mkdir d4/d6/d22/d20/d46/dec 0 2024-04-18T21:07:03.055 INFO:tasks.workunit.client.0.smithi096.stdout:8/934: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/d10e/f133 x:0 0 0 2024-04-18T21:07:03.055 INFO:tasks.workunit.client.0.smithi096.stdout:6/908: dread d1/f1c [8388608,4194304] 0 2024-04-18T21:07:03.056 INFO:tasks.workunit.client.0.smithi096.stdout:6/909: dread - d1/d5/da/d46/d71/d7c/d8b/fde zero size 2024-04-18T21:07:03.056 INFO:tasks.workunit.client.0.smithi096.stdout:8/935: symlink d0/d3/d1d/d83/dcd/d7f/dac/d33/l134 0 2024-04-18T21:07:03.057 INFO:tasks.workunit.client.0.smithi096.stdout:6/910: fdatasync d1/d5/f5d 0 2024-04-18T21:07:03.062 INFO:tasks.workunit.client.0.smithi096.stdout:8/936: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/d10e/l132 13970 1 2024-04-18T21:07:03.063 INFO:tasks.workunit.client.0.smithi096.stdout:6/911: dwrite d1/d3a/d57/d26/ffc [0,4194304] 0 2024-04-18T21:07:03.064 INFO:tasks.workunit.client.0.smithi096.stdout:5/881: dread d2/d11/d28/d64/d7e/f99 [0,4194304] 0 2024-04-18T21:07:03.064 INFO:tasks.workunit.client.0.smithi096.stdout:6/912: write d1/d5/f87 [4412047,13437] 0 2024-04-18T21:07:03.065 INFO:tasks.workunit.client.0.smithi096.stdout:8/937: creat d0/d3/d1d/d102/d115/d6f/f135 x:0 0 0 2024-04-18T21:07:03.066 INFO:tasks.workunit.client.0.smithi096.stdout:6/913: rename d1/d5/f15 to d1/d3a/f131 0 2024-04-18T21:07:03.070 INFO:tasks.workunit.client.0.smithi096.stdout:5/882: dwrite d2/d11/d28/d4a/d131/da0/dcb/f126 [0,4194304] 0 2024-04-18T21:07:03.070 INFO:tasks.workunit.client.0.smithi096.stdout:5/883: write d2/d11/f21 [475838,66426] 0 2024-04-18T21:07:03.076 INFO:tasks.workunit.client.0.smithi096.stdout:6/914: write d1/d3a/d36/f42 [1470041,106703] 0 2024-04-18T21:07:03.076 INFO:tasks.workunit.client.0.smithi096.stdout:5/884: dwrite d2/d11/d28/d4a/d131/da0/fac [0,4194304] 0 2024-04-18T21:07:03.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/885: dread d2/d11/d28/f72 [0,4194304] 0 2024-04-18T21:07:03.079 INFO:tasks.workunit.client.0.smithi096.stdout:8/938: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 [0,4194304] 0 2024-04-18T21:07:03.080 INFO:tasks.workunit.client.0.smithi096.stdout:8/939: dread - d0/d3/d3a/d9f/ff1 zero size 2024-04-18T21:07:03.081 INFO:tasks.workunit.client.0.smithi096.stdout:8/940: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d9b/f136 x:0 0 0 2024-04-18T21:07:03.083 INFO:tasks.workunit.client.0.smithi096.stdout:8/941: write d0/d3/d1d/d83/dcd/d7f/dac/fb7 [2347528,11926] 0 2024-04-18T21:07:03.083 INFO:tasks.workunit.client.0.smithi096.stdout:8/942: mkdir d0/d3/d1d/d66/d10a/d120/d137 0 2024-04-18T21:07:03.084 INFO:tasks.workunit.client.0.smithi096.stdout:8/943: write d0/d5d/ff8 [3602800,81834] 0 2024-04-18T21:07:03.087 INFO:tasks.workunit.client.0.smithi096.stdout:8/944: read d0/d3/d3a/dab/d46/dc5/ffd [266804,100216] 0 2024-04-18T21:07:03.088 INFO:tasks.workunit.client.0.smithi096.stdout:6/915: read d1/d3a/d36/fae [2746335,114352] 0 2024-04-18T21:07:03.089 INFO:tasks.workunit.client.0.smithi096.stdout:8/945: write d0/d5d/fee [4469782,37186] 0 2024-04-18T21:07:03.089 INFO:tasks.workunit.client.0.smithi096.stdout:6/916: unlink d1/l8 0 2024-04-18T21:07:03.089 INFO:tasks.workunit.client.0.smithi096.stdout:6/917: fdatasync d1/f41 0 2024-04-18T21:07:03.089 INFO:tasks.workunit.client.0.smithi096.stdout:8/946: creat d0/d3/d1d/d66/d10a/f138 x:0 0 0 2024-04-18T21:07:03.090 INFO:tasks.workunit.client.0.smithi096.stdout:6/918: chown d1/d3a/d57/d66/d80/dfb/d94/ca1 1306127 1 2024-04-18T21:07:03.091 INFO:tasks.workunit.client.0.smithi096.stdout:6/919: creat d1/d3a/f132 x:0 0 0 2024-04-18T21:07:03.092 INFO:tasks.workunit.client.0.smithi096.stdout:3/794: dread d4/d8/f74 [0,4194304] 0 2024-04-18T21:07:03.092 INFO:tasks.workunit.client.0.smithi096.stdout:6/920: creat d1/d5/da/d46/d71/dbc/df6/f133 x:0 0 0 2024-04-18T21:07:03.093 INFO:tasks.workunit.client.0.smithi096.stdout:6/921: mknod d1/d3a/d36/d107/c134 0 2024-04-18T21:07:03.093 INFO:tasks.workunit.client.0.smithi096.stdout:6/922: stat d1/d5/da 0 2024-04-18T21:07:03.093 INFO:tasks.workunit.client.0.smithi096.stdout:3/795: getdents d4/d8/d49/db3/db4 0 2024-04-18T21:07:03.094 INFO:tasks.workunit.client.0.smithi096.stdout:6/923: write d1/d5/da/d44/f7d [1164217,64009] 0 2024-04-18T21:07:03.094 INFO:tasks.workunit.client.0.smithi096.stdout:3/796: creat d4/d6/d1b/d1d/fed x:0 0 0 2024-04-18T21:07:03.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/797: rename d4/d6/d1b/d2c/d31/d85/ddc/fde to d4/d6/d1b/d63/fee 0 2024-04-18T21:07:03.100 INFO:tasks.workunit.client.0.smithi096.stdout:6/924: dwrite d1/d5/da/d46/d71/f84 [0,4194304] 0 2024-04-18T21:07:03.102 INFO:tasks.workunit.client.0.smithi096.stdout:6/925: creat d1/d3a/d57/d66/d114/f135 x:0 0 0 2024-04-18T21:07:03.103 INFO:tasks.workunit.client.0.smithi096.stdout:6/926: truncate d1/d3a/d57/d66/d80/dfb/f110 233989 0 2024-04-18T21:07:03.104 INFO:tasks.workunit.client.0.smithi096.stdout:6/927: creat d1/d5/da/d44/f136 x:0 0 0 2024-04-18T21:07:03.105 INFO:tasks.workunit.client.0.smithi096.stdout:6/928: write d1/d5/f5d [863321,53260] 0 2024-04-18T21:07:03.106 INFO:tasks.workunit.client.0.smithi096.stdout:6/929: unlink d1/d5/da/d46/d71/d7c/l86 0 2024-04-18T21:07:03.106 INFO:tasks.workunit.client.0.smithi096.stdout:6/930: stat d1/d5/da/f21 0 2024-04-18T21:07:03.107 INFO:tasks.workunit.client.0.smithi096.stdout:6/931: creat d1/d3a/d36/d7a/d102/f137 x:0 0 0 2024-04-18T21:07:03.108 INFO:tasks.workunit.client.0.smithi096.stdout:6/932: mknod d1/d3a/d57/d66/d9b/d9f/c138 0 2024-04-18T21:07:03.112 INFO:tasks.workunit.client.0.smithi096.stdout:8/947: dread d0/d3/d1d/d83/dcd/d7f/dac/d33/f59 [0,4194304] 0 2024-04-18T21:07:03.113 INFO:tasks.workunit.client.0.smithi096.stdout:8/948: mknod d0/d3/d1d/d66/d10a/c139 0 2024-04-18T21:07:03.114 INFO:tasks.workunit.client.0.smithi096.stdout:8/949: symlink d0/d3/d1d/d66/d10a/d120/d137/l13a 0 2024-04-18T21:07:03.119 INFO:tasks.workunit.client.0.smithi096.stdout:3/798: dread d4/d6/d1b/d63/fd2 [0,4194304] 0 2024-04-18T21:07:03.125 INFO:tasks.workunit.client.0.smithi096.stdout:3/799: dwrite d4/f9c [0,4194304] 0 2024-04-18T21:07:03.134 INFO:tasks.workunit.client.0.smithi096.stdout:8/950: dread d0/d64/f6d [0,4194304] 0 2024-04-18T21:07:03.140 INFO:tasks.workunit.client.0.smithi096.stdout:8/951: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/fc9 [0,4194304] 0 2024-04-18T21:07:03.140 INFO:tasks.workunit.client.0.smithi096.stdout:7/880: sync 2024-04-18T21:07:03.140 INFO:tasks.workunit.client.0.smithi096.stdout:0/902: sync 2024-04-18T21:07:03.141 INFO:tasks.workunit.client.0.smithi096.stdout:4/963: sync 2024-04-18T21:07:03.141 INFO:tasks.workunit.client.0.smithi096.stdout:3/800: sync 2024-04-18T21:07:03.141 INFO:tasks.workunit.client.0.smithi096.stdout:1/918: sync 2024-04-18T21:07:03.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/886: sync 2024-04-18T21:07:03.141 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:03.139+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:03.142 INFO:tasks.workunit.client.0.smithi096.stdout:0/903: fsync d1/db/dda/de9/deb/d6d/db1/f115 0 2024-04-18T21:07:03.142 INFO:tasks.workunit.client.0.smithi096.stdout:8/952: creat d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b/f13b x:0 0 0 2024-04-18T21:07:03.143 INFO:tasks.workunit.client.0.smithi096.stdout:5/887: symlink d2/d18/d11d/l132 0 2024-04-18T21:07:03.143 INFO:tasks.workunit.client.0.smithi096.stdout:6/933: dread d1/d5/da/f2a [0,4194304] 0 2024-04-18T21:07:03.143 INFO:tasks.workunit.client.0.smithi096.stdout:4/964: mknod d2/d2f/d33/c13b 0 2024-04-18T21:07:03.143 INFO:tasks.workunit.client.0.smithi096.stdout:3/801: mknod d4/d6/d1b/d2c/d31/d85/ddc/cef 0 2024-04-18T21:07:03.143 INFO:tasks.workunit.client.0.smithi096.stdout:6/934: fdatasync d1/d61/d91/f11c 0 2024-04-18T21:07:03.144 INFO:tasks.workunit.client.0.smithi096.stdout:8/953: write d0/d3/f5 [589486,67463] 0 2024-04-18T21:07:03.144 INFO:tasks.workunit.client.0.smithi096.stdout:1/919: rename d0/df/de5/l101 to d0/df/d16/d24/l12d 0 2024-04-18T21:07:03.144 INFO:tasks.workunit.client.0.smithi096.stdout:5/888: mkdir d2/d11/d28/d4a/d131/de8/d133 0 2024-04-18T21:07:03.144 INFO:tasks.workunit.client.0.smithi096.stdout:0/904: truncate d1/d23/d126/f127 851727 0 2024-04-18T21:07:03.145 INFO:tasks.workunit.client.0.smithi096.stdout:5/889: write d2/d11/ff8 [4953113,106871] 0 2024-04-18T21:07:03.145 INFO:tasks.workunit.client.0.smithi096.stdout:0/905: readlink d1/db/d30/d4a/l63 0 2024-04-18T21:07:03.145 INFO:tasks.workunit.client.0.smithi096.stdout:6/935: readlink d1/d3a/d57/d66/d80/dfb/d94/lc0 0 2024-04-18T21:07:03.145 INFO:tasks.workunit.client.0.smithi096.stdout:0/906: readlink d1/d23/d32/d43/dfb/l111 0 2024-04-18T21:07:03.146 INFO:tasks.workunit.client.0.smithi096.stdout:6/936: creat d1/d5/da/d46/d71/dbc/d12d/f139 x:0 0 0 2024-04-18T21:07:03.146 INFO:tasks.workunit.client.0.smithi096.stdout:5/890: creat d2/d11/d28/d4a/d131/da0/dab/ded/f134 x:0 0 0 2024-04-18T21:07:03.147 INFO:tasks.workunit.client.0.smithi096.stdout:6/937: rmdir d1/d3a/d57/d66 39 2024-04-18T21:07:03.147 INFO:tasks.workunit.client.0.smithi096.stdout:0/907: rename d1/db/d30/f6c to d1/db/d30/d31/d85/d58/f130 0 2024-04-18T21:07:03.148 INFO:tasks.workunit.client.0.smithi096.stdout:6/938: write d1/d3a/d36/f42 [1599047,18775] 0 2024-04-18T21:07:03.150 INFO:tasks.workunit.client.0.smithi096.stdout:6/939: symlink d1/d3a/d57/d66/d80/l13a 0 2024-04-18T21:07:03.151 INFO:tasks.workunit.client.0.smithi096.stdout:8/954: dwrite d0/d3/d1d/d83/dcd/dd1/dda/f119 [0,4194304] 0 2024-04-18T21:07:03.151 INFO:tasks.workunit.client.0.smithi096.stdout:1/920: dwrite d0/df/d16/d24/dc0/d5f/f6f [0,4194304] 0 2024-04-18T21:07:03.153 INFO:tasks.workunit.client.0.smithi096.stdout:1/921: rmdir d0/df/de5/df8/d9b 39 2024-04-18T21:07:03.157 INFO:tasks.workunit.client.0.smithi096.stdout:8/955: dwrite d0/d5d/f77 [0,4194304] 0 2024-04-18T21:07:03.159 INFO:tasks.workunit.client.0.smithi096.stdout:1/922: dwrite d0/df/d16/d24/dc0/d5f/fcd [0,4194304] 0 2024-04-18T21:07:03.159 INFO:tasks.workunit.client.0.smithi096.stdout:8/956: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/d10e/l132 11752 1 2024-04-18T21:07:03.161 INFO:tasks.workunit.client.0.smithi096.stdout:1/923: rmdir d0/df/d16/d6c/d9d 39 2024-04-18T21:07:03.161 INFO:tasks.workunit.client.0.smithi096.stdout:8/957: read - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/f10f zero size 2024-04-18T21:07:03.162 INFO:tasks.workunit.client.0.smithi096.stdout:1/924: chown d0/df/d16/d24/l12d 786203237 1 2024-04-18T21:07:03.163 INFO:tasks.workunit.client.0.smithi096.stdout:8/958: creat d0/d3/d1d/d102/d115/f13c x:0 0 0 2024-04-18T21:07:03.163 INFO:tasks.workunit.client.0.smithi096.stdout:5/891: dwrite d2/d6a/f105 [0,4194304] 0 2024-04-18T21:07:03.164 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:03.164 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:03.164 INFO:tasks.workunit.client.0.smithi096.stdout:5/892: mkdir d2/d11/d28/d4a/d131/da0/dcb/d135 0 2024-04-18T21:07:03.164 INFO:tasks.workunit.client.0.smithi096.stdout:8/959: fsync d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/ff4 0 2024-04-18T21:07:03.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/893: truncate d2/d18/d61/d6f/f95 182853 0 2024-04-18T21:07:03.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/894: readlink d2/l4 0 2024-04-18T21:07:03.166 INFO:tasks.workunit.client.0.smithi096.stdout:5/895: mkdir d2/d11/d28/d64/d136 0 2024-04-18T21:07:03.167 INFO:tasks.workunit.client.0.smithi096.stdout:0/908: truncate d1/db/d30/d4a/ffa 4145194 0 2024-04-18T21:07:03.168 INFO:tasks.workunit.client.0.smithi096.stdout:6/940: write d1/d3a/d57/d66/d80/dfb/fdb [72778,20164] 0 2024-04-18T21:07:03.168 INFO:tasks.workunit.client.0.smithi096.stdout:0/909: chown d1/db/dda/de9/deb 0 1 2024-04-18T21:07:03.169 INFO:tasks.workunit.client.0.smithi096.stdout:0/910: creat d1/d23/d32/daf/f131 x:0 0 0 2024-04-18T21:07:03.169 INFO:tasks.workunit.client.0.smithi096.stdout:6/941: mknod d1/d5/da/d46/d71/d7c/c13b 0 2024-04-18T21:07:03.169 INFO:tasks.workunit.client.0.smithi096.stdout:0/911: dread - d1/d23/f11d zero size 2024-04-18T21:07:03.170 INFO:tasks.workunit.client.0.smithi096.stdout:0/912: creat d1/d23/d32/d43/d6f/d8a/d91/f132 x:0 0 0 2024-04-18T21:07:03.175 INFO:tasks.workunit.client.0.smithi096.stdout:0/913: dwrite d1/db/d30/d31/d85/d58/fd0 [0,4194304] 0 2024-04-18T21:07:03.176 INFO:tasks.workunit.client.0.smithi096.stdout:0/914: mknod d1/db/d30/d31/d85/dfc/d109/c133 0 2024-04-18T21:07:03.177 INFO:tasks.workunit.client.0.smithi096.stdout:0/915: creat d1/d23/d32/daf/f134 x:0 0 0 2024-04-18T21:07:03.181 INFO:tasks.workunit.client.0.smithi096.stdout:5/896: dread d2/d11/f68 [0,4194304] 0 2024-04-18T21:07:03.182 INFO:tasks.workunit.client.0.smithi096.stdout:0/916: dwrite d1/d23/d32/daf/f131 [0,4194304] 0 2024-04-18T21:07:03.184 INFO:tasks.workunit.client.0.smithi096.stdout:5/897: chown d2/d11/d28/d4a/d131/da0/db5/l116 30409 1 2024-04-18T21:07:03.184 INFO:tasks.workunit.client.0.smithi096.stdout:5/898: stat d2/d11/d129 0 2024-04-18T21:07:03.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:03.188 INFO:tasks.workunit.client.0.smithi096.stdout:6/942: read d1/d61/d91/fb1 [4191368,88267] 0 2024-04-18T21:07:03.192 INFO:tasks.workunit.client.0.smithi096.stdout:6/943: dwrite d1/d61/fcf [0,4194304] 0 2024-04-18T21:07:03.194 INFO:tasks.workunit.client.0.smithi096.stdout:6/944: link d1/d5/l7b d1/d3a/d57/d66/d80/dfb/dbb/l13c 0 2024-04-18T21:07:03.195 INFO:tasks.workunit.client.0.smithi096.stdout:6/945: rmdir d1/d3a/d57/d66/d80/dfb 39 2024-04-18T21:07:03.196 INFO:tasks.workunit.client.0.smithi096.stdout:6/946: creat d1/d5/da/d46/d105/f13d x:0 0 0 2024-04-18T21:07:03.196 INFO:tasks.workunit.client.0.smithi096.stdout:5/899: dread d2/d11/d28/d4a/d131/da0/dcb/fde [0,4194304] 0 2024-04-18T21:07:03.197 INFO:tasks.workunit.client.0.smithi096.stdout:3/802: sync 2024-04-18T21:07:03.197 INFO:tasks.workunit.client.0.smithi096.stdout:6/947: symlink d1/d61/d91/d125/l13e 0 2024-04-18T21:07:03.198 INFO:tasks.workunit.client.0.smithi096.stdout:6/948: readlink d1/d17/l1f 0 2024-04-18T21:07:03.198 INFO:tasks.workunit.client.0.smithi096.stdout:3/803: mknod d4/d6/d22/d20/d46/dec/cf0 0 2024-04-18T21:07:03.200 INFO:tasks.workunit.client.0.smithi096.stdout:3/804: rename d4/d8/c37 to d4/d6/d1b/d2c/d31/d85/cf1 0 2024-04-18T21:07:03.201 INFO:tasks.workunit.client.0.smithi096.stdout:3/805: rmdir d4/d6/d1b/d2c/d5c/ddb 0 2024-04-18T21:07:03.203 INFO:tasks.workunit.client.0.smithi096.stdout:5/900: dwrite d2/d38/f4b [0,4194304] 0 2024-04-18T21:07:03.203 INFO:tasks.workunit.client.0.smithi096.stdout:3/806: symlink d4/d6/d1b/d2c/d31/d11/lf2 0 2024-04-18T21:07:03.205 INFO:tasks.workunit.client.0.smithi096.stdout:5/901: truncate d2/d11/d28/d4a/d55/d81/ddf/de5/f114 948865 0 2024-04-18T21:07:03.206 INFO:tasks.workunit.client.0.smithi096.stdout:3/807: unlink d4/d6/f92 0 2024-04-18T21:07:03.206 INFO:tasks.workunit.client.0.smithi096.stdout:5/902: mkdir d2/d18/d61/d6f/d137 0 2024-04-18T21:07:03.206 INFO:tasks.workunit.client.0.smithi096.stdout:3/808: stat d4/d6/d1b/d1d/fa7 0 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi096.stdout:5/903: rmdir d2/d11/d28/d4a/d131/da0/dcb 39 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi096.stdout:5/904: unlink d2/d38/lb3 0 2024-04-18T21:07:03.209 INFO:tasks.workunit.client.0.smithi096.stdout:5/905: creat d2/d11/d28/d4a/d131/d12b/f138 x:0 0 0 2024-04-18T21:07:03.209 INFO:tasks.workunit.client.0.smithi096.stdout:7/881: dread d0/d7/f5f [0,4194304] 0 2024-04-18T21:07:03.209 INFO:tasks.workunit.client.0.smithi096.stdout:5/906: fsync d2/d6a/d112/feb 0 2024-04-18T21:07:03.211 INFO:tasks.workunit.client.0.smithi096.stdout:5/907: creat d2/d11/d28/d4a/d131/da0/dab/ded/f139 x:0 0 0 2024-04-18T21:07:03.212 INFO:tasks.workunit.client.0.smithi096.stdout:5/908: fsync d2/d18/d61/d6f/d88/fe1 0 2024-04-18T21:07:03.213 INFO:tasks.workunit.client.0.smithi096.stdout:5/909: creat d2/d11/d28/d4a/d131/da0/dcb/f13a x:0 0 0 2024-04-18T21:07:03.213 INFO:tasks.workunit.client.0.smithi096.stdout:4/965: dread d2/d2a/d54/d5b/fea [0,4194304] 0 2024-04-18T21:07:03.214 INFO:tasks.workunit.client.0.smithi096.stdout:5/910: write d2/d11/f68 [1004754,6725] 0 2024-04-18T21:07:03.214 INFO:tasks.workunit.client.0.smithi096.stdout:4/966: write d2/d1d/fae [1294827,47623] 0 2024-04-18T21:07:03.215 INFO:tasks.workunit.client.0.smithi096.stdout:7/882: read d0/d7/d8/f1a [353242,51892] 0 2024-04-18T21:07:03.216 INFO:tasks.workunit.client.0.smithi096.stdout:3/809: sync 2024-04-18T21:07:03.222 INFO:tasks.workunit.client.0.smithi096.stdout:4/967: dwrite d2/d2f/d39/d43/f117 [0,4194304] 0 2024-04-18T21:07:03.223 INFO:tasks.workunit.client.0.smithi096.stdout:7/883: dwrite d0/d7/d8/f9c [0,4194304] 0 2024-04-18T21:07:03.224 INFO:tasks.workunit.client.0.smithi096.stdout:4/968: fdatasync d2/d2f/d33/d55/f9f 0 2024-04-18T21:07:03.224 INFO:tasks.workunit.client.0.smithi096.stdout:0/917: dwrite d1/da3/fc5 [0,4194304] 0 2024-04-18T21:07:03.225 INFO:tasks.workunit.client.0.smithi096.stdout:5/911: dread d2/d11/d28/d4a/fd6 [0,4194304] 0 2024-04-18T21:07:03.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/810: dwrite d4/d6/d1b/d2c/d31/d11/d8c/fe2 [0,4194304] 0 2024-04-18T21:07:03.226 INFO:tasks.workunit.client.0.smithi096.stdout:7/884: creat d0/d20/d39/dda/f123 x:0 0 0 2024-04-18T21:07:03.227 INFO:tasks.workunit.client.0.smithi096.stdout:5/912: symlink d2/d11/d28/d4a/d131/de8/l13b 0 2024-04-18T21:07:03.228 INFO:tasks.workunit.client.0.smithi096.stdout:7/885: unlink d0/d7/fb9 0 2024-04-18T21:07:03.228 INFO:tasks.workunit.client.0.smithi096.stdout:3/811: rename d4/d6/d1b/d2c/d31/d11/cd1 to d4/d6/d1b/d2c/d6b/d99/cf3 0 2024-04-18T21:07:03.228 INFO:tasks.workunit.client.0.smithi096.stdout:5/913: write d2/d6a/faa [132208,28211] 0 2024-04-18T21:07:03.229 INFO:tasks.workunit.client.0.smithi096.stdout:7/886: mkdir d0/d20/d39/dda/d124 0 2024-04-18T21:07:03.229 INFO:tasks.workunit.client.0.smithi096.stdout:6/949: dread d1/f3 [0,4194304] 0 2024-04-18T21:07:03.230 INFO:tasks.workunit.client.0.smithi096.stdout:7/887: fdatasync d0/d20/d6c/fdb 0 2024-04-18T21:07:03.230 INFO:tasks.workunit.client.0.smithi096.stdout:3/812: getdents d4/d6/d1b/d63 0 2024-04-18T21:07:03.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/888: symlink d0/d20/d39/l125 0 2024-04-18T21:07:03.231 INFO:tasks.workunit.client.0.smithi096.stdout:3/813: dread - d4/d6/dbb/fd9 zero size 2024-04-18T21:07:03.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/889: fsync d0/d20/d39/fce 0 2024-04-18T21:07:03.232 INFO:tasks.workunit.client.0.smithi096.stdout:6/950: creat d1/d5/da/d44/d97/da0/f13f x:0 0 0 2024-04-18T21:07:03.232 INFO:tasks.workunit.client.0.smithi096.stdout:3/814: write d4/d6/d1b/d1d/fed [508821,93354] 0 2024-04-18T21:07:03.233 INFO:tasks.workunit.client.0.smithi096.stdout:8/960: dread d0/d3/f49 [0,4194304] 0 2024-04-18T21:07:03.233 INFO:tasks.workunit.client.0.smithi096.stdout:6/951: write d1/d3a/d57/f9 [5943809,37675] 0 2024-04-18T21:07:03.234 INFO:tasks.workunit.client.0.smithi096.stdout:8/961: write d0/d3/d1d/d83/dcd/d7f/dac/fb7 [2269707,106008] 0 2024-04-18T21:07:03.234 INFO:tasks.workunit.client.0.smithi096.stdout:6/952: readlink d1/d5/da/d46/d71/d7c/l9e 0 2024-04-18T21:07:03.235 INFO:tasks.workunit.client.0.smithi096.stdout:3/815: link d4/d6/d22/d20/d46/l6d d4/d8/d49/db3/db4/lf4 0 2024-04-18T21:07:03.236 INFO:tasks.workunit.client.0.smithi096.stdout:4/969: read d2/d2f/d33/f3b [1944876,36197] 0 2024-04-18T21:07:03.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/953: mknod d1/d3a/d57/d66/d80/dfb/dbb/c140 0 2024-04-18T21:07:03.237 INFO:tasks.workunit.client.0.smithi096.stdout:8/962: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/dd9/f13d x:0 0 0 2024-04-18T21:07:03.238 INFO:tasks.workunit.client.0.smithi096.stdout:6/954: unlink d1/d61/d91/d125/l13e 0 2024-04-18T21:07:03.238 INFO:tasks.workunit.client.0.smithi096.stdout:1/925: dread d0/df/d16/d24/dc0/f73 [4194304,4194304] 0 2024-04-18T21:07:03.238 INFO:tasks.workunit.client.0.smithi096.stdout:5/914: dread d2/d18/d61/d6f/f91 [0,4194304] 0 2024-04-18T21:07:03.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/890: dwrite d0/f1d [0,4194304] 0 2024-04-18T21:07:03.240 INFO:tasks.workunit.client.0.smithi096.stdout:4/970: read d2/f50 [1347133,119801] 0 2024-04-18T21:07:03.240 INFO:tasks.workunit.client.0.smithi096.stdout:3/816: dread d4/d6/d1b/d2c/d31/d11/d8c/fe2 [0,4194304] 0 2024-04-18T21:07:03.241 INFO:tasks.workunit.client.0.smithi096.stdout:1/926: chown d0/df/d62/c7e 41 1 2024-04-18T21:07:03.241 INFO:tasks.workunit.client.0.smithi096.stdout:4/971: mknod d2/d2f/d33/d55/d57/d88/c13c 0 2024-04-18T21:07:03.241 INFO:tasks.workunit.client.0.smithi096.stdout:8/963: getdents d0/d3/d1d/d83/dcd/dd1 0 2024-04-18T21:07:03.241 INFO:tasks.workunit.client.0.smithi096.stdout:7/891: mkdir d0/d20/d39/d8a/df2/d126 0 2024-04-18T21:07:03.242 INFO:tasks.workunit.client.0.smithi096.stdout:6/955: getdents d1/d5/da/d44/d97/da0/d12e 0 2024-04-18T21:07:03.242 INFO:tasks.workunit.client.0.smithi096.stdout:3/817: creat d4/d8/d49/db3/db4/ff5 x:0 0 0 2024-04-18T21:07:03.242 INFO:tasks.workunit.client.0.smithi096.stdout:1/927: chown d0/df/de5/df8/d95/fbd 1288 1 2024-04-18T21:07:03.242 INFO:tasks.workunit.client.0.smithi096.stdout:4/972: fdatasync d2/d2a/d54/d5b/fea 0 2024-04-18T21:07:03.242 INFO:tasks.workunit.client.0.smithi096.stdout:8/964: creat d0/d3/d1d/d66/d10a/f13e x:0 0 0 2024-04-18T21:07:03.243 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:03.243+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:03.243 INFO:tasks.workunit.client.0.smithi096.stdout:7/892: write d0/d20/d62/d7d/dee/f114 [252211,64976] 0 2024-04-18T21:07:03.243 INFO:tasks.workunit.client.0.smithi096.stdout:1/928: chown d0/dd0/ffb 1159 1 2024-04-18T21:07:03.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/956: link d1/d3a/d57/d66/d80/fdc d1/d10d/f141 0 2024-04-18T21:07:03.244 INFO:tasks.workunit.client.0.smithi096.stdout:4/973: symlink d2/d2f/d39/d98/l13d 0 2024-04-18T21:07:03.244 INFO:tasks.workunit.client.0.smithi096.stdout:6/957: write d1/d3a/d57/d26/fdd [1923581,39323] 0 2024-04-18T21:07:03.244 INFO:tasks.workunit.client.0.smithi096.stdout:7/893: rename d0/d20/d62/dca/dd6 to d0/d20/d6c/d127 0 2024-04-18T21:07:03.245 INFO:tasks.workunit.client.0.smithi096.stdout:8/965: creat d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/dfe/d114/f13f x:0 0 0 2024-04-18T21:07:03.245 INFO:tasks.workunit.client.0.smithi096.stdout:4/974: mkdir d2/d2f/d33/d55/d57/d88/d13e 0 2024-04-18T21:07:03.245 INFO:tasks.workunit.client.0.smithi096.stdout:8/966: read - d0/d3/d1d/d102/f105 zero size 2024-04-18T21:07:03.245 INFO:tasks.workunit.client.0.smithi096.stdout:4/975: creat d2/d11e/f13f x:0 0 0 2024-04-18T21:07:03.246 INFO:tasks.workunit.client.0.smithi096.stdout:6/958: write d1/d5/da/d46/d71/dbc/f119 [214946,22] 0 2024-04-18T21:07:03.246 INFO:tasks.workunit.client.0.smithi096.stdout:7/894: truncate d0/d20/d4b/d7f/da1/ff4 440752 0 2024-04-18T21:07:03.247 INFO:tasks.workunit.client.0.smithi096.stdout:8/967: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/f12c zero size 2024-04-18T21:07:03.247 INFO:tasks.workunit.client.0.smithi096.stdout:7/895: fsync d0/d20/d6c/d127/fdc 0 2024-04-18T21:07:03.248 INFO:tasks.workunit.client.0.smithi096.stdout:6/959: rename d1/d5/da/d46/d71/dbc/f119 to d1/d3a/d57/d66/d114/f142 0 2024-04-18T21:07:03.249 INFO:tasks.workunit.client.0.smithi096.stdout:1/929: dread d0/df/d16/d24/dc0/f3c [0,4194304] 0 2024-04-18T21:07:03.249 INFO:tasks.workunit.client.0.smithi096.stdout:7/896: creat d0/d7/d42/d118/f128 x:0 0 0 2024-04-18T21:07:03.249 INFO:tasks.workunit.client.0.smithi096.stdout:8/968: read - d0/d3/d1d/d102/d115/f13c zero size 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi096.stdout:1/930: mkdir d0/df/d62/d12e 0 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi096.stdout:5/915: read d2/d18/d61/d6f/d88/fe1 [1134464,6598] 0 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi096.stdout:7/897: chown d0/d20/d62/dca/dae/ff1 72906636 1 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi096.stdout:3/818: dwrite d4/d6/d1b/d2c/d5c/f91 [0,4194304] 0 2024-04-18T21:07:03.252 INFO:tasks.workunit.client.0.smithi096.stdout:5/916: read d2/d6a/f86 [414035,90123] 0 2024-04-18T21:07:03.253 INFO:tasks.workunit.client.0.smithi096.stdout:3/819: creat d4/d6/d1b/d63/ff6 x:0 0 0 2024-04-18T21:07:03.255 INFO:tasks.workunit.client.0.smithi096.stdout:3/820: write d4/d6/d1b/d2c/d31/d93/fe1 [257666,123989] 0 2024-04-18T21:07:03.256 INFO:tasks.workunit.client.0.smithi096.stdout:8/969: dwrite d0/d3/d1d/d83/dcd/d7f/f112 [0,4194304] 0 2024-04-18T21:07:03.256 INFO:tasks.workunit.client.0.smithi096.stdout:3/821: mknod d4/d6/cf7 0 2024-04-18T21:07:03.258 INFO:tasks.workunit.client.0.smithi096.stdout:8/970: getdents d0/d3/d1d 0 2024-04-18T21:07:03.258 INFO:tasks.workunit.client.0.smithi096.stdout:8/971: read - d0/d3/d3a/dab/d46/dc5/f111 zero size 2024-04-18T21:07:03.263 INFO:tasks.workunit.client.0.smithi096.stdout:7/898: truncate d0/d20/d62/dca/fcc 109129 0 2024-04-18T21:07:03.263 INFO:tasks.workunit.client.0.smithi096.stdout:1/931: truncate d0/df/de5/df8/d9b/fb5 328198 0 2024-04-18T21:07:03.264 INFO:tasks.workunit.client.0.smithi096.stdout:7/899: write d0/d7/d8/f6a [1424035,65238] 0 2024-04-18T21:07:03.264 INFO:tasks.workunit.client.0.smithi096.stdout:8/972: dwrite d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/de1/f11a [0,4194304] 0 2024-04-18T21:07:03.265 INFO:tasks.workunit.client.0.smithi096.stdout:8/973: chown d0/d3/d1d/d83/dcd/d7f/dac/d1b/l1c 1549898941 1 2024-04-18T21:07:03.266 INFO:tasks.workunit.client.0.smithi096.stdout:8/974: chown d0/d3/d3a/cad 96 1 2024-04-18T21:07:03.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/932: rename d0/df/de5/df8/d9b/cb4 to d0/dd0/c12f 0 2024-04-18T21:07:03.266 INFO:tasks.workunit.client.0.smithi096.stdout:5/917: truncate d2/d11/d28/d4a/d131/da0/fac 4111340 0 2024-04-18T21:07:03.266 INFO:tasks.workunit.client.0.smithi096.stdout:1/933: readlink d0/df/d16/lc1 0 2024-04-18T21:07:03.267 INFO:tasks.workunit.client.0.smithi096.stdout:7/900: mknod d0/d20/c129 0 2024-04-18T21:07:03.267 INFO:tasks.workunit.client.0.smithi096.stdout:1/934: unlink d0/df/d16/d24/dac/fa0 0 2024-04-18T21:07:03.268 INFO:tasks.workunit.client.0.smithi096.stdout:8/975: creat d0/d3/d1d/d83/dcd/d7f/dac/d1b/d10b/f140 x:0 0 0 2024-04-18T21:07:03.268 INFO:tasks.workunit.client.0.smithi096.stdout:3/822: write d4/d6/f8a [198496,80344] 0 2024-04-18T21:07:03.268 INFO:tasks.workunit.client.0.smithi096.stdout:5/918: truncate d2/d11/d28/d4a/f59 3154156 0 2024-04-18T21:07:03.269 INFO:tasks.workunit.client.0.smithi096.stdout:8/976: fsync d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/f113 0 2024-04-18T21:07:03.270 INFO:tasks.workunit.client.0.smithi096.stdout:1/935: symlink d0/df/d62/l130 0 2024-04-18T21:07:03.270 INFO:tasks.workunit.client.0.smithi096.stdout:5/919: rmdir d2/d18/d61/d6f/d88 39 2024-04-18T21:07:03.271 INFO:tasks.workunit.client.0.smithi096.stdout:3/823: truncate d4/d6/d1b/d2c/f57 2308038 0 2024-04-18T21:07:03.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/936: creat d0/df/d16/d24/dac/dd2/f131 x:0 0 0 2024-04-18T21:07:03.272 INFO:tasks.workunit.client.0.smithi096.stdout:5/920: unlink d2/d11/d28/d4a/d131/da0/dcb/f126 0 2024-04-18T21:07:03.272 INFO:tasks.workunit.client.0.smithi096.stdout:7/901: dread d0/d20/f46 [4194304,4194304] 0 2024-04-18T21:07:03.273 INFO:tasks.workunit.client.0.smithi096.stdout:7/902: dread - d0/d7/d2f/d63/dd3/dd8/fe1 zero size 2024-04-18T21:07:03.273 INFO:tasks.workunit.client.0.smithi096.stdout:0/918: dread d1/db/d30/d31/f4c [0,4194304] 0 2024-04-18T21:07:03.273 INFO:tasks.workunit.client.0.smithi096.stdout:4/976: dread d2/d2f/d33/d55/de0/f10f [4194304,4194304] 0 2024-04-18T21:07:03.273 INFO:tasks.workunit.client.0.smithi096.stdout:5/921: write d2/d11/d28/d4a/d131/da0/f11e [105153,125560] 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi096.stdout:7/903: mkdir d0/d20/d6c/d127/dfa/d12a 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi096.stdout:4/977: readlink d2/d2f/d39/le1 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi096.stdout:1/937: rename d0/df/de5/df8/d9b/dca/dde/fc4 to d0/df/de5/df8/d9b/f132 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi096.stdout:7/904: dread - d0/d20/fe4 zero size 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi096.stdout:0/919: fsync d1/d23/d32/d43/d6f/d8a/d91/dba/dee/ff9 0 2024-04-18T21:07:03.275 INFO:tasks.workunit.client.0.smithi096.stdout:5/922: write d2/d11/d28/f78 [1220220,103829] 0 2024-04-18T21:07:03.276 INFO:tasks.workunit.client.0.smithi096.stdout:5/923: creat d2/d18/d61/d6d/d109/f13c x:0 0 0 2024-04-18T21:07:03.277 INFO:tasks.workunit.client.0.smithi096.stdout:1/938: truncate d0/df/d16/d24/d9c/f107 548985 0 2024-04-18T21:07:03.277 INFO:tasks.workunit.client.0.smithi096.stdout:7/905: link d0/d20/d39/f4c d0/d7/d42/d118/f12b 0 2024-04-18T21:07:03.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/920: truncate d1/db/d30/d4a/dae/dcf/fd9 379268 0 2024-04-18T21:07:03.277 INFO:tasks.workunit.client.0.smithi096.stdout:5/924: chown d2/d11/d28/d4a/d131/de8/d133 6 1 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi096.stdout:0/921: fdatasync d1/d23/d32/daf/f131 0 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi096.stdout:7/906: mknod d0/d20/d62/dca/dae/c12c 0 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi096.stdout:0/922: stat d1/db/l18 0 2024-04-18T21:07:03.279 INFO:tasks.workunit.client.0.smithi096.stdout:5/925: dread - d2/d11/d28/d4a/d69/ffc zero size 2024-04-18T21:07:03.279 INFO:tasks.workunit.client.0.smithi096.stdout:7/907: mkdir d0/d20/d6c/d127/d12d 0 2024-04-18T21:07:03.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/824: dread d4/d6/d1b/d2c/f5a [0,4194304] 0 2024-04-18T21:07:03.280 INFO:tasks.workunit.client.0.smithi096.stdout:0/923: truncate d1/db/d30/d4a/ffa 2037714 0 2024-04-18T21:07:03.281 INFO:tasks.workunit.client.0.smithi096.stdout:5/926: write d2/d18/d61/d6f/d88/fe1 [2823149,8817] 0 2024-04-18T21:07:03.281 INFO:tasks.workunit.client.0.smithi096.stdout:3/825: unlink d4/l2d 0 2024-04-18T21:07:03.281 INFO:tasks.workunit.client.0.smithi096.stdout:7/908: unlink d0/d7/d2f/d53/f84 0 2024-04-18T21:07:03.284 INFO:tasks.workunit.client.0.smithi096.stdout:0/924: symlink d1/db/d30/d31/d85/d58/l135 0 2024-04-18T21:07:03.285 INFO:tasks.workunit.client.0.smithi096.stdout:1/939: dwrite d0/df/d16/d24/da8/fae [4194304,4194304] 0 2024-04-18T21:07:03.285 INFO:tasks.workunit.client.0.smithi096.stdout:3/826: rename d4/d8/lbf to d4/d8/d49/db3/db4/de6/lf8 0 2024-04-18T21:07:03.286 INFO:tasks.workunit.client.0.smithi096.stdout:3/827: write d4/d6/d1b/d1d/fa7 [700550,4310] 0 2024-04-18T21:07:03.287 INFO:tasks.workunit.client.0.smithi096.stdout:4/978: write d2/d2f/d33/d55/f9f [725760,23767] 0 2024-04-18T21:07:03.287 INFO:tasks.workunit.client.0.smithi096.stdout:0/925: creat d1/db/d30/d12d/f136 x:0 0 0 2024-04-18T21:07:03.288 INFO:tasks.workunit.client.0.smithi096.stdout:7/909: dwrite d0/d7/d2f/d63/f9a [0,4194304] 0 2024-04-18T21:07:03.288 INFO:tasks.workunit.client.0.smithi096.stdout:8/977: dread d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/fbc [0,4194304] 0 2024-04-18T21:07:03.289 INFO:tasks.workunit.client.0.smithi096.stdout:6/960: sync 2024-04-18T21:07:03.289 INFO:tasks.workunit.client.0.smithi096.stdout:7/910: write d0/d20/d6c/fdb [2542885,78144] 0 2024-04-18T21:07:03.290 INFO:tasks.workunit.client.0.smithi096.stdout:6/961: chown d1/d5/da/l24 0 1 2024-04-18T21:07:03.290 INFO:tasks.workunit.client.0.smithi096.stdout:7/911: truncate d0/d7/d42/f74 4297938 0 2024-04-18T21:07:03.291 INFO:tasks.workunit.client.0.smithi096.stdout:0/926: mknod d1/db/dda/c137 0 2024-04-18T21:07:03.291 INFO:tasks.workunit.client.0.smithi096.stdout:8/978: chown d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/f113 12694 1 2024-04-18T21:07:03.291 INFO:tasks.workunit.client.0.smithi096.stdout:4/979: mknod d2/d2f/d33/d55/d59/d5f/c140 0 2024-04-18T21:07:03.294 INFO:tasks.workunit.client.0.smithi096.stdout:4/980: rename d2/d2f/d33/d55/d59/d5f/dcd/f10e to d2/dbb/dde/f141 0 2024-04-18T21:07:03.294 INFO:tasks.workunit.client.0.smithi096.stdout:4/981: fsync d2/d1d/fae 0 2024-04-18T21:07:03.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/927: link d1/d23/d32/d43/d6f/l7c d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/d124/l138 0 2024-04-18T21:07:03.296 INFO:tasks.workunit.client.0.smithi096.stdout:7/912: dread d0/d11/d18/faf [4194304,4194304] 0 2024-04-18T21:07:03.296 INFO:tasks.workunit.client.0.smithi096.stdout:3/828: dwrite d4/d6/d1b/d2c/d6b/d99/da6/f78 [0,4194304] 0 2024-04-18T21:07:03.298 INFO:tasks.workunit.client.0.smithi096.stdout:3/829: mknod d4/d6/d1b/d2c/d6b/d99/cf9 0 2024-04-18T21:07:03.298 INFO:tasks.workunit.client.0.smithi096.stdout:0/928: creat d1/db/dda/de9/deb/d6d/f139 x:0 0 0 2024-04-18T21:07:03.298 INFO:tasks.workunit.client.0.smithi096.stdout:7/913: creat d0/d20/d6c/d127/d12d/f12e x:0 0 0 2024-04-18T21:07:03.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/982: link d2/d2a/d54/l64 d2/d2f/d33/d55/d59/db9/l142 0 2024-04-18T21:07:03.299 INFO:tasks.workunit.client.0.smithi096.stdout:0/929: stat d1/db/d30/d31/f4c 0 2024-04-18T21:07:03.299 INFO:tasks.workunit.client.0.smithi096.stdout:7/914: symlink d0/d20/d6c/d127/l12f 0 2024-04-18T21:07:03.300 INFO:tasks.workunit.client.0.smithi096.stdout:4/983: mknod d2/d2f/d33/d55/de0/d125/c143 0 2024-04-18T21:07:03.305 INFO:tasks.workunit.client.0.smithi096.stdout:7/915: dwrite d0/d11/f17 [4194304,4194304] 0 2024-04-18T21:07:03.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/927: dread d2/d11/d28/d4a/d131/de8/f12e [0,4194304] 0 2024-04-18T21:07:03.306 INFO:tasks.workunit.client.0.smithi096.stdout:5/928: fdatasync d2/d11/d28/d4a/d55/d81/f9c 0 2024-04-18T21:07:03.307 INFO:tasks.workunit.client.0.smithi096.stdout:4/984: truncate d2/d2a/f7b 1460020 0 2024-04-18T21:07:03.311 INFO:tasks.workunit.client.0.smithi096.stdout:1/940: dread d0/df/de5/df8/d95/fba [0,4194304] 0 2024-04-18T21:07:03.312 INFO:tasks.workunit.client.0.smithi096.stdout:7/916: dwrite d0/d7/d2f/d63/f9a [0,4194304] 0 2024-04-18T21:07:03.313 INFO:tasks.workunit.client.0.smithi096.stdout:1/941: chown d0/df/d16/f37 17 1 2024-04-18T21:07:03.313 INFO:tasks.workunit.client.0.smithi096.stdout:5/929: dwrite d2/fe7 [4194304,4194304] 0 2024-04-18T21:07:03.313 INFO:tasks.workunit.client.0.smithi096.stdout:5/930: chown d2/d8f/fbd 15369858 1 2024-04-18T21:07:03.314 INFO:tasks.workunit.client.0.smithi096.stdout:7/917: creat d0/d20/d6c/d127/dfa/f130 x:0 0 0 2024-04-18T21:07:03.315 INFO:tasks.workunit.client.0.smithi096.stdout:1/942: mkdir d0/df/d16/d24/d121/d133 0 2024-04-18T21:07:03.315 INFO:tasks.workunit.client.0.smithi096.stdout:7/918: mkdir d0/d20/d62/dca/d131 0 2024-04-18T21:07:03.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/919: mknod d0/d20/d39/c132 0 2024-04-18T21:07:03.321 INFO:tasks.workunit.client.0.smithi096.stdout:1/943: dwrite d0/df/d16/d24/dc0/f73 [4194304,4194304] 0 2024-04-18T21:07:03.322 INFO:tasks.workunit.client.0.smithi096.stdout:6/962: dread d1/d3a/d57/d26/f3c [0,4194304] 0 2024-04-18T21:07:03.323 INFO:tasks.workunit.client.0.smithi096.stdout:6/963: mkdir d1/d3a/d57/d66/d80/dfb/d94/d143 0 2024-04-18T21:07:03.325 INFO:tasks.workunit.client.0.smithi096.stdout:6/964: mknod d1/d3a/d57/d66/d80/c144 0 2024-04-18T21:07:03.325 INFO:tasks.workunit.client.0.smithi096.stdout:0/930: sync 2024-04-18T21:07:03.325 INFO:tasks.workunit.client.0.smithi096.stdout:5/931: dread d2/d11/d28/d4a/d55/fc2 [0,4194304] 0 2024-04-18T21:07:03.326 INFO:tasks.workunit.client.0.smithi096.stdout:6/965: rename d1/d3a/d57/de3/c96 to d1/d3a/dec/d10f/c145 0 2024-04-18T21:07:03.327 INFO:tasks.workunit.client.0.smithi096.stdout:0/931: chown d1/d23/d32/d43/d6f/d8a/d96/c123 1871769072 1 2024-04-18T21:07:03.327 INFO:tasks.workunit.client.0.smithi096.stdout:5/932: rename d2/d11/d28/d4a/d131/de8/c11a to d2/d6a/d112/c13d 0 2024-04-18T21:07:03.328 INFO:tasks.workunit.client.0.smithi096.stdout:1/944: dwrite d0/df/d16/d24/da8/f108 [0,4194304] 0 2024-04-18T21:07:03.330 INFO:tasks.workunit.client.0.smithi096.stdout:5/933: unlink d2/d18/lbb 0 2024-04-18T21:07:03.333 INFO:tasks.workunit.client.0.smithi096.stdout:1/945: dread d0/df/d16/d24/dc0/d5f/f6f [0,4194304] 0 2024-04-18T21:07:03.334 INFO:tasks.workunit.client.0.smithi096.stdout:6/966: dwrite d1/d5/f69 [0,4194304] 0 2024-04-18T21:07:03.334 INFO:tasks.workunit.client.0.smithi096.stdout:7/920: dread d0/d20/d39/d59/fba [0,4194304] 0 2024-04-18T21:07:03.334 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:03.334 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:03.335 INFO:tasks.workunit.client.0.smithi096.stdout:1/946: write d0/df/d30/d53/da2/f10a [2397254,117829] 0 2024-04-18T21:07:03.336 INFO:tasks.workunit.client.0.smithi096.stdout:6/967: creat d1/d5/da/d44/d97/f146 x:0 0 0 2024-04-18T21:07:03.337 INFO:tasks.workunit.client.0.smithi096.stdout:8/979: dread d0/d3/d1d/f24 [0,4194304] 0 2024-04-18T21:07:03.337 INFO:tasks.workunit.client.0.smithi096.stdout:6/968: write d1/d5/da/d46/d71/f84 [514596,114167] 0 2024-04-18T21:07:03.338 INFO:tasks.workunit.client.0.smithi096.stdout:5/934: dwrite d2/d11/d28/d4a/d131/d12b/f138 [0,4194304] 0 2024-04-18T21:07:03.341 INFO:tasks.workunit.client.0.smithi096.stdout:3/830: dread d4/d6/d1b/f38 [0,4194304] 0 2024-04-18T21:07:03.341 INFO:tasks.workunit.client.0.smithi096.stdout:7/921: dwrite d0/d7/d2f/d53/f92 [0,4194304] 0 2024-04-18T21:07:03.342 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:03.341+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:03.342 INFO:tasks.workunit.client.0.smithi096.stdout:7/922: rmdir d0/d20/d62/d7d 39 2024-04-18T21:07:03.342 INFO:tasks.workunit.client.0.smithi096.stdout:3/831: truncate d4/d6/dbb/fd9 805342 0 2024-04-18T21:07:03.344 INFO:tasks.workunit.client.0.smithi096.stdout:5/935: dwrite d2/d8f/ff5 [0,4194304] 0 2024-04-18T21:07:03.346 INFO:tasks.workunit.client.0.smithi096.stdout:5/936: symlink d2/d11/d28/d4a/d55/d81/ddf/de5/l13e 0 2024-04-18T21:07:03.348 INFO:tasks.workunit.client.0.smithi096.stdout:0/932: dwrite d1/db/d30/f86 [0,4194304] 0 2024-04-18T21:07:03.350 INFO:tasks.workunit.client.0.smithi096.stdout:4/985: dread d2/d2f/d33/d55/d59/db9/fca [0,4194304] 0 2024-04-18T21:07:03.350 INFO:tasks.workunit.client.0.smithi096.stdout:8/980: write d0/d3/d1d/d102/d115/f6a [2842711,82079] 0 2024-04-18T21:07:03.350 INFO:tasks.workunit.client.0.smithi096.stdout:5/937: symlink d2/d11/d28/d4a/d131/de8/d133/l13f 0 2024-04-18T21:07:03.351 INFO:tasks.workunit.client.0.smithi096.stdout:0/933: rename d1/da3/dde/lf3 to d1/db/d30/d12d/l13a 0 2024-04-18T21:07:03.351 INFO:tasks.workunit.client.0.smithi096.stdout:3/832: dwrite d4/d8/d49/d9e/fd7 [0,4194304] 0 2024-04-18T21:07:03.351 INFO:tasks.workunit.client.0.smithi096.stdout:7/923: dwrite d0/d7/d42/d118/f128 [0,4194304] 0 2024-04-18T21:07:03.352 INFO:tasks.workunit.client.0.smithi096.stdout:5/938: mknod d2/d6a/d112/c140 0 2024-04-18T21:07:03.352 INFO:tasks.workunit.client.0.smithi096.stdout:4/986: symlink d2/d2f/d33/d55/d59/l144 0 2024-04-18T21:07:03.352 INFO:tasks.workunit.client.0.smithi096.stdout:3/833: chown d4/d6/d22/l1e 1378513 1 2024-04-18T21:07:03.353 INFO:tasks.workunit.client.0.smithi096.stdout:8/981: unlink d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/dd9/f13d 0 2024-04-18T21:07:03.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:03.355 INFO:tasks.workunit.client.0.smithi096.stdout:4/987: creat d2/d2f/d33/d55/d59/db9/f145 x:0 0 0 2024-04-18T21:07:03.355 INFO:tasks.workunit.client.0.smithi096.stdout:3/834: rename d4/d6/d1b/d2c/f5a to d4/d6/d22/d20/d46/d50/daa/ffa 0 2024-04-18T21:07:03.355 INFO:tasks.workunit.client.0.smithi096.stdout:8/982: rmdir d0/d3/d1d/d83/dcd/dd1 39 2024-04-18T21:07:03.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/983: unlink d0/d3/d3a/f127 0 2024-04-18T21:07:03.357 INFO:tasks.workunit.client.0.smithi096.stdout:4/988: rename d2/d2f/d39/d98/l13d to d2/d2f/d33/d55/d57/l146 0 2024-04-18T21:07:03.358 INFO:tasks.workunit.client.0.smithi096.stdout:3/835: write d4/d6/d1b/f38 [323599,95713] 0 2024-04-18T21:07:03.358 INFO:tasks.workunit.client.0.smithi096.stdout:4/989: readlink d2/d2f/d39/d98/l12a 0 2024-04-18T21:07:03.360 INFO:tasks.workunit.client.0.smithi096.stdout:5/939: dwrite d2/f7 [0,4194304] 0 2024-04-18T21:07:03.360 INFO:tasks.workunit.client.0.smithi096.stdout:6/969: read d1/d17/f2f [2023912,78709] 0 2024-04-18T21:07:03.361 INFO:tasks.workunit.client.0.smithi096.stdout:6/970: sync 2024-04-18T21:07:03.361 INFO:tasks.workunit.client.0.smithi096.stdout:8/984: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/d2f/dfe/d114/f13f zero size 2024-04-18T21:07:03.361 INFO:tasks.workunit.client.0.smithi096.stdout:7/924: dwrite d0/d20/f34 [0,4194304] 0 2024-04-18T21:07:03.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/934: dwrite d1/db/d30/d31/d85/f5 [0,4194304] 0 2024-04-18T21:07:03.362 INFO:tasks.workunit.client.0.smithi096.stdout:4/990: getdents d2/d2f/d33/d55/d57/d88/d13e 0 2024-04-18T21:07:03.362 INFO:tasks.workunit.client.0.smithi096.stdout:6/971: creat d1/d61/d91/dd1/f147 x:0 0 0 2024-04-18T21:07:03.362 INFO:tasks.workunit.client.0.smithi096.stdout:6/972: sync 2024-04-18T21:07:03.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/925: rmdir d0/d20/d62/dca/d131 0 2024-04-18T21:07:03.363 INFO:tasks.workunit.client.0.smithi096.stdout:4/991: truncate d2/d1d/faf 519223 0 2024-04-18T21:07:03.363 INFO:tasks.workunit.client.0.smithi096.stdout:0/935: creat d1/db/dda/de9/deb/d6d/db1/f13b x:0 0 0 2024-04-18T21:07:03.364 INFO:tasks.workunit.client.0.smithi096.stdout:7/926: write d0/fdf [1105169,15556] 0 2024-04-18T21:07:03.365 INFO:tasks.workunit.client.0.smithi096.stdout:8/985: creat d0/d3/d3a/f141 x:0 0 0 2024-04-18T21:07:03.365 INFO:tasks.workunit.client.0.smithi096.stdout:7/927: rmdir d0/d7/d2f/d63/dd3/dd8 39 2024-04-18T21:07:03.366 INFO:tasks.workunit.client.0.smithi096.stdout:6/973: link d1/d3a/d57/d66/d80/dfb/dbb/l12f d1/d61/d91/dd1/l148 0 2024-04-18T21:07:03.366 INFO:tasks.workunit.client.0.smithi096.stdout:4/992: mknod d2/d2f/d33/d55/d59/d12f/c147 0 2024-04-18T21:07:03.367 INFO:tasks.workunit.client.0.smithi096.stdout:7/928: rmdir d0/d20/d62/dca/dae/d10f 0 2024-04-18T21:07:03.368 INFO:tasks.workunit.client.0.smithi096.stdout:8/986: dread - d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/f108 zero size 2024-04-18T21:07:03.368 INFO:tasks.workunit.client.0.smithi096.stdout:6/974: chown d1/d5/da/d55/ld0 1076797818 1 2024-04-18T21:07:03.369 INFO:tasks.workunit.client.0.smithi096.stdout:5/940: dwrite d2/d11/f52 [0,4194304] 0 2024-04-18T21:07:03.369 INFO:tasks.workunit.client.0.smithi096.stdout:6/975: readlink d1/d5/da/l24 0 2024-04-18T21:07:03.370 INFO:tasks.workunit.client.0.smithi096.stdout:5/941: write d2/f3a [271366,98662] 0 2024-04-18T21:07:03.371 INFO:tasks.workunit.client.0.smithi096.stdout:0/936: dwrite d1/db/d30/f5c [0,4194304] 0 2024-04-18T21:07:03.372 INFO:tasks.workunit.client.0.smithi096.stdout:8/987: rmdir d0/d3/d1d/d83/dcd/d7f/dac/d33/db4/df2 0 2024-04-18T21:07:03.373 INFO:tasks.workunit.client.0.smithi096.stdout:8/988: mknod d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/c142 0 2024-04-18T21:07:03.374 INFO:tasks.workunit.client.0.smithi096.stdout:8/989: readlink d0/d3/d1d/d66/d10a/d120/d137/l13a 0 2024-04-18T21:07:03.374 INFO:tasks.workunit.client.0.smithi096.stdout:6/976: dread d1/d5/f69 [0,4194304] 0 2024-04-18T21:07:03.374 INFO:tasks.workunit.client.0.smithi096.stdout:6/977: truncate d1/d17/fe7 531364 0 2024-04-18T21:07:03.375 INFO:tasks.workunit.client.0.smithi096.stdout:8/990: chown d0/d64/f52 49104 1 2024-04-18T21:07:03.376 INFO:tasks.workunit.client.0.smithi096.stdout:8/991: chown d0/d3/d1d/d83/dcd/d7f/dac/d1b/c4e 1 1 2024-04-18T21:07:03.376 INFO:tasks.workunit.client.0.smithi096.stdout:6/978: creat d1/d5/da/d46/d71/f149 x:0 0 0 2024-04-18T21:07:03.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/992: fdatasync d0/d3/d1d/d66/d10a/f13e 0 2024-04-18T21:07:03.379 INFO:tasks.workunit.client.0.smithi096.stdout:3/836: dread d4/d6/d22/d20/d46/d50/daa/ffa [0,4194304] 0 2024-04-18T21:07:03.380 INFO:tasks.workunit.client.0.smithi096.stdout:3/837: symlink d4/d6/lfb 0 2024-04-18T21:07:03.382 INFO:tasks.workunit.client.0.smithi096.stdout:3/838: getdents d4/d6/d22/d20/d46 0 2024-04-18T21:07:03.383 INFO:tasks.workunit.client.0.smithi096.stdout:8/993: dwrite d0/d3/f23 [0,4194304] 0 2024-04-18T21:07:03.383 INFO:tasks.workunit.client.0.smithi096.stdout:3/839: creat d4/d6/d7/db8/ffc x:0 0 0 2024-04-18T21:07:03.384 INFO:tasks.workunit.client.0.smithi096.stdout:8/994: mknod d0/d3/d3a/dab/d46/dc5/c143 0 2024-04-18T21:07:03.385 INFO:tasks.workunit.client.0.smithi096.stdout:4/993: rename d2/d2f/d33/d55/d59/d12f to d2/d2f/d33/d55/d57/d7d/d148 0 2024-04-18T21:07:03.385 INFO:tasks.workunit.client.0.smithi096.stdout:7/929: rename d0/d20/d4b/d7f/d106 to d0/d20/d62/d7d/dee/d133 0 2024-04-18T21:07:03.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/995: symlink d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/de4/l144 0 2024-04-18T21:07:03.386 INFO:tasks.workunit.client.0.smithi096.stdout:4/994: mkdir d2/d2f/d33/d55/d59/db9/d149 0 2024-04-18T21:07:03.386 INFO:tasks.workunit.client.0.smithi096.stdout:6/979: rename d1/d5/cc3 to d1/d5/da/d46/d71/d7c/d8b/c14a 0 2024-04-18T21:07:03.387 INFO:tasks.workunit.client.0.smithi096.stdout:7/930: write d0/d7/d8/faa [94002,40028] 0 2024-04-18T21:07:03.387 INFO:tasks.workunit.client.0.smithi096.stdout:8/996: mknod d0/c145 0 2024-04-18T21:07:03.387 INFO:tasks.workunit.client.0.smithi096.stdout:4/995: mknod d2/d2f/d39/c14a 0 2024-04-18T21:07:03.388 INFO:tasks.workunit.client.0.smithi096.stdout:6/980: write d1/d5/da/d46/d71/d7c/f8f [9401183,5766] 0 2024-04-18T21:07:03.388 INFO:tasks.workunit.client.0.smithi096.stdout:7/931: symlink d0/d7/d2f/d63/dc4/d104/l134 0 2024-04-18T21:07:03.388 INFO:tasks.workunit.client.0.smithi096.stdout:4/996: chown d2/d2f/d33/d55/d59/d5f 656628 1 2024-04-18T21:07:03.388 INFO:tasks.workunit.client.0.smithi096.stdout:8/997: chown d0/d3/d3a/dab/d46/dc5/f111 805 1 2024-04-18T21:07:03.388 INFO:tasks.workunit.client.0.smithi096.stdout:5/942: write d2/d11/d28/d4a/d55/f7c [4496521,112368] 0 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:5/943: chown d2/d18/d61/d6f/d7a/c7f 2368767 1 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:7/932: link d0/d20/d62/c11d d0/d7/d2f/c135 0 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:6/981: getdents d1/d61/d91/dd1 0 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:5/944: sync 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:6/982: sync 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:7/933: chown d0/d20/d39/d8a/df2 3 1 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:6/983: fsync d1/d3a/d57/d66/d114/f135 0 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi096.stdout:7/934: symlink d0/d7/d8/l136 0 2024-04-18T21:07:03.391 INFO:tasks.workunit.client.0.smithi096.stdout:7/935: write d0/d7/d42/f74 [1688561,4187] 0 2024-04-18T21:07:03.391 INFO:tasks.workunit.client.0.smithi096.stdout:6/984: rename d1/d3a/d57/d66/d80/dfb/d94/f109 to d1/f14b 0 2024-04-18T21:07:03.392 INFO:tasks.workunit.client.0.smithi096.stdout:7/936: symlink d0/d20/d6c/d127/dfa/l137 0 2024-04-18T21:07:03.392 INFO:tasks.workunit.client.0.smithi096.stdout:6/985: read - d1/d5/da/d46/f123 zero size 2024-04-18T21:07:03.393 INFO:tasks.workunit.client.0.smithi096.stdout:7/937: creat d0/d7/d2f/d63/dd3/f138 x:0 0 0 2024-04-18T21:07:03.394 INFO:tasks.workunit.client.0.smithi096.stdout:7/938: mkdir d0/d139 0 2024-04-18T21:07:03.394 INFO:tasks.workunit.client.0.smithi096.stdout:7/939: mkdir d0/d20/d13a 0 2024-04-18T21:07:03.395 INFO:tasks.workunit.client.0.smithi096.stdout:7/940: unlink d0/d11/d18/l75 0 2024-04-18T21:07:03.396 INFO:tasks.workunit.client.0.smithi096.stdout:7/941: rename d0/d7/d8/l37 to d0/d20/d6c/d127/dfa/l13b 0 2024-04-18T21:07:03.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/998: write d0/d3/d1d/d83/dcd/fa0 [639720,94009] 0 2024-04-18T21:07:03.398 INFO:tasks.workunit.client.0.smithi096.stdout:6/986: dwrite d1/d5/da/f21 [0,4194304] 0 2024-04-18T21:07:03.400 INFO:tasks.workunit.client.0.smithi096.stdout:8/999: mkdir d0/d3/d1d/d83/dcd/d7f/dac/d56/d4d/d9d/ddc/dc3/d146 0 2024-04-18T21:07:03.401 INFO:tasks.workunit.client.0.smithi096.stdout:1/947: dread d0/df/d30/d53/f12b [0,4194304] 0 2024-04-18T21:07:03.402 INFO:tasks.workunit.client.0.smithi096.stdout:1/948: rename d0/dd0/ddb to d0/dd0/d134 0 2024-04-18T21:07:03.403 INFO:tasks.workunit.client.0.smithi096.stdout:1/949: creat d0/df/d62/db1/f135 x:0 0 0 2024-04-18T21:07:03.403 INFO:tasks.workunit.client.0.smithi096.stdout:6/987: dwrite d1/f41 [0,4194304] 0 2024-04-18T21:07:03.404 INFO:tasks.workunit.client.0.smithi096.stdout:1/950: write d0/df/de5/d120/f12c [573711,56584] 0 2024-04-18T21:07:03.404 INFO:tasks.workunit.client.0.smithi096.stdout:6/988: chown d1/f34 287638624 1 2024-04-18T21:07:03.405 INFO:tasks.workunit.client.0.smithi096.stdout:1/951: write d0/df/d30/f94 [1642213,105945] 0 2024-04-18T21:07:03.405 INFO:tasks.workunit.client.0.smithi096.stdout:6/989: symlink d1/d3a/d36/d7a/l14c 0 2024-04-18T21:07:03.406 INFO:tasks.workunit.client.0.smithi096.stdout:1/952: unlink d0/df/d16/d24/c2c 0 2024-04-18T21:07:03.406 INFO:tasks.workunit.client.0.smithi096.stdout:6/990: unlink d1/d5/da/d46/d105/f13d 0 2024-04-18T21:07:03.406 INFO:tasks.workunit.client.0.smithi096.stdout:1/953: fdatasync d0/df/d16/d24/f2b 0 2024-04-18T21:07:03.408 INFO:tasks.workunit.client.0.smithi096.stdout:1/954: getdents d0/df/de5/df8 0 2024-04-18T21:07:03.410 INFO:tasks.workunit.client.0.smithi096.stdout:1/955: mkdir d0/df/d16/d24/dc0/d5f/d136 0 2024-04-18T21:07:03.413 INFO:tasks.workunit.client.0.smithi096.stdout:0/937: dread d1/db/d30/d31/f47 [0,4194304] 0 2024-04-18T21:07:03.413 INFO:tasks.workunit.client.0.smithi096.stdout:6/991: dwrite d1/d3a/f132 [0,4194304] 0 2024-04-18T21:07:03.416 INFO:tasks.workunit.client.0.smithi096.stdout:0/938: rename d1/db/d30/d4a/c12c to d1/db/c13c 0 2024-04-18T21:07:03.416 INFO:tasks.workunit.client.0.smithi096.stdout:6/992: rename d1/d5/da/d46/cc2 to d1/d5/da/d46/d71/c14d 0 2024-04-18T21:07:03.417 INFO:tasks.workunit.client.0.smithi096.stdout:6/993: creat d1/d5/da/d46/d71/dbc/df6/f14e x:0 0 0 2024-04-18T21:07:03.418 INFO:tasks.workunit.client.0.smithi096.stdout:4/997: dread d2/d2f/fb1 [0,4194304] 0 2024-04-18T21:07:03.419 INFO:tasks.workunit.client.0.smithi096.stdout:6/994: rename d1/d5/da/d44/cb6 to d1/d5/da/d46/d71/d7c/d8b/d10e/c14f 0 2024-04-18T21:07:03.420 INFO:tasks.workunit.client.0.smithi096.stdout:4/998: mkdir d2/d2f/d33/d55/d57/d7d/d14b 0 2024-04-18T21:07:03.421 INFO:tasks.workunit.client.0.smithi096.stdout:4/999: dread - d2/d2f/d33/d55/d59/d5f/dcd/f12b zero size 2024-04-18T21:07:03.422 INFO:tasks.workunit.client.0.smithi096.stdout:0/939: dwrite d1/db/d30/d31/d85/d58/fd0 [0,4194304] 0 2024-04-18T21:07:03.424 INFO:tasks.workunit.client.0.smithi096.stdout:0/940: symlink d1/db/d30/d31/d85/d112/l13d 0 2024-04-18T21:07:03.424 INFO:tasks.workunit.client.0.smithi096.stdout:3/840: dread d4/d6/d22/d20/f76 [0,4194304] 0 2024-04-18T21:07:03.425 INFO:tasks.workunit.client.0.smithi096.stdout:0/941: creat d1/d23/d32/d43/d6f/d8a/d91/f13e x:0 0 0 2024-04-18T21:07:03.426 INFO:tasks.workunit.client.0.smithi096.stdout:0/942: rmdir d1/d23/d32/d43/d6f/d8a 39 2024-04-18T21:07:03.428 INFO:tasks.workunit.client.0.smithi096.stdout:0/943: creat d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/d124/f13f x:0 0 0 2024-04-18T21:07:03.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/841: dread d4/d6/d1b/d2c/d5c/f91 [0,4194304] 0 2024-04-18T21:07:03.428 INFO:tasks.workunit.client.0.smithi096.stdout:0/944: write d1/f8e [2925693,59493] 0 2024-04-18T21:07:03.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/842: fsync d4/d6/d1b/d2c/d5c/fca 0 2024-04-18T21:07:03.429 INFO:tasks.workunit.client.0.smithi096.stdout:0/945: mkdir d1/db/d30/d4a/d140 0 2024-04-18T21:07:03.429 INFO:tasks.workunit.client.0.smithi096.stdout:3/843: readlink d4/d8/d49/lc0 0 2024-04-18T21:07:03.430 INFO:tasks.workunit.client.0.smithi096.stdout:0/946: mkdir d1/d23/d32/d43/d6f/dd3/d141 0 2024-04-18T21:07:03.431 INFO:tasks.workunit.client.0.smithi096.stdout:0/947: mknod d1/d23/d32/d43/d6f/d8a/d91/dba/dee/c142 0 2024-04-18T21:07:03.432 INFO:tasks.workunit.client.0.smithi096.stdout:0/948: unlink d1/d23/d32/d43/d6f/d8a/d96/c9c 0 2024-04-18T21:07:03.434 INFO:tasks.workunit.client.0.smithi096.stdout:3/844: dwrite d4/d6/d7/d90/fa4 [0,4194304] 0 2024-04-18T21:07:03.438 INFO:tasks.workunit.client.0.smithi096.stdout:0/949: dwrite d1/fca [0,4194304] 0 2024-04-18T21:07:03.440 INFO:tasks.workunit.client.0.smithi096.stdout:0/950: truncate d1/d23/d32/fa7 709620 0 2024-04-18T21:07:03.441 INFO:tasks.workunit.client.0.smithi096.stdout:7/942: dread d0/d20/d39/ffe [0,4194304] 0 2024-04-18T21:07:03.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:03.438+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:03.443 INFO:tasks.workunit.client.0.smithi096.stdout:5/945: dread d2/d11/ff8 [0,4194304] 0 2024-04-18T21:07:03.444 INFO:tasks.workunit.client.0.smithi096.stdout:1/956: dread d0/df/d16/d24/dac/d65/fbf [0,4194304] 0 2024-04-18T21:07:03.444 INFO:tasks.workunit.client.0.smithi096.stdout:5/946: stat d2/d18/c6e 0 2024-04-18T21:07:03.445 INFO:tasks.workunit.client.0.smithi096.stdout:5/947: symlink d2/d11/l141 0 2024-04-18T21:07:03.445 INFO:tasks.workunit.client.0.smithi096.stdout:5/948: chown d2/d18 108488 1 2024-04-18T21:07:03.447 INFO:tasks.workunit.client.0.smithi096.stdout:3/845: write d4/d8/f48 [2127699,51556] 0 2024-04-18T21:07:03.448 INFO:tasks.workunit.client.0.smithi096.stdout:3/846: chown d4/d6/d1b/d63/cc6 202 1 2024-04-18T21:07:03.449 INFO:tasks.workunit.client.0.smithi096.stdout:0/951: dwrite d1/d23/d32/d43/f119 [0,4194304] 0 2024-04-18T21:07:03.450 INFO:tasks.workunit.client.0.smithi096.stdout:1/957: dwrite d0/df/d62/d110/f116 [0,4194304] 0 2024-04-18T21:07:03.458 INFO:tasks.workunit.client.0.smithi096.stdout:3/847: sync 2024-04-18T21:07:03.459 INFO:tasks.workunit.client.0.smithi096.stdout:3/848: write d4/d6/d1b/d1d/fed [462093,75612] 0 2024-04-18T21:07:03.460 INFO:tasks.workunit.client.0.smithi096.stdout:3/849: read - d4/d6/d7/db8/ffc zero size 2024-04-18T21:07:03.461 INFO:tasks.workunit.client.0.smithi096.stdout:3/850: truncate d4/d8/d7f/d94/fda 391167 0 2024-04-18T21:07:03.463 INFO:tasks.workunit.client.0.smithi096.stdout:6/995: dread d1/d3a/d36/f6f [4194304,4194304] 0 2024-04-18T21:07:03.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/952: dwrite d1/db/dda/de9/deb/d5d/d60/f3c [4194304,4194304] 0 2024-04-18T21:07:03.469 INFO:tasks.workunit.client.0.smithi096.stdout:7/943: dread d0/d7/d8/f94 [0,4194304] 0 2024-04-18T21:07:03.469 INFO:tasks.workunit.client.0.smithi096.stdout:0/953: fsync d1/d23/d32/daf/fef 0 2024-04-18T21:07:03.471 INFO:tasks.workunit.client.0.smithi096.stdout:0/954: write d1/d23/d32/d43/d6f/d8a/d91/dba/dee/f12b [383741,27537] 0 2024-04-18T21:07:03.471 INFO:tasks.workunit.client.0.smithi096.stdout:7/944: link d0/d11/d18/faf d0/d7/d2f/d63/dd3/dd8/f13c 0 2024-04-18T21:07:03.471 INFO:tasks.workunit.client.0.smithi096.stdout:7/945: creat d0/d7/d42/f13d x:0 0 0 2024-04-18T21:07:03.475 INFO:tasks.workunit.client.0.smithi096.stdout:0/955: truncate d1/f8e 539718 0 2024-04-18T21:07:03.476 INFO:tasks.workunit.client.0.smithi096.stdout:0/956: creat d1/db/d30/d31/d85/d112/f143 x:0 0 0 2024-04-18T21:07:03.477 INFO:tasks.workunit.client.0.smithi096.stdout:7/946: dwrite d0/d20/d39/f61 [0,4194304] 0 2024-04-18T21:07:03.477 INFO:tasks.workunit.client.0.smithi096.stdout:7/947: stat d0/d7/d2f/cf8 0 2024-04-18T21:07:03.477 INFO:tasks.workunit.client.0.smithi096.stdout:7/948: sync 2024-04-18T21:07:03.480 INFO:tasks.workunit.client.0.smithi096.stdout:0/957: rmdir d1/de8/d11f 0 2024-04-18T21:07:03.480 INFO:tasks.workunit.client.0.smithi096.stdout:7/949: chown d0/d7/d2f/c3e 127 1 2024-04-18T21:07:03.481 INFO:tasks.workunit.client.0.smithi096.stdout:0/958: fdatasync d1/db/dda/de9/deb/fbb 0 2024-04-18T21:07:03.481 INFO:tasks.workunit.client.0.smithi096.stdout:7/950: rename d0/d7/d2f/d63 to d0/d20/d39/dda/d124/d13e 0 2024-04-18T21:07:03.482 INFO:tasks.workunit.client.0.smithi096.stdout:7/951: mknod d0/d7/d42/d118/c13f 0 2024-04-18T21:07:03.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/958: dread d0/f17 [0,4194304] 0 2024-04-18T21:07:03.483 INFO:tasks.workunit.client.0.smithi096.stdout:7/952: mknod d0/d20/d39/d8a/db4/c140 0 2024-04-18T21:07:03.485 INFO:tasks.workunit.client.0.smithi096.stdout:7/953: creat d0/d7/d2f/f141 x:0 0 0 2024-04-18T21:07:03.485 INFO:tasks.workunit.client.0.smithi096.stdout:7/954: sync 2024-04-18T21:07:03.485 INFO:tasks.workunit.client.0.smithi096.stdout:7/955: sync 2024-04-18T21:07:03.485 INFO:tasks.workunit.client.0.smithi096.stdout:5/949: dread d2/d18/d61/d6f/d88/fe1 [0,4194304] 0 2024-04-18T21:07:03.486 INFO:tasks.workunit.client.0.smithi096.stdout:7/956: symlink d0/d20/d13a/l142 0 2024-04-18T21:07:03.487 INFO:tasks.workunit.client.0.smithi096.stdout:5/950: truncate d2/d11/d28/d64/d7e/f99 3199635 0 2024-04-18T21:07:03.488 INFO:tasks.workunit.client.0.smithi096.stdout:7/957: readlink d0/d20/d39/dda/d124/d13e/dc4/d104/le6 0 2024-04-18T21:07:03.488 INFO:tasks.workunit.client.0.smithi096.stdout:0/959: dwrite d1/db/dda/de9/deb/d6d/db1/f13b [0,4194304] 0 2024-04-18T21:07:03.490 INFO:tasks.workunit.client.0.smithi096.stdout:7/958: write d0/d7/d2f/f141 [300528,29746] 0 2024-04-18T21:07:03.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/951: creat d2/d11/d28/d4a/d131/de8/d133/f142 x:0 0 0 2024-04-18T21:07:03.490 INFO:tasks.workunit.client.0.smithi096.stdout:0/960: getdents d1/d23/d126 0 2024-04-18T21:07:03.491 INFO:tasks.workunit.client.0.smithi096.stdout:1/959: dwrite d0/df/d16/f68 [0,4194304] 0 2024-04-18T21:07:03.491 INFO:tasks.workunit.client.0.smithi096.stdout:7/959: chown d0/d20/d39/dda/d124/d13e/f9a 1291 1 2024-04-18T21:07:03.492 INFO:tasks.workunit.client.0.smithi096.stdout:6/996: dread d1/d3a/d57/de3/f59 [0,4194304] 0 2024-04-18T21:07:03.494 INFO:tasks.workunit.client.0.smithi096.stdout:7/960: stat d0/d20/d62/leb 0 2024-04-18T21:07:03.494 INFO:tasks.workunit.client.0.smithi096.stdout:0/961: chown d1/db/d30/d31/f7f 14695892 1 2024-04-18T21:07:03.494 INFO:tasks.workunit.client.0.smithi096.stdout:0/962: sync 2024-04-18T21:07:03.494 INFO:tasks.workunit.client.0.smithi096.stdout:7/961: write d0/d7/d8/f6a [1246785,50828] 0 2024-04-18T21:07:03.495 INFO:tasks.workunit.client.0.smithi096.stdout:7/962: stat d0/d11/c58 0 2024-04-18T21:07:03.499 INFO:tasks.workunit.client.0.smithi096.stdout:0/963: dwrite d1/d23/d32/d43/fb5 [0,4194304] 0 2024-04-18T21:07:03.500 INFO:tasks.workunit.client.0.smithi096.stdout:0/964: mkdir d1/d23/d32/d43/daa/d144 0 2024-04-18T21:07:03.500 INFO:tasks.workunit.client.0.smithi096.stdout:1/960: read d0/df/d16/f50 [1318851,55387] 0 2024-04-18T21:07:03.501 INFO:tasks.workunit.client.0.smithi096.stdout:7/963: write d0/d20/d39/f4c [744106,27364] 0 2024-04-18T21:07:03.501 INFO:tasks.workunit.client.0.smithi096.stdout:6/997: write d1/d3a/f3f [4894040,82913] 0 2024-04-18T21:07:03.502 INFO:tasks.workunit.client.0.smithi096.stdout:0/965: write d1/d23/d32/d43/d6f/d8a/d91/dba/dee/f12b [283134,100906] 0 2024-04-18T21:07:03.502 INFO:tasks.workunit.client.0.smithi096.stdout:6/998: write d1/d3a/d57/d66/d9b/d9f/f101 [289625,25692] 0 2024-04-18T21:07:03.503 INFO:tasks.workunit.client.0.smithi096.stdout:7/964: creat d0/d20/d62/f143 x:0 0 0 2024-04-18T21:07:03.503 INFO:tasks.workunit.client.0.smithi096.stdout:6/999: mkdir d1/d3a/d36/d150 0 2024-04-18T21:07:03.503 INFO:tasks.workunit.client.0.smithi096.stdout:0/966: unlink d1/db/dda/de9/deb/d6d/db1/f115 0 2024-04-18T21:07:03.504 INFO:tasks.workunit.client.0.smithi096.stdout:3/851: dread d4/d6/d22/d20/f3f [0,4194304] 0 2024-04-18T21:07:03.504 INFO:tasks.workunit.client.0.smithi096.stdout:0/967: write d1/fca [529817,12604] 0 2024-04-18T21:07:03.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/852: rename d4/d6/d22/d20/l8e to d4/d6/d22/d20/d46/d50/daa/lfd 0 2024-04-18T21:07:03.505 INFO:tasks.workunit.client.0.smithi096.stdout:0/968: symlink d1/d23/d32/d43/d6f/d8a/d91/l145 0 2024-04-18T21:07:03.506 INFO:tasks.workunit.client.0.smithi096.stdout:0/969: rename d1/db/dda/de9/deb/d5d/d60 to d1/db/d30/d31/d65/d146 0 2024-04-18T21:07:03.507 INFO:tasks.workunit.client.0.smithi096.stdout:0/970: fsync d1/db/f92 0 2024-04-18T21:07:03.510 INFO:tasks.workunit.client.0.smithi096.stdout:1/961: read d0/df/d16/f55 [7409830,27106] 0 2024-04-18T21:07:03.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/971: read d1/d23/d32/fa7 [176205,97198] 0 2024-04-18T21:07:03.510 INFO:tasks.workunit.client.0.smithi096.stdout:1/962: chown d0/dd0 120 1 2024-04-18T21:07:03.510 INFO:tasks.workunit.client.0.smithi096.stdout:7/965: dwrite d0/d20/d62/d7d/dee/f114 [0,4194304] 0 2024-04-18T21:07:03.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/972: chown d1/d23/fc7 0 1 2024-04-18T21:07:03.510 INFO:tasks.workunit.client.0.smithi096.stdout:1/963: chown d0/df/d16/d24/dac/d6a/df4/f11d 57 1 2024-04-18T21:07:03.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/973: stat d1/db/dda/de9/deb/d6d/f117 0 2024-04-18T21:07:03.512 INFO:tasks.workunit.client.0.smithi096.stdout:3/853: dwrite d4/d8/f48 [0,4194304] 0 2024-04-18T21:07:03.512 INFO:tasks.workunit.client.0.smithi096.stdout:7/966: rename d0/d20/d39/dda/d124/d13e/dd3/c119 to d0/d7/c144 0 2024-04-18T21:07:03.513 INFO:tasks.workunit.client.0.smithi096.stdout:7/967: chown d0/d20/d13a/l142 1768 1 2024-04-18T21:07:03.514 INFO:tasks.workunit.client.0.smithi096.stdout:3/854: creat d4/d6/dcc/ffe x:0 0 0 2024-04-18T21:07:03.514 INFO:tasks.workunit.client.0.smithi096.stdout:7/968: creat d0/d139/f145 x:0 0 0 2024-04-18T21:07:03.515 INFO:tasks.workunit.client.0.smithi096.stdout:3/855: chown d4/d6/d1b/d2c/d31/d85 4750 1 2024-04-18T21:07:03.515 INFO:tasks.workunit.client.0.smithi096.stdout:7/969: symlink d0/d20/d39/l146 0 2024-04-18T21:07:03.516 INFO:tasks.workunit.client.0.smithi096.stdout:7/970: fdatasync d0/d7/d42/f13d 0 2024-04-18T21:07:03.517 INFO:tasks.workunit.client.0.smithi096.stdout:7/971: mkdir d0/d20/d39/dda/d124/d147 0 2024-04-18T21:07:03.517 INFO:tasks.workunit.client.0.smithi096.stdout:7/972: stat d0/d7/d42/f74 0 2024-04-18T21:07:03.518 INFO:tasks.workunit.client.0.smithi096.stdout:3/856: creat d4/d6/d1b/d2c/d31/d4e/de8/fff x:0 0 0 2024-04-18T21:07:03.518 INFO:tasks.workunit.client.0.smithi096.stdout:0/974: dwrite d1/da3/fc5 [0,4194304] 0 2024-04-18T21:07:03.518 INFO:tasks.workunit.client.0.smithi096.stdout:7/973: write d0/d20/d6c/fdb [4989097,28663] 0 2024-04-18T21:07:03.519 INFO:tasks.workunit.client.0.smithi096.stdout:0/975: mknod d1/d23/d32/c147 0 2024-04-18T21:07:03.519 INFO:tasks.workunit.client.0.smithi096.stdout:7/974: unlink d0/d20/d4b/f86 0 2024-04-18T21:07:03.519 INFO:tasks.workunit.client.0.smithi096.stdout:0/976: readlink d1/db/d25/la8 0 2024-04-18T21:07:03.519 INFO:tasks.workunit.client.0.smithi096.stdout:3/857: creat d4/d6/d1b/d2c/d31/d4e/de8/de9/f100 x:0 0 0 2024-04-18T21:07:03.520 INFO:tasks.workunit.client.0.smithi096.stdout:7/975: truncate d0/d20/fe4 727271 0 2024-04-18T21:07:03.520 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:03.520 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:03.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/976: write d0/d20/d62/dca/f117 [860832,39776] 0 2024-04-18T21:07:03.521 INFO:tasks.workunit.client.0.smithi096.stdout:3/858: link d4/d6/d1b/d1d/f28 d4/d6/d1b/d2c/d31/f101 0 2024-04-18T21:07:03.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/977: mknod d0/d7/d49/c148 0 2024-04-18T21:07:03.522 INFO:tasks.workunit.client.0.smithi096.stdout:7/978: fdatasync d0/d7/d42/f74 0 2024-04-18T21:07:03.525 INFO:tasks.workunit.client.0.smithi096.stdout:0/977: dwrite d1/db/d30/d31/d85/d58/f130 [8388608,4194304] 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi096.stdout:0/978: chown d1/db/d30/d4a/dae/dcf/fd9 0 1 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi096.stdout:0/979: unlink d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/dbd/fdf 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi096.stdout:7/979: dwrite d0/fdf [0,4194304] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi096.stdout:0/980: dread d1/db/dda/de9/deb/d6d/db1/fc8 [4194304,4194304] 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi096.stdout:0/981: creat d1/db/d30/d4a/d140/f148 x:0 0 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi096.stdout:0/982: mkdir d1/d128/d149 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi096.stdout:7/980: dread d0/d20/d62/d7d/dee/f114 [0,4194304] 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi096.stdout:0/983: fdatasync d1/d23/d32/f10d 0 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi096.stdout:7/981: truncate d0/d7/d42/f87 1215444 0 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi096.stdout:0/984: mkdir d1/db/dda/de9/deb/d14a 0 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi096.stdout:7/982: rmdir d0/d20/d6c/d127/dfa 39 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi096.stdout:0/985: creat d1/db/d30/d31/d85/dfc/d109/f14b x:0 0 0 2024-04-18T21:07:03.536 INFO:tasks.workunit.client.0.smithi096.stdout:7/983: creat d0/d20/d39/dda/d124/d13e/dd3/dd8/f149 x:0 0 0 2024-04-18T21:07:03.537 INFO:tasks.workunit.client.0.smithi096.stdout:5/952: dread d2/f44 [0,4194304] 0 2024-04-18T21:07:03.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/984: chown d0/d7/d42/d118/c13f 74 1 2024-04-18T21:07:03.537 INFO:tasks.workunit.client.0.smithi096.stdout:5/953: truncate d2/d11/d28/d4a/d69/fad 293406 0 2024-04-18T21:07:03.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/985: link d0/d20/d39/da2/lf6 d0/d11/l14a 0 2024-04-18T21:07:03.541 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:03.541 INFO:tasks.workunit.client.0.smithi096.stdout:5/954: dread d2/d11/d28/d64/dba/fe4 [0,4194304] 0 2024-04-18T21:07:03.542 INFO:tasks.workunit.client.0.smithi096.stdout:5/955: write d2/d18/ff7 [679479,35664] 0 2024-04-18T21:07:03.542 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:03.541+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:03.548 INFO:tasks.workunit.client.0.smithi096.stdout:3/859: dread d4/d6/d1b/d2c/d31/d11/f55 [0,4194304] 0 2024-04-18T21:07:03.549 INFO:tasks.workunit.client.0.smithi096.stdout:7/986: truncate d0/d20/d39/f4c 3340709 0 2024-04-18T21:07:03.551 INFO:tasks.workunit.client.0.smithi096.stdout:7/987: creat d0/d20/d39/dda/d124/d13e/dd3/f14b x:0 0 0 2024-04-18T21:07:03.554 INFO:tasks.workunit.client.0.smithi096.stdout:0/986: dwrite d1/d23/d126/f127 [0,4194304] 0 2024-04-18T21:07:03.555 INFO:tasks.workunit.client.0.smithi096.stdout:1/964: dread d0/df/d30/f4e [0,4194304] 0 2024-04-18T21:07:03.555 INFO:tasks.workunit.client.0.smithi096.stdout:3/860: dwrite d4/d8/f9 [0,4194304] 0 2024-04-18T21:07:03.555 INFO:tasks.workunit.client.0.smithi096.stdout:0/987: write d1/d23/fa4 [184305,52343] 0 2024-04-18T21:07:03.556 INFO:tasks.workunit.client.0.smithi096.stdout:3/861: chown d4/d6/f32 5328185 1 2024-04-18T21:07:03.556 INFO:tasks.workunit.client.0.smithi096.stdout:3/862: chown d4/d6/d7 202 1 2024-04-18T21:07:03.556 INFO:tasks.workunit.client.0.smithi096.stdout:0/988: readlink d1/d23/d32/d43/d6f/d8a/d91/l145 0 2024-04-18T21:07:03.557 INFO:tasks.workunit.client.0.smithi096.stdout:1/965: mknod d0/df/d16/d6c/d106/d90/c137 0 2024-04-18T21:07:03.557 INFO:tasks.workunit.client.0.smithi096.stdout:7/988: rename d0/d20/d39/dda/d124/d13e/dd3/f14b to d0/d20/d39/d59/f14c 0 2024-04-18T21:07:03.557 INFO:tasks.workunit.client.0.smithi096.stdout:0/989: mknod d1/db/d30/d31/d85/c14c 0 2024-04-18T21:07:03.558 INFO:tasks.workunit.client.0.smithi096.stdout:1/966: chown d0/df/d30/d53/da2/ld7 17 1 2024-04-18T21:07:03.559 INFO:tasks.workunit.client.0.smithi096.stdout:7/989: mknod d0/d20/d62/c14d 0 2024-04-18T21:07:03.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/990: mkdir d1/db/d30/d4a/d67/d14d 0 2024-04-18T21:07:03.559 INFO:tasks.workunit.client.0.smithi096.stdout:1/967: symlink d0/df/d16/d6c/d106/d90/l138 0 2024-04-18T21:07:03.559 INFO:tasks.workunit.client.0.smithi096.stdout:3/863: chown d4/d6/d22/d20/d46/l6d 1014 1 2024-04-18T21:07:03.560 INFO:tasks.workunit.client.0.smithi096.stdout:0/991: fdatasync d1/d23/d32/d43/f46 0 2024-04-18T21:07:03.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/990: symlink d0/d20/d6c/d127/dfa/d12a/l14e 0 2024-04-18T21:07:03.561 INFO:tasks.workunit.client.0.smithi096.stdout:7/991: chown d0/d20/d6c/d127/dfa/d12a 847720571 1 2024-04-18T21:07:03.561 INFO:tasks.workunit.client.0.smithi096.stdout:1/968: rename d0/df/de5/df8/d95/fbd to d0/dd0/d134/f139 0 2024-04-18T21:07:03.561 INFO:tasks.workunit.client.0.smithi096.stdout:1/969: fsync d0/df/d16/d24/da8/f108 0 2024-04-18T21:07:03.562 INFO:tasks.workunit.client.0.smithi096.stdout:1/970: rmdir d0/df/d16/d24/da8 39 2024-04-18T21:07:03.562 INFO:tasks.workunit.client.0.smithi096.stdout:1/971: mkdir d0/dd0/d134/d13a 0 2024-04-18T21:07:03.564 INFO:tasks.workunit.client.0.smithi096.stdout:0/992: sync 2024-04-18T21:07:03.565 INFO:tasks.workunit.client.0.smithi096.stdout:0/993: fdatasync d1/d23/d32/d43/d6f/d8a/d91/dba/dee/ff9 0 2024-04-18T21:07:03.566 INFO:tasks.workunit.client.0.smithi096.stdout:0/994: mkdir d1/d23/d32/d43/d6f/d8a/d91/dba/d7e/d14e 0 2024-04-18T21:07:03.567 INFO:tasks.workunit.client.0.smithi096.stdout:1/972: dwrite d0/df/d62/f114 [0,4194304] 0 2024-04-18T21:07:03.567 INFO:tasks.workunit.client.0.smithi096.stdout:0/995: creat d1/db/dda/de9/deb/d82/f14f x:0 0 0 2024-04-18T21:07:03.568 INFO:tasks.workunit.client.0.smithi096.stdout:0/996: chown d1/db/d30/d31/d85/dfc/d109 73 1 2024-04-18T21:07:03.569 INFO:tasks.workunit.client.0.smithi096.stdout:0/997: write d1/db/d30/f86 [50415,31036] 0 2024-04-18T21:07:03.569 INFO:tasks.workunit.client.0.smithi096.stdout:1/973: write d0/df/d62/f85 [3184753,5457] 0 2024-04-18T21:07:03.570 INFO:tasks.workunit.client.0.smithi096.stdout:0/998: write d1/db/dda/de9/deb/d82/f14f [760972,107957] 0 2024-04-18T21:07:03.571 INFO:tasks.workunit.client.0.smithi096.stdout:0/999: readlink d1/d23/l26 0 2024-04-18T21:07:03.573 INFO:tasks.workunit.client.0.smithi096.stdout:5/956: dread d2/d38/d4c/fee [0,4194304] 0 2024-04-18T21:07:03.574 INFO:tasks.workunit.client.0.smithi096.stdout:1/974: dread d0/df/d16/fc9 [0,4194304] 0 2024-04-18T21:07:03.574 INFO:tasks.workunit.client.0.smithi096.stdout:5/957: creat d2/d11/d28/d4a/d87/da7/f143 x:0 0 0 2024-04-18T21:07:03.574 INFO:tasks.workunit.client.0.smithi096.stdout:5/958: write d2/f27 [1235022,67410] 0 2024-04-18T21:07:03.575 INFO:tasks.workunit.client.0.smithi096.stdout:1/975: write d0/df/d16/f50 [4006146,101351] 0 2024-04-18T21:07:03.575 INFO:tasks.workunit.client.0.smithi096.stdout:5/959: chown d2/d18/d61/fdd 66231830 1 2024-04-18T21:07:03.576 INFO:tasks.workunit.client.0.smithi096.stdout:5/960: fsync d2/d11/d28/d4a/d131/da0/fac 0 2024-04-18T21:07:03.577 INFO:tasks.workunit.client.0.smithi096.stdout:5/961: creat d2/d18/f144 x:0 0 0 2024-04-18T21:07:03.577 INFO:tasks.workunit.client.0.smithi096.stdout:5/962: unlink d2/d11/l67 0 2024-04-18T21:07:03.578 INFO:tasks.workunit.client.0.smithi096.stdout:5/963: rmdir d2/d11/d28/d122 0 2024-04-18T21:07:03.582 INFO:tasks.workunit.client.0.smithi096.stdout:1/976: truncate d0/df/d16/d24/dac/fc7 2705229 0 2024-04-18T21:07:03.583 INFO:tasks.workunit.client.0.smithi096.stdout:5/964: truncate d2/f7 1322096 0 2024-04-18T21:07:03.584 INFO:tasks.workunit.client.0.smithi096.stdout:5/965: write d2/d11/d28/d4a/d55/d81/ddf/de5/f10d [1946997,6605] 0 2024-04-18T21:07:03.586 INFO:tasks.workunit.client.0.smithi096.stdout:5/966: getdents d2/d11/d28/d4a/d131/da0/dab 0 2024-04-18T21:07:03.586 INFO:tasks.workunit.client.0.smithi096.stdout:7/992: dread d0/d7/d8/f1a [0,4194304] 0 2024-04-18T21:07:03.587 INFO:tasks.workunit.client.0.smithi096.stdout:5/967: dread d2/d11/d28/f72 [0,4194304] 0 2024-04-18T21:07:03.587 INFO:tasks.workunit.client.0.smithi096.stdout:3/864: dread d4/f73 [0,4194304] 0 2024-04-18T21:07:03.587 INFO:tasks.workunit.client.0.smithi096.stdout:7/993: write d0/d20/f34 [4231806,8022] 0 2024-04-18T21:07:03.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/977: dread d0/df/d16/d24/dac/d6a/df4/f11d [0,4194304] 0 2024-04-18T21:07:03.588 INFO:tasks.workunit.client.0.smithi096.stdout:3/865: creat d4/d6/d1b/d2c/d6b/d99/f102 x:0 0 0 2024-04-18T21:07:03.588 INFO:tasks.workunit.client.0.smithi096.stdout:7/994: mknod d0/d20/d39/da2/c14f 0 2024-04-18T21:07:03.588 INFO:tasks.workunit.client.0.smithi096.stdout:5/968: link d2/d11/d28/d4a/fe2 d2/f145 0 2024-04-18T21:07:03.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/995: mkdir d0/d7/d42/d150 0 2024-04-18T21:07:03.589 INFO:tasks.workunit.client.0.smithi096.stdout:5/969: mkdir d2/d11/d28/d4a/d131/d146 0 2024-04-18T21:07:03.589 INFO:tasks.workunit.client.0.smithi096.stdout:3/866: getdents d4/d6/d1b 0 2024-04-18T21:07:03.590 INFO:tasks.workunit.client.0.smithi096.stdout:3/867: unlink d4/d6/d1b/d2c/d31/d4e/l62 0 2024-04-18T21:07:03.600 INFO:tasks.workunit.client.0.smithi096.stdout:7/996: dwrite d0/d20/d39/dda/d124/d13e/dc4/fc8 [0,4194304] 0 2024-04-18T21:07:03.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/997: creat d0/d20/d6c/d127/dfa/f151 x:0 0 0 2024-04-18T21:07:03.603 INFO:tasks.workunit.client.0.smithi096.stdout:7/998: sync 2024-04-18T21:07:03.603 INFO:tasks.workunit.client.0.smithi096.stdout:3/868: dread d4/d6/d1b/d63/fd2 [0,4194304] 0 2024-04-18T21:07:03.604 INFO:tasks.workunit.client.0.smithi096.stdout:7/999: creat d0/d7/f152 x:0 0 0 2024-04-18T21:07:03.605 INFO:tasks.workunit.client.0.smithi096.stdout:3/869: creat d4/d8/d49/dad/f103 x:0 0 0 2024-04-18T21:07:03.606 INFO:tasks.workunit.client.0.smithi096.stdout:3/870: symlink d4/d6/d22/d20/d46/dec/l104 0 2024-04-18T21:07:03.607 INFO:tasks.workunit.client.0.smithi096.stdout:1/978: dread d0/df/d16/d6c/d9d/fa4 [0,4194304] 0 2024-04-18T21:07:03.607 INFO:tasks.workunit.client.0.smithi096.stdout:3/871: creat d4/d6/d1b/d2c/d31/d4e/de8/de9/f105 x:0 0 0 2024-04-18T21:07:03.608 INFO:tasks.workunit.client.0.smithi096.stdout:3/872: chown d4/d6/d7/d90 17090 1 2024-04-18T21:07:03.608 INFO:tasks.workunit.client.0.smithi096.stdout:5/970: dread d2/d18/fd1 [0,4194304] 0 2024-04-18T21:07:03.609 INFO:tasks.workunit.client.0.smithi096.stdout:3/873: read d4/d6/d1b/d1d/f7a [920882,67377] 0 2024-04-18T21:07:03.609 INFO:tasks.workunit.client.0.smithi096.stdout:5/971: mknod d2/d8f/de9/c147 0 2024-04-18T21:07:03.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/972: creat d2/d18/d61/d6f/d7a/f148 x:0 0 0 2024-04-18T21:07:03.610 INFO:tasks.workunit.client.0.smithi096.stdout:3/874: creat d4/d6/d1b/d2c/d31/d4e/f106 x:0 0 0 2024-04-18T21:07:03.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/973: symlink d2/d38/l149 0 2024-04-18T21:07:03.611 INFO:tasks.workunit.client.0.smithi096.stdout:5/974: write d2/d11/d28/d4a/d87/da7/f143 [135769,58483] 0 2024-04-18T21:07:03.611 INFO:tasks.workunit.client.0.smithi096.stdout:5/975: write d2/f106 [314022,36995] 0 2024-04-18T21:07:03.613 INFO:tasks.workunit.client.0.smithi096.stdout:5/976: link d2/d11/d28/d4a/l113 d2/d18/d61/d6f/d88/l14a 0 2024-04-18T21:07:03.613 INFO:tasks.workunit.client.0.smithi096.stdout:5/977: creat d2/d18/d61/f14b x:0 0 0 2024-04-18T21:07:03.614 INFO:tasks.workunit.client.0.smithi096.stdout:1/979: truncate d0/df/d62/f85 1095938 0 2024-04-18T21:07:03.615 INFO:tasks.workunit.client.0.smithi096.stdout:5/978: creat d2/d18/d61/d6f/d7a/d111/f14c x:0 0 0 2024-04-18T21:07:03.615 INFO:tasks.workunit.client.0.smithi096.stdout:1/980: mkdir d0/df/de5/df8/d9b/d13b 0 2024-04-18T21:07:03.615 INFO:tasks.workunit.client.0.smithi096.stdout:3/875: dwrite d4/d6/d1b/d2c/d6b/d99/f102 [0,4194304] 0 2024-04-18T21:07:03.616 INFO:tasks.workunit.client.0.smithi096.stdout:5/979: write d2/d11/d28/d64/f6c [5586082,72448] 0 2024-04-18T21:07:03.616 INFO:tasks.workunit.client.0.smithi096.stdout:5/980: chown d2/f106 182171 1 2024-04-18T21:07:03.617 INFO:tasks.workunit.client.0.smithi096.stdout:5/981: mknod d2/d38/c14d 0 2024-04-18T21:07:03.618 INFO:tasks.workunit.client.0.smithi096.stdout:1/981: mkdir d0/df/d16/d24/dac/d13c 0 2024-04-18T21:07:03.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/982: symlink d2/d11/d28/d4a/d55/d81/dbe/l14e 0 2024-04-18T21:07:03.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/982: chown d0/df/d16/d24/dac/d65/lcb 3506 1 2024-04-18T21:07:03.619 INFO:tasks.workunit.client.0.smithi096.stdout:5/983: stat d2/d11/d28/d4a/d55/f7c 0 2024-04-18T21:07:03.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/984: fsync d2/d11/d28/d4a/d131/da0/dab/fc9 0 2024-04-18T21:07:03.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/985: read - d2/d6a/df0/f11c zero size 2024-04-18T21:07:03.621 INFO:tasks.workunit.client.0.smithi096.stdout:5/986: mknod d2/d18/c14f 0 2024-04-18T21:07:03.622 INFO:tasks.workunit.client.0.smithi096.stdout:3/876: dwrite d4/d6/dcc/ffe [0,4194304] 0 2024-04-18T21:07:03.622 INFO:tasks.workunit.client.0.smithi096.stdout:3/877: sync 2024-04-18T21:07:03.623 INFO:tasks.workunit.client.0.smithi096.stdout:5/987: unlink d2/d11/d28/d4a/d131/da0/fac 0 2024-04-18T21:07:03.623 INFO:tasks.workunit.client.0.smithi096.stdout:3/878: rmdir d4/d6/d1b/d2c/d6b/d99 39 2024-04-18T21:07:03.624 INFO:tasks.workunit.client.0.smithi096.stdout:5/988: write d2/f2b [4117269,96092] 0 2024-04-18T21:07:03.625 INFO:tasks.workunit.client.0.smithi096.stdout:5/989: stat d2/d11/d28/d4a/d131/da0/d128 0 2024-04-18T21:07:03.625 INFO:tasks.workunit.client.0.smithi096.stdout:1/983: dwrite d0/f70 [0,4194304] 0 2024-04-18T21:07:03.626 INFO:tasks.workunit.client.0.smithi096.stdout:1/984: write d0/df/d16/d24/dac/d6a/df4/ff9 [694639,2941] 0 2024-04-18T21:07:03.627 INFO:tasks.workunit.client.0.smithi096.stdout:1/985: symlink d0/df/de5/l13d 0 2024-04-18T21:07:03.628 INFO:tasks.workunit.client.0.smithi096.stdout:1/986: getdents d0/df/de5/df8/d95 0 2024-04-18T21:07:03.629 INFO:tasks.workunit.client.0.smithi096.stdout:1/987: creat d0/df/d16/d24/dac/d65/f13e x:0 0 0 2024-04-18T21:07:03.629 INFO:tasks.workunit.client.0.smithi096.stdout:3/879: dwrite d4/d6/d22/d20/f44 [0,4194304] 0 2024-04-18T21:07:03.631 INFO:tasks.workunit.client.0.smithi096.stdout:3/880: mkdir d4/d6/d107 0 2024-04-18T21:07:03.633 INFO:tasks.workunit.client.0.smithi096.stdout:3/881: creat d4/d6/d22/d20/d46/dec/f108 x:0 0 0 2024-04-18T21:07:03.633 INFO:tasks.workunit.client.0.smithi096.stdout:1/988: dread d0/f17 [0,4194304] 0 2024-04-18T21:07:03.633 INFO:tasks.workunit.client.0.smithi096.stdout:3/882: creat d4/d6/d22/d20/d46/d50/f109 x:0 0 0 2024-04-18T21:07:03.634 INFO:tasks.workunit.client.0.smithi096.stdout:3/883: chown d4/d8/fb9 12 1 2024-04-18T21:07:03.634 INFO:tasks.workunit.client.0.smithi096.stdout:1/989: link d0/df/d30/f94 d0/df/d30/d53/f13f 0 2024-04-18T21:07:03.635 INFO:tasks.workunit.client.0.smithi096.stdout:3/884: getdents d4/d8/d49/db3/db4 0 2024-04-18T21:07:03.635 INFO:tasks.workunit.client.0.smithi096.stdout:1/990: write d0/df/d16/d24/dc0/f7f [625191,38741] 0 2024-04-18T21:07:03.636 INFO:tasks.workunit.client.0.smithi096.stdout:3/885: dread - d4/d6/d1b/d2c/d31/d4e/de8/fff zero size 2024-04-18T21:07:03.636 INFO:tasks.workunit.client.0.smithi096.stdout:1/991: read - d0/df/d16/d24/dac/d6a/f10b zero size 2024-04-18T21:07:03.636 INFO:tasks.workunit.client.0.smithi096.stdout:1/992: rmdir d0/df/de5/df8 39 2024-04-18T21:07:03.638 INFO:tasks.workunit.client.0.smithi096.stdout:5/990: truncate d2/f15 1532807 0 2024-04-18T21:07:03.638 INFO:tasks.workunit.client.0.smithi096.stdout:5/991: write d2/d11/d28/f72 [1092715,20674] 0 2024-04-18T21:07:03.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/886: read d4/d8/d49/d9e/fd7 [1490520,87286] 0 2024-04-18T21:07:03.639 INFO:tasks.workunit.client.0.smithi096.stdout:3/887: stat d4/d6/d1b/d2c/d5c/fca 0 2024-04-18T21:07:03.639 INFO:tasks.workunit.client.0.smithi096.stdout:5/992: creat d2/d11/d28/d4a/d55/f150 x:0 0 0 2024-04-18T21:07:03.639 INFO:tasks.workunit.client.0.smithi096.stdout:5/993: dread - d2/d9b/f124 zero size 2024-04-18T21:07:03.639 INFO:tasks.workunit.client.0.smithi096.stdout:3/888: symlink d4/d6/d1b/d63/l10a 0 2024-04-18T21:07:03.640 INFO:tasks.workunit.client.0.smithi096.stdout:5/994: mknod d2/d11/d28/d4a/d131/da0/dab/c151 0 2024-04-18T21:07:03.641 INFO:tasks.workunit.client.0.smithi096.stdout:5/995: write d2/d11/d28/d4a/d131/de8/d133/f142 [438992,10987] 0 2024-04-18T21:07:03.641 INFO:tasks.workunit.client.0.smithi096.stdout:5/996: mknod d2/d11/d28/c152 0 2024-04-18T21:07:03.642 INFO:tasks.workunit.client.0.smithi096.stdout:5/997: readlink d2/d11/l19 0 2024-04-18T21:07:03.642 INFO:tasks.workunit.client.0.smithi096.stdout:5/998: chown d2/d18/d61/d6f/d7a 987 1 2024-04-18T21:07:03.642 INFO:tasks.workunit.client.0.smithi096.stdout:5/999: chown d2/d18/d61/d6f/d7a/d111 481 1 2024-04-18T21:07:03.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:03.642+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:03.657 INFO:tasks.workunit.client.0.smithi096.stdout:3/889: getdents d4/d6/d22/d20/d46/d50 0 2024-04-18T21:07:03.657 INFO:tasks.workunit.client.0.smithi096.stdout:1/993: truncate d0/df/d30/d53/da2/f10a 3015622 0 2024-04-18T21:07:03.658 INFO:tasks.workunit.client.0.smithi096.stdout:3/890: rename d4/d8/d7f/l8b to d4/d6/d1b/d2c/d31/d4e/l10b 0 2024-04-18T21:07:03.658 INFO:tasks.workunit.client.0.smithi096.stdout:3/891: fsync d4/d8/d49/d9e/fd7 0 2024-04-18T21:07:03.659 INFO:tasks.workunit.client.0.smithi096.stdout:3/892: write d4/d6/d1b/d1d/fa7 [1738804,16470] 0 2024-04-18T21:07:03.660 INFO:tasks.workunit.client.0.smithi096.stdout:3/893: write d4/d6/d1b/d63/fd2 [2905684,37907] 0 2024-04-18T21:07:03.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/894: chown d4/d6/d1b/d2c/d31/f9b 141614 1 2024-04-18T21:07:03.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/895: chown d4/d6/d22/d20/d46/d50/daa 38677178 1 2024-04-18T21:07:03.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/896: fdatasync d4/d8/f74 0 2024-04-18T21:07:03.662 INFO:tasks.workunit.client.0.smithi096.stdout:3/897: fdatasync d4/d6/d1b/d2c/d31/d4e/de8/de9/f105 0 2024-04-18T21:07:03.663 INFO:tasks.workunit.client.0.smithi096.stdout:3/898: chown d4/d6/d1b/d2c/d6b/d99/da6/f69 1050831377 1 2024-04-18T21:07:03.690 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:03.690 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:03.706 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:03.723 INFO:tasks.workunit.client.0.smithi096.stdout:3/899: creat d4/d6/d22/d20/f10c x:0 0 0 2024-04-18T21:07:03.723 INFO:tasks.workunit.client.0.smithi096.stdout:3/900: chown d4/d6/d1b/d2c/d31/d4e 318 1 2024-04-18T21:07:03.729 INFO:tasks.workunit.client.0.smithi096.stdout:1/994: truncate d0/df/d62/f114 1964190 0 2024-04-18T21:07:03.730 INFO:tasks.workunit.client.0.smithi096.stdout:1/995: mknod d0/df/d30/d53/da2/c140 0 2024-04-18T21:07:03.732 INFO:tasks.workunit.client.0.smithi096.stdout:1/996: creat d0/df/d16/d24/dc0/d5f/d136/f141 x:0 0 0 2024-04-18T21:07:03.732 INFO:tasks.workunit.client.0.smithi096.stdout:1/997: chown d0/df/d16/lc1 3345882 1 2024-04-18T21:07:03.733 INFO:tasks.workunit.client.0.smithi096.stdout:1/998: readlink d0/df/d16/d24/dc0/d5f/laf 0 2024-04-18T21:07:03.734 INFO:tasks.workunit.client.0.smithi096.stdout:1/999: mknod d0/df/d16/d24/dac/c142 0 2024-04-18T21:07:03.743 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:03.742+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:03.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/901: rename d4/d8/f3d to d4/d6/d1b/d2c/d6b/d99/f10d 0 2024-04-18T21:07:03.770 INFO:tasks.workunit.client.0.smithi096.stdout:3/902: rename d4/d8/l59 to d4/d6/d1b/d2c/d31/d11/d8c/l10e 0 2024-04-18T21:07:03.772 INFO:tasks.workunit.client.0.smithi096.stdout:3/903: dread d4/d6/d1b/d2c/d31/d11/fd0 [0,4194304] 0 2024-04-18T21:07:03.773 INFO:tasks.workunit.client.0.smithi096.stdout:3/904: creat d4/d6/d1b/d1d/f10f x:0 0 0 2024-04-18T21:07:03.774 INFO:tasks.workunit.client.0.smithi096.stdout:3/905: mknod d4/d8/d49/c110 0 2024-04-18T21:07:03.790 INFO:tasks.workunit.client.0.smithi096.stdout:3/906: truncate d4/d6/d22/d20/f76 928883 0 2024-04-18T21:07:03.791 INFO:tasks.workunit.client.0.smithi096.stdout:3/907: chown d4/d6/d1b/d63/fd2 355 1 2024-04-18T21:07:03.792 INFO:tasks.workunit.client.0.smithi096.stdout:3/908: mknod d4/d6/d7/c111 0 2024-04-18T21:07:03.793 INFO:tasks.workunit.client.0.smithi096.stdout:3/909: mknod d4/d8/d49/d9e/c112 0 2024-04-18T21:07:03.838 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:03.838 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:03.844 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:03.843+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:03.848 INFO:tasks.workunit.client.0.smithi096.stdout:3/910: sync 2024-04-18T21:07:03.852 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:03.858 INFO:tasks.workunit.client.0.smithi096.stdout:3/911: dwrite d4/d8/fd3 [0,4194304] 0 2024-04-18T21:07:03.864 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:07:03.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/912: truncate d4/d8/f1f 1599966 0 2024-04-18T21:07:03.883 INFO:tasks.workunit.client.0.smithi096.stdout:3/913: dread d4/d6/d1b/d2c/d31/f41 [0,4194304] 0 2024-04-18T21:07:03.884 INFO:tasks.workunit.client.0.smithi096.stdout:3/914: chown d4/d8/d49/dad/f103 6067137 1 2024-04-18T21:07:03.885 INFO:tasks.workunit.client.0.smithi096.stdout:3/915: dread - d4/d6/d1b/d63/ff6 zero size 2024-04-18T21:07:03.886 INFO:tasks.workunit.client.0.smithi096.stdout:3/916: write d4/d6/d1b/f38 [1141453,39765] 0 2024-04-18T21:07:03.890 INFO:tasks.workunit.client.0.smithi096.stdout:3/917: write d4/d6/d1b/d2c/d31/f41 [1640086,51046] 0 2024-04-18T21:07:03.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/918: readlink d4/d6/d1b/d2c/d31/d11/d8c/l10e 0 2024-04-18T21:07:03.892 INFO:tasks.workunit.client.0.smithi096.stdout:3/919: mknod d4/d8/d49/db3/db4/c113 0 2024-04-18T21:07:03.944 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:03.941+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:03.982 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:03.982 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:03.996 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:04.015 INFO:tasks.workunit.client.0.smithi096.stdout:3/920: sync 2024-04-18T21:07:04.017 INFO:tasks.workunit.client.0.smithi096.stdout:3/921: readlink d4/d8/d49/db3/db4/de6/lf8 0 2024-04-18T21:07:04.021 INFO:tasks.workunit.client.0.smithi096.stdout:3/922: dread d4/d6/dbb/fd9 [0,4194304] 0 2024-04-18T21:07:04.023 INFO:tasks.workunit.client.0.smithi096.stdout:3/923: creat d4/d6/d1b/d2c/d31/d11/f114 x:0 0 0 2024-04-18T21:07:04.035 INFO:tasks.workunit.client.0.smithi096.stdout:3/924: dwrite d4/f73 [0,4194304] 0 2024-04-18T21:07:04.037 INFO:tasks.workunit.client.0.smithi096.stdout:3/925: readlink d4/d6/d1b/d2c/d6b/d99/da6/l8d 0 2024-04-18T21:07:04.039 INFO:tasks.workunit.client.0.smithi096.stdout:3/926: fdatasync d4/d6/d1b/d1d/f10f 0 2024-04-18T21:07:04.040 INFO:tasks.workunit.client.0.smithi096.stdout:3/927: symlink d4/d6/d1b/d1d/l115 0 2024-04-18T21:07:04.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:04.042+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:04.052 INFO:tasks.workunit.client.0.smithi096.stdout:3/928: dwrite d4/d6/d1b/d2c/d31/d11/f5b [0,4194304] 0 2024-04-18T21:07:04.055 INFO:tasks.workunit.client.0.smithi096.stdout:3/929: mknod d4/d6/d1b/d2c/d31/d4e/de8/c116 0 2024-04-18T21:07:04.058 INFO:tasks.workunit.client.0.smithi096.stdout:3/930: creat d4/d8/d49/d9e/f117 x:0 0 0 2024-04-18T21:07:04.063 INFO:tasks.workunit.client.0.smithi096.stdout:3/931: write d4/d6/d1b/d2c/f53 [776605,33938] 0 2024-04-18T21:07:04.066 INFO:tasks.workunit.client.0.smithi096.stdout:3/932: truncate d4/d6/d1b/d2c/d31/d11/f114 693225 0 2024-04-18T21:07:04.067 INFO:tasks.workunit.client.0.smithi096.stdout:3/933: chown d4/d6/d1b/d1d/l115 6 1 2024-04-18T21:07:04.069 INFO:tasks.workunit.client.0.smithi096.stdout:3/934: mknod d4/d6/d1b/d2c/d31/d11/d8c/c118 0 2024-04-18T21:07:04.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/935: dread d4/d6/d1b/d2c/d31/d85/fc4 [0,4194304] 0 2024-04-18T21:07:04.098 INFO:tasks.workunit.client.0.smithi096.stdout:3/936: rmdir d4/d6/d7/db8 39 2024-04-18T21:07:04.099 INFO:tasks.workunit.client.0.smithi096.stdout:3/937: chown d4/d8/d49/db3/db4 0 1 2024-04-18T21:07:04.101 INFO:tasks.workunit.client.0.smithi096.stdout:3/938: mkdir d4/d6/d22/d20/d46/d50/d119 0 2024-04-18T21:07:04.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/939: mkdir d4/d6/d1b/d2c/d11a 0 2024-04-18T21:07:04.104 INFO:tasks.workunit.client.0.smithi096.stdout:3/940: write d4/d6/d1b/d1d/fed [438588,18283] 0 2024-04-18T21:07:04.106 INFO:tasks.workunit.client.0.smithi096.stdout:3/941: symlink d4/d6/d1b/d2c/d31/d11/d8c/l11b 0 2024-04-18T21:07:04.107 INFO:tasks.workunit.client.0.smithi096.stdout:3/942: chown d4/d6/d1b/d1d 16349 1 2024-04-18T21:07:04.108 INFO:tasks.workunit.client.0.smithi096.stdout:3/943: read - d4/d8/d49/dad/f103 zero size 2024-04-18T21:07:04.110 INFO:tasks.workunit.client.0.smithi096.stdout:3/944: creat d4/d8/d49/d9e/f11c x:0 0 0 2024-04-18T21:07:04.113 INFO:tasks.workunit.client.0.smithi096.stdout:3/945: read d4/d6/d1b/d2c/d31/d11/f114 [422912,64016] 0 2024-04-18T21:07:04.115 INFO:tasks.workunit.client.0.smithi096.stdout:3/946: creat d4/d6/d1b/d2c/d6b/d99/da6/f11d x:0 0 0 2024-04-18T21:07:04.116 INFO:tasks.workunit.client.0.smithi096.stdout:3/947: write d4/d6/d7/fac [886249,2070] 0 2024-04-18T21:07:04.119 INFO:tasks.workunit.client.0.smithi096.stdout:3/948: creat d4/d6/d1b/d2c/d6b/f11e x:0 0 0 2024-04-18T21:07:04.122 INFO:tasks.workunit.client.0.smithi096.stdout:3/949: rename d4/d6/d1b/d2c/f53 to d4/d6/d1b/d2c/d31/d4e/de8/f11f 0 2024-04-18T21:07:04.123 INFO:tasks.workunit.client.0.smithi096.stdout:3/950: mkdir d4/d6/d1b/d63/d120 0 2024-04-18T21:07:04.125 INFO:tasks.workunit.client.0.smithi096.stdout:3/951: write d4/d6/d1b/d1d/f10f [134256,2319] 0 2024-04-18T21:07:04.127 INFO:tasks.workunit.client.0.smithi096.stdout:3/952: link d4/d8/d49/d9e/fd7 d4/d8/d49/dad/f121 0 2024-04-18T21:07:04.130 INFO:tasks.workunit.client.0.smithi096.stdout:3/953: chown d4/d6/d22/d20/d46/d50/daa/lfd 0 1 2024-04-18T21:07:04.132 INFO:tasks.workunit.client.0.smithi096.stdout:3/954: write d4/d6/d1b/d2c/d5c/f91 [4307089,107683] 0 2024-04-18T21:07:04.135 INFO:tasks.workunit.client.0.smithi096.stdout:3/955: rename d4/d6/d7/d90/la3 to d4/d6/d22/d20/d46/d50/l122 0 2024-04-18T21:07:04.136 INFO:tasks.workunit.client.0.smithi096.stdout:3/956: write d4/d8/f9 [1052067,2334] 0 2024-04-18T21:07:04.138 INFO:tasks.workunit.client.0.smithi096.stdout:3/957: chown d4/d6/d22/d20/d46/d50/f109 20 1 2024-04-18T21:07:04.140 INFO:tasks.workunit.client.0.smithi096.stdout:3/958: fdatasync d4/d6/d1b/d2c/d31/d4e/de8/fff 0 2024-04-18T21:07:04.142 INFO:tasks.workunit.client.0.smithi096.stdout:3/959: mknod d4/d6/d1b/d2c/d6b/d99/da6/c123 0 2024-04-18T21:07:04.143 INFO:tasks.workunit.client.0.smithi096.stdout:3/960: dread - d4/d6/d1b/d2c/d31/d4e/f106 zero size 2024-04-18T21:07:04.145 INFO:tasks.workunit.client.0.smithi096.stdout:3/961: creat d4/d6/d1b/d2c/d11a/f124 x:0 0 0 2024-04-18T21:07:04.146 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:04.143+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:04.147 INFO:tasks.workunit.client.0.smithi096.stdout:3/962: dread - d4/d6/d1b/d2c/d6b/f11e zero size 2024-04-18T21:07:04.148 INFO:tasks.workunit.client.0.smithi096.stdout:3/963: mkdir d4/d6/d7/d125 0 2024-04-18T21:07:04.150 INFO:tasks.workunit.client.0.smithi096.stdout:3/964: write d4/d6/d1b/d1d/f7a [1746860,36641] 0 2024-04-18T21:07:04.152 INFO:tasks.workunit.client.0.smithi096.stdout:3/965: write d4/d6/d1b/d2c/d6b/f11e [907177,58096] 0 2024-04-18T21:07:04.153 INFO:tasks.workunit.client.0.smithi096.stdout:3/966: fdatasync d4/d8/fb9 0 2024-04-18T21:07:04.154 INFO:tasks.workunit.client.0.smithi096.stdout:3/967: dread - d4/d6/d22/d20/d46/d50/f109 zero size 2024-04-18T21:07:04.157 INFO:tasks.workunit.client.0.smithi096.stdout:3/968: rename d4/d6/d7/db8/fc1 to d4/d6/d7/f126 0 2024-04-18T21:07:04.159 INFO:tasks.workunit.client.0.smithi096.stdout:3/969: unlink d4/d6/c4a 0 2024-04-18T21:07:04.162 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:04.163 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:04.170 INFO:tasks.workunit.client.0.smithi096.stdout:3/970: truncate d4/d6/d22/d20/f3f 1573642 0 2024-04-18T21:07:04.172 INFO:tasks.workunit.client.0.smithi096.stdout:3/971: mknod d4/d6/d1b/d2c/d31/d11/c127 0 2024-04-18T21:07:04.174 INFO:tasks.workunit.client.0.smithi096.stdout:3/972: creat d4/d6/d1b/d2c/d6b/d99/f128 x:0 0 0 2024-04-18T21:07:04.175 INFO:tasks.workunit.client.0.smithi096.stdout:3/973: creat d4/d6/d1b/d1d/f129 x:0 0 0 2024-04-18T21:07:04.177 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:04.178 INFO:tasks.workunit.client.0.smithi096.stdout:3/974: mkdir d4/d6/d22/d20/d46/d50/d119/d12a 0 2024-04-18T21:07:04.179 INFO:tasks.workunit.client.0.smithi096.stdout:3/975: creat d4/d6/d107/f12b x:0 0 0 2024-04-18T21:07:04.182 INFO:tasks.workunit.client.0.smithi096.stdout:3/976: getdents d4/d6/d1b/d2c/d6b/d99/da6 0 2024-04-18T21:07:04.184 INFO:tasks.workunit.client.0.smithi096.stdout:3/977: truncate d4/d6/d1b/d1d/f28 5153110 0 2024-04-18T21:07:04.185 INFO:tasks.workunit.client.0.smithi096.stdout:3/978: stat d4/d8/d49/db3/db4/lf4 0 2024-04-18T21:07:04.186 INFO:tasks.workunit.client.0.smithi096.stdout:3/979: readlink d4/d8/d7f/d94/le7 0 2024-04-18T21:07:04.192 INFO:tasks.workunit.client.0.smithi096.stdout:3/980: write d4/d6/d1b/d2c/f57 [1311304,112851] 0 2024-04-18T21:07:04.198 INFO:tasks.workunit.client.0.smithi096.stdout:3/981: write d4/d6/d1b/d2c/d6b/d99/da6/f69 [699118,81302] 0 2024-04-18T21:07:04.200 INFO:tasks.workunit.client.0.smithi096.stdout:3/982: mkdir d4/d6/d22/d20/d46/d50/daa/d12c 0 2024-04-18T21:07:04.202 INFO:tasks.workunit.client.0.smithi096.stdout:3/983: chown d4/d6/d1b/d2c/d31/d4e/de8/de9/f100 0 1 2024-04-18T21:07:04.203 INFO:tasks.workunit.client.0.smithi096.stdout:3/984: mknod d4/d6/d1b/c12d 0 2024-04-18T21:07:04.246 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:04.247+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:04.249 INFO:tasks.workunit.client.0.smithi096.stdout:3/985: sync 2024-04-18T21:07:04.251 INFO:tasks.workunit.client.0.smithi096.stdout:3/986: getdents d4/d6/d1b/d2c/d6b/d99/da6 0 2024-04-18T21:07:04.253 INFO:tasks.workunit.client.0.smithi096.stdout:3/987: write d4/d6/d1b/d2c/d31/d11/f5b [2332255,90605] 0 2024-04-18T21:07:04.255 INFO:tasks.workunit.client.0.smithi096.stdout:3/988: creat d4/d8/d7f/d94/f12e x:0 0 0 2024-04-18T21:07:04.257 INFO:tasks.workunit.client.0.smithi096.stdout:3/989: mknod d4/d6/d22/c12f 0 2024-04-18T21:07:04.258 INFO:tasks.workunit.client.0.smithi096.stdout:3/990: fdatasync d4/d8/d49/d9e/f117 0 2024-04-18T21:07:04.260 INFO:tasks.workunit.client.0.smithi096.stdout:3/991: dread - d4/d6/d22/d20/d46/d50/f109 zero size 2024-04-18T21:07:04.264 INFO:tasks.workunit.client.0.smithi096.stdout:3/992: dread d4/d6/d22/d20/f3f [0,4194304] 0 2024-04-18T21:07:04.267 INFO:tasks.workunit.client.0.smithi096.stdout:3/993: creat d4/d6/d1b/d2c/d6b/f130 x:0 0 0 2024-04-18T21:07:04.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/994: dwrite d4/d6/d1b/d2c/d31/d4e/de8/f11f [0,4194304] 0 2024-04-18T21:07:04.285 INFO:tasks.workunit.client.0.smithi096.stdout:3/995: mknod d4/d6/d1b/d2c/d31/d11/d8c/c131 0 2024-04-18T21:07:04.296 INFO:tasks.workunit.client.0.smithi096.stdout:3/996: getdents d4/d6/d1b/d2c/d31/d11/d8c 0 2024-04-18T21:07:04.297 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:04.297 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:04.303 INFO:tasks.workunit.client.0.smithi096.stdout:3/997: truncate d4/d6/dcc/ffe 24628 0 2024-04-18T21:07:04.305 INFO:tasks.workunit.client.0.smithi096.stdout:3/998: symlink d4/d6/d1b/d2c/d31/d4e/de8/de9/l132 0 2024-04-18T21:07:04.309 INFO:tasks.workunit.client.0.smithi096.stdout:3/999: truncate d4/d6/d1b/d2c/d6b/d99/da6/f69 1696084 0 2024-04-18T21:07:04.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:04.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm -rf -- ./tmp.pYQ32nC2Vb 2024-04-18T21:07:04.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:04.358+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:04.441 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:04.442 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:04.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:04.446+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:04.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:04.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:04.546+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:04.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:04.674 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:04.674+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:04.749 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:04.747+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:04.800 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:04.801 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:04.815 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:04.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:04.850+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:04.883 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:04.888 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:07:04.888 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:04.889 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:07:04.889 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:07:04.942 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:04.942 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:04.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:04.950+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:04.956 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:05.050 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:05.050 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:05.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:05.050+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:05.076 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:05.077 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:05.077 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:05.077 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:05.091 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:05.097 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:05.097 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:05.153 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:05.151+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:05.220 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:05.220 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:05.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:05.220 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:05.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.220 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.610045048, 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:05.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.606535791999999, 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.593342589999999, 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:05.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.576155386, 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:05.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:05.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:05.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.572741272000002, 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:05.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.571887756999999, 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:05.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:05.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:05.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.569351075, 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:05.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:05.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:05.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.554618859000001, 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.265 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.271 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.552159027999998, 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.546240002000001, 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.278 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.539511107999999, 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:05.290 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.484829058999999, 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.455242605999999, 2024-04-18T21:07:05.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.302 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.444058476999999, 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.443764286, 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.308 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:05.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:05.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:05.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:05.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:05.313 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.441123758, 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.432842163, 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:05.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:05.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:05.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 16.245924837, 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 16.244937068999999, 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:05.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:05.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:05.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 16.240632625, 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:05.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:05.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:05.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:05.341 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:05.343 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:07:05.343 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:07:05.343 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 65, 2024-04-18T21:07:05.343 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:07:05.343 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:07:05.343 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:07:03.854166+0000", 2024-04-18T21:07:05.343 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5806080, 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "nodeep-scrub", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "noscrub", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:07:05.344 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:05.345 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:07:05.346 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:05.347 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:05.348 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:05.349 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-18T21:07:05.350 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:05.351 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:05.352 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:05.353 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:05.354 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:05.355 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.8799999952316284, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.8799999952316284, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.8799999952316284, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.8799999952316284, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.356 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:05.359 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.360 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:07:05.361 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.7799999713897705, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.7799999713897705, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.7799999713897705, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.7799999713897705, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:07:05.362 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:05.363 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:05.364 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:05.365 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:07:05.367 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "score_type": "Fair distribution", 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5499999523162842, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5499999523162842, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5499999523162842, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5499999523162842, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 0.67087304592132568, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 0.67000001668930054, 2024-04-18T21:07:05.368 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 0.0126190185546875, 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:07:05.369 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 60, 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:07:05.370 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.371 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.372 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.373 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:07:05.374 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 61, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.376 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.377 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.378 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 53, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.380 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:07:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:07:05.384 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:07:05.385 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:07:05.386 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "4.3", 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:07:05.387 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:07:05.388 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:05.389 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:07:05.390 INFO:tasks.thrashosds.thrasher:j is {'epoch': 65, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:07:03.854166+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 1, 'raw_score_acting': 1.7799999713897705, 'raw_score_stable': 1.7799999713897705, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5499999523162842, 'score_stable': 1.5499999523162842, 'optimal_score': 1, 'raw_score_acting': 1.5499999523162842, 'raw_score_stable': 1.5499999523162842, 'primary_affinity_weighted': 0.6708730459213257, 'average_primary_affinity': 0.6700000166893005, 'average_primary_affinity_weighted': 0.6700000166893005}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.0126190185546875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 61, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 53, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.3', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:07:05.390 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:07:05.390 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:05.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:05.342+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:05.443 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:05.443+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:05.523 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:05.523 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:05.524 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:05.524 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:05.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:05.586 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:05.585+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:05.645 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:05.645+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:05.664 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:05.664 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:05.664 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:05.664 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:05.664 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:05.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:05.709 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:07:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:07:05.727 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-04-18T21:07:05.633618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1370039928,"num_objects":11112,"num_object_clones":0,"num_object_copies":22224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11112,"num_whiteouts":0,"num_read":1612,"num_read_kb":711976,"num_write":13794,"num_write_kb":2414050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13805,"ondisk_log_size":13805,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":434916,"kb_used_data":311028,"kb_used_omap":4,"kb_used_meta":121275,"kb_avail":282680604,"statfs":{"total":289910292480,"available":289464938496,"internally_reserved":0,"allocated":318492672,"data_stored":2308979139,"data_compressed":133839349,"data_compressed_allocated":174440448,"data_compressed_original":2219214710,"omap_allocated":4785,"internal_metadata":124185935},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1183722217,"num_objects":417,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":417,"num_whiteouts":0,"num_read":1452,"num_read_kb":707912,"num_write":2503,"num_write_kb":2182059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001025"},"pg_stats":[{"pgid":"4.3f","version":"63'176","reported_seq":306,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.712712+0000","last_change":"2024-04-18T21:05:08.612396+0000","last_active":"2024-04-18T21:07:00.712712+0000","last_peered":"2024-04-18T21:07:00.712712+0000","last_clean":"2024-04-18T21:07:00.712712+0000","last_became_active":"2024-04-18T21:05:08.609640+0000","last_became_peered":"2024-04-18T21:05:08.609640+0000","last_unstale":"2024-04-18T21:07:00.712712+0000","last_undegraded":"2024-04-18T21:07:00.712712+0000","last_fullsized":"2024-04-18T21:07:00.712712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17262490,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":28,"num_read_kb":13499,"num_write":175,"num_write_kb":21744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"63'204","reported_seq":335,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.690841+0000","last_change":"2024-04-18T21:05:08.610952+0000","last_active":"2024-04-18T21:07:00.690841+0000","last_peered":"2024-04-18T21:07:00.690841+0000","last_clean":"2024-04-18T21:07:00.690841+0000","last_became_active":"2024-04-18T21:05:08.608250+0000","last_became_peered":"2024-04-18T21:05:08.608250+0000","last_unstale":"2024-04-18T21:07:00.690841+0000","last_undegraded":"2024-04-18T21:07:00.690841+0000","last_fullsized":"2024-04-18T21:07:00.690841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21808827,"num_objects":167,"num_object_clones":0,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":29,"num_read_kb":18481,"num_write":202,"num_write_kb":67693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"63'171","reported_seq":288,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.264024+0000","last_change":"2024-04-18T21:06:42.772100+0000","last_active":"2024-04-18T21:07:00.264024+0000","last_peered":"2024-04-18T21:07:00.264024+0000","last_clean":"2024-04-18T21:07:00.264024+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:07:00.264024+0000","last_undegraded":"2024-04-18T21:07:00.264024+0000","last_fullsized":"2024-04-18T21:07:00.264024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:42.621459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18474690,"num_objects":164,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":164,"num_whiteouts":0,"num_read":10,"num_read_kb":4741,"num_write":171,"num_write_kb":22425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"63'176","reported_seq":307,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.252469+0000","last_change":"2024-04-18T21:06:42.773600+0000","last_active":"2024-04-18T21:07:00.252469+0000","last_peered":"2024-04-18T21:07:00.252469+0000","last_clean":"2024-04-18T21:07:00.252469+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:07:00.252469+0000","last_undegraded":"2024-04-18T21:07:00.252469+0000","last_fullsized":"2024-04-18T21:07:00.252469+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:01.631939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10534146,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":175,"num_write_kb":34458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'206","reported_seq":325,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.437541+0000","last_change":"2024-04-18T21:05:08.607780+0000","last_active":"2024-04-18T21:07:00.437541+0000","last_peered":"2024-04-18T21:07:00.437541+0000","last_clean":"2024-04-18T21:07:00.437541+0000","last_became_active":"2024-04-18T21:05:08.606911+0000","last_became_peered":"2024-04-18T21:05:08.606911+0000","last_unstale":"2024-04-18T21:07:00.437541+0000","last_undegraded":"2024-04-18T21:07:00.437541+0000","last_fullsized":"2024-04-18T21:07:00.437541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28857052,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":17,"num_read_kb":12297,"num_write":204,"num_write_kb":47087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"63'185","reported_seq":316,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.651978+0000","last_change":"2024-04-18T21:06:42.762884+0000","last_active":"2024-04-18T21:07:00.651978+0000","last_peered":"2024-04-18T21:07:00.651978+0000","last_clean":"2024-04-18T21:07:00.651978+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:07:00.651978+0000","last_undegraded":"2024-04-18T21:07:00.651978+0000","last_fullsized":"2024-04-18T21:07:00.651978+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:57:06.797511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26046125,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":24,"num_read_kb":17804,"num_write":184,"num_write_kb":32988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'196","reported_seq":321,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.630597+0000","last_change":"2024-04-18T21:06:42.765508+0000","last_active":"2024-04-18T21:07:00.630597+0000","last_peered":"2024-04-18T21:07:00.630597+0000","last_clean":"2024-04-18T21:07:00.630597+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:07:00.630597+0000","last_undegraded":"2024-04-18T21:07:00.630597+0000","last_fullsized":"2024-04-18T21:07:00.630597+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:01:42.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27888475,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":18,"num_read_kb":8517,"num_write":195,"num_write_kb":42821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'162","reported_seq":275,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.378837+0000","last_change":"2024-04-18T21:06:42.764054+0000","last_active":"2024-04-18T21:07:00.378837+0000","last_peered":"2024-04-18T21:07:00.378837+0000","last_clean":"2024-04-18T21:07:00.378837+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:07:00.378837+0000","last_undegraded":"2024-04-18T21:07:00.378837+0000","last_fullsized":"2024-04-18T21:07:00.378837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:15:50.427889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14197917,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":6,"num_read_kb":672,"num_write":160,"num_write_kb":21950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'205","reported_seq":329,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.541170+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:07:00.541170+0000","last_peered":"2024-04-18T21:07:00.541170+0000","last_clean":"2024-04-18T21:07:00.541170+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:07:00.541170+0000","last_undegraded":"2024-04-18T21:07:00.541170+0000","last_fullsized":"2024-04-18T21:07:00.541170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17408764,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":22,"num_read_kb":12860,"num_write":204,"num_write_kb":58985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"63'183","reported_seq":304,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.527931+0000","last_change":"2024-04-18T21:05:08.610235+0000","last_active":"2024-04-18T21:07:00.527931+0000","last_peered":"2024-04-18T21:07:00.527931+0000","last_clean":"2024-04-18T21:07:00.527931+0000","last_became_active":"2024-04-18T21:05:08.607252+0000","last_became_peered":"2024-04-18T21:05:08.607252+0000","last_unstale":"2024-04-18T21:07:00.527931+0000","last_undegraded":"2024-04-18T21:07:00.527931+0000","last_fullsized":"2024-04-18T21:07:00.527931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31083084,"num_objects":164,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":164,"num_whiteouts":0,"num_read":19,"num_read_kb":8726,"num_write":183,"num_write_kb":54865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"63'173","reported_seq":294,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.670655+0000","last_change":"2024-04-18T21:06:42.770457+0000","last_active":"2024-04-18T21:07:00.670655+0000","last_peered":"2024-04-18T21:07:00.670655+0000","last_clean":"2024-04-18T21:07:00.670655+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:07:00.670655+0000","last_undegraded":"2024-04-18T21:07:00.670655+0000","last_fullsized":"2024-04-18T21:07:00.670655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:10.843661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12352508,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":14,"num_read_kb":6454,"num_write":172,"num_write_kb":17251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'158","reported_seq":304,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.707622+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:07:00.707622+0000","last_peered":"2024-04-18T21:07:00.707622+0000","last_clean":"2024-04-18T21:07:00.707622+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:07:00.707622+0000","last_undegraded":"2024-04-18T21:07:00.707622+0000","last_fullsized":"2024-04-18T21:07:00.707622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19115007,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":44,"num_read_kb":17192,"num_write":158,"num_write_kb":21282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"63'178","reported_seq":312,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.043058+0000","last_change":"2024-04-18T21:05:08.605203+0000","last_active":"2024-04-18T21:07:00.043058+0000","last_peered":"2024-04-18T21:07:00.043058+0000","last_clean":"2024-04-18T21:07:00.043058+0000","last_became_active":"2024-04-18T21:05:08.604029+0000","last_became_peered":"2024-04-18T21:05:08.604029+0000","last_unstale":"2024-04-18T21:07:00.043058+0000","last_undegraded":"2024-04-18T21:07:00.043058+0000","last_fullsized":"2024-04-18T21:07:00.043058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15317323,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":32,"num_read_kb":18652,"num_write":176,"num_write_kb":25722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"63'215","reported_seq":358,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.683233+0000","last_change":"2024-04-18T21:06:42.763763+0000","last_active":"2024-04-18T21:07:00.683233+0000","last_peered":"2024-04-18T21:07:00.683233+0000","last_clean":"2024-04-18T21:07:00.683233+0000","last_became_active":"2024-04-18T21:06:42.757502+0000","last_became_peered":"2024-04-18T21:06:42.757502+0000","last_unstale":"2024-04-18T21:07:00.683233+0000","last_undegraded":"2024-04-18T21:07:00.683233+0000","last_fullsized":"2024-04-18T21:07:00.683233+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:01:42.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37303552,"num_objects":187,"num_object_clones":0,"num_object_copies":374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":0,"num_read":36,"num_read_kb":18476,"num_write":213,"num_write_kb":75473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"63'185","reported_seq":331,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.694900+0000","last_change":"2024-04-18T21:06:42.765445+0000","last_active":"2024-04-18T21:07:00.694900+0000","last_peered":"2024-04-18T21:07:00.694900+0000","last_clean":"2024-04-18T21:07:00.694900+0000","last_became_active":"2024-04-18T21:06:42.758220+0000","last_became_peered":"2024-04-18T21:06:42.758220+0000","last_unstale":"2024-04-18T21:07:00.694900+0000","last_undegraded":"2024-04-18T21:07:00.694900+0000","last_fullsized":"2024-04-18T21:07:00.694900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:47.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39407043,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":39,"num_read_kb":21683,"num_write":185,"num_write_kb":54770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'211","reported_seq":347,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.698328+0000","last_change":"2024-04-18T21:06:42.762039+0000","last_active":"2024-04-18T21:07:00.698328+0000","last_peered":"2024-04-18T21:07:00.698328+0000","last_clean":"2024-04-18T21:07:00.698328+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:07:00.698328+0000","last_undegraded":"2024-04-18T21:07:00.698328+0000","last_fullsized":"2024-04-18T21:07:00.698328+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:27.621896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29101227,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":30,"num_read_kb":11711,"num_write":211,"num_write_kb":51182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'189","reported_seq":307,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.177535+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:07:00.177535+0000","last_peered":"2024-04-18T21:07:00.177535+0000","last_clean":"2024-04-18T21:07:00.177535+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:07:00.177535+0000","last_undegraded":"2024-04-18T21:07:00.177535+0000","last_fullsized":"2024-04-18T21:07:00.177535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14943169,"num_objects":171,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":0,"num_read":16,"num_read_kb":4110,"num_write":189,"num_write_kb":30258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"63'187","reported_seq":309,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.693921+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:07:00.693921+0000","last_peered":"2024-04-18T21:07:00.693921+0000","last_clean":"2024-04-18T21:07:00.693921+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:07:00.693921+0000","last_undegraded":"2024-04-18T21:07:00.693921+0000","last_fullsized":"2024-04-18T21:07:00.693921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22184205,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":20,"num_read_kb":10014,"num_write":183,"num_write_kb":38201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"63'193","reported_seq":325,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.506814+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:07:00.506814+0000","last_peered":"2024-04-18T21:07:00.506814+0000","last_clean":"2024-04-18T21:07:00.506814+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:07:00.506814+0000","last_undegraded":"2024-04-18T21:07:00.506814+0000","last_fullsized":"2024-04-18T21:07:00.506814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23153906,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":30,"num_read_kb":14467,"num_write":191,"num_write_kb":42750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'194","reported_seq":318,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.563827+0000","last_change":"2024-04-18T21:06:42.777421+0000","last_active":"2024-04-18T21:07:00.563827+0000","last_peered":"2024-04-18T21:07:00.563827+0000","last_clean":"2024-04-18T21:07:00.563827+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:07:00.563827+0000","last_undegraded":"2024-04-18T21:07:00.563827+0000","last_fullsized":"2024-04-18T21:07:00.563827+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:05.221224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17365936,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":17,"num_read_kb":5029,"num_write":191,"num_write_kb":17473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'173","reported_seq":286,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.638432+0000","last_change":"2024-04-18T21:06:42.776871+0000","last_active":"2024-04-18T21:07:00.638432+0000","last_peered":"2024-04-18T21:07:00.638432+0000","last_clean":"2024-04-18T21:07:00.638432+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:07:00.638432+0000","last_undegraded":"2024-04-18T21:07:00.638432+0000","last_fullsized":"2024-04-18T21:07:00.638432+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:16.876164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16427376,"num_objects":167,"num_object_clones":0,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":6,"num_read_kb":1549,"num_write":185,"num_write_kb":22186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'209","reported_seq":331,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.672576+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:07:00.672576+0000","last_peered":"2024-04-18T21:07:00.672576+0000","last_clean":"2024-04-18T21:07:00.672576+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:07:00.672576+0000","last_undegraded":"2024-04-18T21:07:00.672576+0000","last_fullsized":"2024-04-18T21:07:00.672576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743846,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":20,"num_read_kb":9048,"num_write":209,"num_write_kb":59439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"63'183","reported_seq":291,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.687996+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:07:00.687996+0000","last_peered":"2024-04-18T21:07:00.687996+0000","last_clean":"2024-04-18T21:07:00.687996+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:07:00.687996+0000","last_undegraded":"2024-04-18T21:07:00.687996+0000","last_fullsized":"2024-04-18T21:07:00.687996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29547963,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":6,"num_read_kb":1408,"num_write":181,"num_write_kb":50869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"63'208","reported_seq":341,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.528186+0000","last_change":"2024-04-18T21:05:08.607955+0000","last_active":"2024-04-18T21:07:00.528186+0000","last_peered":"2024-04-18T21:07:00.528186+0000","last_clean":"2024-04-18T21:07:00.528186+0000","last_became_active":"2024-04-18T21:05:08.604111+0000","last_became_peered":"2024-04-18T21:05:08.604111+0000","last_unstale":"2024-04-18T21:07:00.528186+0000","last_undegraded":"2024-04-18T21:07:00.528186+0000","last_fullsized":"2024-04-18T21:07:00.528186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30151660,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":31,"num_read_kb":20588,"num_write":206,"num_write_kb":46745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"63'194","reported_seq":296,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.851729+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:06:59.851729+0000","last_peered":"2024-04-18T21:06:59.851729+0000","last_clean":"2024-04-18T21:06:59.851729+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:06:59.851729+0000","last_undegraded":"2024-04-18T21:06:59.851729+0000","last_fullsized":"2024-04-18T21:06:59.851729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4637333,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":9283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"63'224","reported_seq":369,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.648450+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:07:00.648450+0000","last_peered":"2024-04-18T21:07:00.648450+0000","last_clean":"2024-04-18T21:07:00.648450+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:07:00.648450+0000","last_undegraded":"2024-04-18T21:07:00.648450+0000","last_fullsized":"2024-04-18T21:07:00.648450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26432132,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":0,"num_read":43,"num_read_kb":23317,"num_write":219,"num_write_kb":38714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"63'174","reported_seq":297,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.942444+0000","last_change":"2024-04-18T21:06:42.769309+0000","last_active":"2024-04-18T21:06:59.942444+0000","last_peered":"2024-04-18T21:06:59.942444+0000","last_clean":"2024-04-18T21:06:59.942444+0000","last_became_active":"2024-04-18T21:06:42.766848+0000","last_became_peered":"2024-04-18T21:06:42.766848+0000","last_unstale":"2024-04-18T21:06:59.942444+0000","last_undegraded":"2024-04-18T21:06:59.942444+0000","last_fullsized":"2024-04-18T21:06:59.942444+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:09.526938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12933837,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":16,"num_read_kb":2312,"num_write":173,"num_write_kb":9585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"63'183","reported_seq":355,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.605956+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:07:00.605956+0000","last_peered":"2024-04-18T21:07:00.605956+0000","last_clean":"2024-04-18T21:07:00.605956+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:07:00.605956+0000","last_undegraded":"2024-04-18T21:07:00.605956+0000","last_fullsized":"2024-04-18T21:07:00.605956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29233265,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":70,"num_read_kb":38068,"num_write":182,"num_write_kb":42831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"63'180","reported_seq":293,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.687319+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:07:00.687319+0000","last_peered":"2024-04-18T21:07:00.687319+0000","last_clean":"2024-04-18T21:07:00.687319+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:07:00.687319+0000","last_undegraded":"2024-04-18T21:07:00.687319+0000","last_fullsized":"2024-04-18T21:07:00.687319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21005399,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":11,"num_read_kb":4508,"num_write":179,"num_write_kb":25900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"63'211","reported_seq":333,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.370793+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:07:00.370793+0000","last_peered":"2024-04-18T21:07:00.370793+0000","last_clean":"2024-04-18T21:07:00.370793+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:07:00.370793+0000","last_undegraded":"2024-04-18T21:07:00.370793+0000","last_fullsized":"2024-04-18T21:07:00.370793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20766055,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":20,"num_read_kb":8951,"num_write":211,"num_write_kb":34117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"63'205","reported_seq":348,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.468297+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:07:00.468297+0000","last_peered":"2024-04-18T21:07:00.468297+0000","last_clean":"2024-04-18T21:07:00.468297+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:07:00.468297+0000","last_undegraded":"2024-04-18T21:07:00.468297+0000","last_fullsized":"2024-04-18T21:07:00.468297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10324026,"num_objects":187,"num_object_clones":0,"num_object_copies":374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":0,"num_read":41,"num_read_kb":16816,"num_write":205,"num_write_kb":30404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"63'207","reported_seq":340,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.327994+0000","last_change":"2024-04-18T21:06:42.764233+0000","last_active":"2024-04-18T21:07:00.327994+0000","last_peered":"2024-04-18T21:07:00.327994+0000","last_clean":"2024-04-18T21:07:00.327994+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:07:00.327994+0000","last_undegraded":"2024-04-18T21:07:00.327994+0000","last_fullsized":"2024-04-18T21:07:00.327994+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:09.928737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14443532,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":26,"num_read_kb":13021,"num_write":205,"num_write_kb":23693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'180","reported_seq":304,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.620990+0000","last_change":"2024-04-18T21:05:08.615855+0000","last_active":"2024-04-18T21:07:00.620990+0000","last_peered":"2024-04-18T21:07:00.620990+0000","last_clean":"2024-04-18T21:07:00.620990+0000","last_became_active":"2024-04-18T21:05:08.608636+0000","last_became_peered":"2024-04-18T21:05:08.608636+0000","last_unstale":"2024-04-18T21:07:00.620990+0000","last_undegraded":"2024-04-18T21:07:00.620990+0000","last_fullsized":"2024-04-18T21:07:00.620990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8224465,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":22,"num_read_kb":10844,"num_write":178,"num_write_kb":34277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"62'588","reported_seq":625,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.856419+0000","last_change":"2024-04-18T21:06:42.767288+0000","last_active":"2024-04-18T21:06:59.856419+0000","last_peered":"2024-04-18T21:06:59.856419+0000","last_clean":"2024-04-18T21:06:59.856419+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:06:59.856419+0000","last_undegraded":"2024-04-18T21:06:59.856419+0000","last_fullsized":"2024-04-18T21:06:59.856419+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:20.327001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'191","reported_seq":313,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.606847+0000","last_change":"2024-04-18T21:06:04.010167+0000","last_active":"2024-04-18T21:07:00.606847+0000","last_peered":"2024-04-18T21:07:00.606847+0000","last_clean":"2024-04-18T21:07:00.606847+0000","last_became_active":"2024-04-18T21:06:04.009963+0000","last_became_peered":"2024-04-18T21:06:04.009963+0000","last_unstale":"2024-04-18T21:07:00.606847+0000","last_undegraded":"2024-04-18T21:07:00.606847+0000","last_fullsized":"2024-04-18T21:07:00.606847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.959959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23224662,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":10,"num_read_kb":1787,"num_write":188,"num_write_kb":50825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":104,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.855892+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:06:59.855892+0000","last_peered":"2024-04-18T21:06:59.855892+0000","last_clean":"2024-04-18T21:06:59.855892+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:06:59.855892+0000","last_undegraded":"2024-04-18T21:06:59.855892+0000","last_fullsized":"2024-04-18T21:06:59.855892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"63'185","reported_seq":304,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.697274+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:07:00.697274+0000","last_peered":"2024-04-18T21:07:00.697274+0000","last_clean":"2024-04-18T21:07:00.697274+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:07:00.697274+0000","last_undegraded":"2024-04-18T21:07:00.697274+0000","last_fullsized":"2024-04-18T21:07:00.697274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22370639,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":17,"num_read_kb":13175,"num_write":184,"num_write_kb":30042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"63'1","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.850574+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:06:59.850574+0000","last_peered":"2024-04-18T21:06:59.850574+0000","last_clean":"2024-04-18T21:06:59.850574+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:06:59.850574+0000","last_undegraded":"2024-04-18T21:06:59.850574+0000","last_fullsized":"2024-04-18T21:06:59.850574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"63'181","reported_seq":322,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.697750+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:07:00.697750+0000","last_peered":"2024-04-18T21:07:00.697750+0000","last_clean":"2024-04-18T21:07:00.697750+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:07:00.697750+0000","last_undegraded":"2024-04-18T21:07:00.697750+0000","last_fullsized":"2024-04-18T21:07:00.697750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24266779,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":39,"num_read_kb":19297,"num_write":180,"num_write_kb":38815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"63'10","reported_seq":41,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.691153+0000","last_change":"2024-04-18T21:06:42.765792+0000","last_active":"2024-04-18T21:07:00.691153+0000","last_peered":"2024-04-18T21:07:00.691153+0000","last_clean":"2024-04-18T21:07:00.691153+0000","last_became_active":"2024-04-18T21:06:42.763647+0000","last_became_peered":"2024-04-18T21:06:42.763647+0000","last_unstale":"2024-04-18T21:07:00.691153+0000","last_undegraded":"2024-04-18T21:07:00.691153+0000","last_fullsized":"2024-04-18T21:07:00.691153+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:29:03.325216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.851601+0000","last_change":"2024-04-18T21:06:42.769260+0000","last_active":"2024-04-18T21:06:59.851601+0000","last_peered":"2024-04-18T21:06:59.851601+0000","last_clean":"2024-04-18T21:06:59.851601+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:06:59.851601+0000","last_undegraded":"2024-04-18T21:06:59.851601+0000","last_fullsized":"2024-04-18T21:06:59.851601+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:12:01.164268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"63'191","reported_seq":305,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.657152+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:07:00.657152+0000","last_peered":"2024-04-18T21:07:00.657152+0000","last_clean":"2024-04-18T21:07:00.657152+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:07:00.657152+0000","last_undegraded":"2024-04-18T21:07:00.657152+0000","last_fullsized":"2024-04-18T21:07:00.657152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14840980,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":12,"num_read_kb":4942,"num_write":190,"num_write_kb":34342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"62'3","reported_seq":107,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.852176+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:06:59.852176+0000","last_peered":"2024-04-18T21:06:59.852176+0000","last_clean":"2024-04-18T21:06:59.852176+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:06:59.852176+0000","last_undegraded":"2024-04-18T21:06:59.852176+0000","last_fullsized":"2024-04-18T21:06:59.852176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"63'215","reported_seq":363,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.633382+0000","last_change":"2024-04-18T21:05:08.605984+0000","last_active":"2024-04-18T21:07:00.633382+0000","last_peered":"2024-04-18T21:07:00.633382+0000","last_clean":"2024-04-18T21:07:00.633382+0000","last_became_active":"2024-04-18T21:05:08.604830+0000","last_became_peered":"2024-04-18T21:05:08.604830+0000","last_unstale":"2024-04-18T21:07:00.633382+0000","last_undegraded":"2024-04-18T21:07:00.633382+0000","last_fullsized":"2024-04-18T21:07:00.633382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:56.541990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25454052,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":46,"num_read_kb":21925,"num_write":214,"num_write_kb":35129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"63'4","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.851671+0000","last_change":"2024-04-18T21:06:42.771952+0000","last_active":"2024-04-18T21:06:59.851671+0000","last_peered":"2024-04-18T21:06:59.851671+0000","last_clean":"2024-04-18T21:06:59.851671+0000","last_became_active":"2024-04-18T21:06:42.768441+0000","last_became_peered":"2024-04-18T21:06:42.768441+0000","last_unstale":"2024-04-18T21:06:59.851671+0000","last_undegraded":"2024-04-18T21:06:59.851671+0000","last_fullsized":"2024-04-18T21:06:59.851671+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:00.622485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"63'220","reported_seq":397,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.624830+0000","last_change":"2024-04-18T21:06:42.773762+0000","last_active":"2024-04-18T21:07:00.624830+0000","last_peered":"2024-04-18T21:07:00.624830+0000","last_clean":"2024-04-18T21:07:00.624830+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:07:00.624830+0000","last_undegraded":"2024-04-18T21:07:00.624830+0000","last_fullsized":"2024-04-18T21:07:00.624830+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:42.621459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47969429,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":70,"num_read_kb":35260,"num_write":220,"num_write_kb":80356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.856856+0000","last_change":"2024-04-18T21:06:42.775878+0000","last_active":"2024-04-18T21:06:59.856856+0000","last_peered":"2024-04-18T21:06:59.856856+0000","last_clean":"2024-04-18T21:06:59.856856+0000","last_became_active":"2024-04-18T21:06:42.772647+0000","last_became_peered":"2024-04-18T21:06:42.772647+0000","last_unstale":"2024-04-18T21:06:59.856856+0000","last_undegraded":"2024-04-18T21:06:59.856856+0000","last_fullsized":"2024-04-18T21:06:59.856856+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:15.012341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'204","reported_seq":357,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.308123+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:07:00.308123+0000","last_peered":"2024-04-18T21:07:00.308123+0000","last_clean":"2024-04-18T21:07:00.308123+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:07:00.308123+0000","last_undegraded":"2024-04-18T21:07:00.308123+0000","last_fullsized":"2024-04-18T21:07:00.308123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19018912,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":51,"num_read_kb":25758,"num_write":203,"num_write_kb":25978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"62'20","reported_seq":124,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.857112+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:06:59.857112+0000","last_peered":"2024-04-18T21:06:59.857112+0000","last_clean":"2024-04-18T21:06:59.857112+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:06:59.857112+0000","last_undegraded":"2024-04-18T21:06:59.857112+0000","last_fullsized":"2024-04-18T21:06:59.857112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"63'208","reported_seq":328,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.618545+0000","last_change":"2024-04-18T21:06:42.775218+0000","last_active":"2024-04-18T21:07:00.618545+0000","last_peered":"2024-04-18T21:07:00.618545+0000","last_clean":"2024-04-18T21:07:00.618545+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:07:00.618545+0000","last_undegraded":"2024-04-18T21:07:00.618545+0000","last_fullsized":"2024-04-18T21:07:00.618545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:09.627976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546368,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":207,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.855318+0000","last_change":"2024-04-18T21:06:42.762081+0000","last_active":"2024-04-18T21:06:59.855318+0000","last_peered":"2024-04-18T21:06:59.855318+0000","last_clean":"2024-04-18T21:06:59.855318+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:06:59.855318+0000","last_undegraded":"2024-04-18T21:06:59.855318+0000","last_fullsized":"2024-04-18T21:06:59.855318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:14.883260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'204","reported_seq":334,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.687571+0000","last_change":"2024-04-18T21:06:42.771159+0000","last_active":"2024-04-18T21:07:00.687571+0000","last_peered":"2024-04-18T21:07:00.687571+0000","last_clean":"2024-04-18T21:07:00.687571+0000","last_became_active":"2024-04-18T21:06:42.767524+0000","last_became_peered":"2024-04-18T21:06:42.767524+0000","last_unstale":"2024-04-18T21:07:00.687571+0000","last_undegraded":"2024-04-18T21:07:00.687571+0000","last_fullsized":"2024-04-18T21:07:00.687571+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:42.258137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21814616,"num_objects":175,"num_object_clones":0,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":0,"num_read":23,"num_read_kb":17630,"num_write":202,"num_write_kb":70874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'1","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.850402+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:06:59.850402+0000","last_peered":"2024-04-18T21:06:59.850402+0000","last_clean":"2024-04-18T21:06:59.850402+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:06:59.850402+0000","last_undegraded":"2024-04-18T21:06:59.850402+0000","last_fullsized":"2024-04-18T21:06:59.850402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"63'162","reported_seq":290,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.270799+0000","last_change":"2024-04-18T21:06:42.763294+0000","last_active":"2024-04-18T21:07:00.270799+0000","last_peered":"2024-04-18T21:07:00.270799+0000","last_clean":"2024-04-18T21:07:00.270799+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:07:00.270799+0000","last_undegraded":"2024-04-18T21:07:00.270799+0000","last_fullsized":"2024-04-18T21:07:00.270799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:27.194682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14677310,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":21,"num_read_kb":4820,"num_write":161,"num_write_kb":21731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"63'4","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.691309+0000","last_change":"2024-04-18T21:05:07.582430+0000","last_active":"2024-04-18T21:07:00.691309+0000","last_peered":"2024-04-18T21:07:00.691309+0000","last_clean":"2024-04-18T21:07:00.691309+0000","last_became_active":"2024-04-18T21:05:07.581658+0000","last_became_peered":"2024-04-18T21:05:07.581658+0000","last_unstale":"2024-04-18T21:07:00.691309+0000","last_undegraded":"2024-04-18T21:07:00.691309+0000","last_fullsized":"2024-04-18T21:07:00.691309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:33.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17684,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"63'199","reported_seq":339,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.681110+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:07:00.681110+0000","last_peered":"2024-04-18T21:07:00.681110+0000","last_clean":"2024-04-18T21:07:00.681110+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:07:00.681110+0000","last_undegraded":"2024-04-18T21:07:00.681110+0000","last_fullsized":"2024-04-18T21:07:00.681110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26368223,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":38,"num_read_kb":15673,"num_write":198,"num_write_kb":59079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":231,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.850945+0000","last_change":"2024-04-18T21:06:42.764387+0000","last_active":"2024-04-18T21:06:59.850945+0000","last_peered":"2024-04-18T21:06:59.850945+0000","last_clean":"2024-04-18T21:06:59.850945+0000","last_became_active":"2024-04-18T21:06:42.763432+0000","last_became_peered":"2024-04-18T21:06:42.763432+0000","last_unstale":"2024-04-18T21:06:59.850945+0000","last_undegraded":"2024-04-18T21:06:59.850945+0000","last_fullsized":"2024-04-18T21:06:59.850945+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:10.269224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.857248+0000","last_change":"2024-04-18T21:06:42.775112+0000","last_active":"2024-04-18T21:06:59.857248+0000","last_peered":"2024-04-18T21:06:59.857248+0000","last_clean":"2024-04-18T21:06:59.857248+0000","last_became_active":"2024-04-18T21:06:42.770706+0000","last_became_peered":"2024-04-18T21:06:42.770706+0000","last_unstale":"2024-04-18T21:06:59.857248+0000","last_undegraded":"2024-04-18T21:06:59.857248+0000","last_fullsized":"2024-04-18T21:06:59.857248+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:24:32.220495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"61'90","reported_seq":194,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.855909+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:06:59.855909+0000","last_peered":"2024-04-18T21:06:59.855909+0000","last_clean":"2024-04-18T21:06:59.855909+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:06:59.855909+0000","last_undegraded":"2024-04-18T21:06:59.855909+0000","last_fullsized":"2024-04-18T21:06:59.855909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"63'188","reported_seq":307,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.697549+0000","last_change":"2024-04-18T21:06:42.772808+0000","last_active":"2024-04-18T21:07:00.697549+0000","last_peered":"2024-04-18T21:07:00.697549+0000","last_clean":"2024-04-18T21:07:00.697549+0000","last_became_active":"2024-04-18T21:06:42.770871+0000","last_became_peered":"2024-04-18T21:06:42.770871+0000","last_unstale":"2024-04-18T21:07:00.697549+0000","last_undegraded":"2024-04-18T21:07:00.697549+0000","last_fullsized":"2024-04-18T21:07:00.697549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:24:37.254402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13517013,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":12,"num_read_kb":4612,"num_write":187,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.850741+0000","last_change":"2024-04-18T21:06:42.767098+0000","last_active":"2024-04-18T21:06:59.850741+0000","last_peered":"2024-04-18T21:06:59.850741+0000","last_clean":"2024-04-18T21:06:59.850741+0000","last_became_active":"2024-04-18T21:06:42.765744+0000","last_became_peered":"2024-04-18T21:06:42.765744+0000","last_unstale":"2024-04-18T21:06:59.850741+0000","last_undegraded":"2024-04-18T21:06:59.850741+0000","last_fullsized":"2024-04-18T21:06:59.850741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:10.352655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'10","reported_seq":123,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.682660+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:07:00.682660+0000","last_peered":"2024-04-18T21:07:00.682660+0000","last_clean":"2024-04-18T21:07:00.682660+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:07:00.682660+0000","last_undegraded":"2024-04-18T21:07:00.682660+0000","last_fullsized":"2024-04-18T21:07:00.682660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":15,"num_write":9,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"63'221","reported_seq":383,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.693815+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:07:00.693815+0000","last_peered":"2024-04-18T21:07:00.693815+0000","last_clean":"2024-04-18T21:07:00.693815+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:07:00.693815+0000","last_undegraded":"2024-04-18T21:07:00.693815+0000","last_fullsized":"2024-04-18T21:07:00.693815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25763648,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":60,"num_read_kb":23144,"num_write":218,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.856145+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:06:59.856145+0000","last_peered":"2024-04-18T21:06:59.856145+0000","last_clean":"2024-04-18T21:06:59.856145+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:06:59.856145+0000","last_undegraded":"2024-04-18T21:06:59.856145+0000","last_fullsized":"2024-04-18T21:06:59.856145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"62'235","reported_seq":339,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.850572+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:06:59.850572+0000","last_peered":"2024-04-18T21:06:59.850572+0000","last_clean":"2024-04-18T21:06:59.850572+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:06:59.850572+0000","last_undegraded":"2024-04-18T21:06:59.850572+0000","last_fullsized":"2024-04-18T21:06:59.850572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"63'150","reported_seq":275,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.414030+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:07:00.414030+0000","last_peered":"2024-04-18T21:07:00.414030+0000","last_clean":"2024-04-18T21:07:00.414030+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:07:00.414030+0000","last_undegraded":"2024-04-18T21:07:00.414030+0000","last_fullsized":"2024-04-18T21:07:00.414030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11026522,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":23,"num_read_kb":9096,"num_write":149,"num_write_kb":13482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.856058+0000","last_change":"2024-04-18T21:06:42.771115+0000","last_active":"2024-04-18T21:06:59.856058+0000","last_peered":"2024-04-18T21:06:59.856058+0000","last_clean":"2024-04-18T21:06:59.856058+0000","last_became_active":"2024-04-18T21:06:42.769644+0000","last_became_peered":"2024-04-18T21:06:42.769644+0000","last_unstale":"2024-04-18T21:06:59.856058+0000","last_undegraded":"2024-04-18T21:06:59.856058+0000","last_fullsized":"2024-04-18T21:06:59.856058+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:57.139815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.856547+0000","last_change":"2024-04-18T21:06:42.769806+0000","last_active":"2024-04-18T21:06:59.856547+0000","last_peered":"2024-04-18T21:06:59.856547+0000","last_clean":"2024-04-18T21:06:59.856547+0000","last_became_active":"2024-04-18T21:06:42.766399+0000","last_became_peered":"2024-04-18T21:06:42.766399+0000","last_unstale":"2024-04-18T21:06:59.856547+0000","last_undegraded":"2024-04-18T21:06:59.856547+0000","last_fullsized":"2024-04-18T21:06:59.856547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:14.377108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'186","reported_seq":308,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.688223+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:07:00.688223+0000","last_peered":"2024-04-18T21:07:00.688223+0000","last_clean":"2024-04-18T21:07:00.688223+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:07:00.688223+0000","last_undegraded":"2024-04-18T21:07:00.688223+0000","last_fullsized":"2024-04-18T21:07:00.688223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31799391,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":20,"num_read_kb":15399,"num_write":183,"num_write_kb":66869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"63'1","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.856595+0000","last_change":"2024-04-18T21:06:42.771952+0000","last_active":"2024-04-18T21:06:59.856595+0000","last_peered":"2024-04-18T21:06:59.856595+0000","last_clean":"2024-04-18T21:06:59.856595+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:06:59.856595+0000","last_undegraded":"2024-04-18T21:06:59.856595+0000","last_fullsized":"2024-04-18T21:06:59.856595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:41.248683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.857448+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:06:59.857448+0000","last_peered":"2024-04-18T21:06:59.857448+0000","last_clean":"2024-04-18T21:06:59.857448+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:06:59.857448+0000","last_undegraded":"2024-04-18T21:06:59.857448+0000","last_fullsized":"2024-04-18T21:06:59.857448+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"63'165","reported_seq":284,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.517564+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:07:00.517564+0000","last_peered":"2024-04-18T21:07:00.517564+0000","last_clean":"2024-04-18T21:07:00.517564+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:07:00.517564+0000","last_undegraded":"2024-04-18T21:07:00.517564+0000","last_fullsized":"2024-04-18T21:07:00.517564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9474961,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":17,"num_read_kb":5944,"num_write":163,"num_write_kb":9318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"63'2","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.857323+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:06:59.857323+0000","last_peered":"2024-04-18T21:06:59.857323+0000","last_clean":"2024-04-18T21:06:59.857323+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:06:59.857323+0000","last_undegraded":"2024-04-18T21:06:59.857323+0000","last_fullsized":"2024-04-18T21:06:59.857323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.852364+0000","last_change":"2024-04-18T21:05:03.546111+0000","last_active":"2024-04-18T21:06:59.852364+0000","last_peered":"2024-04-18T21:06:59.852364+0000","last_clean":"2024-04-18T21:06:59.852364+0000","last_became_active":"2024-04-18T21:05:03.545502+0000","last_became_peered":"2024-04-18T21:05:03.545502+0000","last_unstale":"2024-04-18T21:06:59.852364+0000","last_undegraded":"2024-04-18T21:06:59.852364+0000","last_fullsized":"2024-04-18T21:06:59.852364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:38.441819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"63'179","reported_seq":306,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.718730+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:07:00.718730+0000","last_peered":"2024-04-18T21:07:00.718730+0000","last_clean":"2024-04-18T21:07:00.718730+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:07:00.718730+0000","last_undegraded":"2024-04-18T21:07:00.718730+0000","last_fullsized":"2024-04-18T21:07:00.718730+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24097579,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":22,"num_read_kb":10411,"num_write":178,"num_write_kb":25661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.858746+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:06:59.858746+0000","last_peered":"2024-04-18T21:06:59.858746+0000","last_clean":"2024-04-18T21:06:59.858746+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:06:59.858746+0000","last_undegraded":"2024-04-18T21:06:59.858746+0000","last_fullsized":"2024-04-18T21:06:59.858746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.858122+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:06:59.858122+0000","last_peered":"2024-04-18T21:06:59.858122+0000","last_clean":"2024-04-18T21:06:59.858122+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:06:59.858122+0000","last_undegraded":"2024-04-18T21:06:59.858122+0000","last_fullsized":"2024-04-18T21:06:59.858122+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"63'177","reported_seq":279,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.254837+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:07:00.254837+0000","last_peered":"2024-04-18T21:07:00.254837+0000","last_clean":"2024-04-18T21:07:00.254837+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:07:00.254837+0000","last_undegraded":"2024-04-18T21:07:00.254837+0000","last_fullsized":"2024-04-18T21:07:00.254837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8990236,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":25349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"63'28","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.858138+0000","last_change":"2024-04-18T21:06:36.741511+0000","last_active":"2024-04-18T21:06:59.858138+0000","last_peered":"2024-04-18T21:06:59.858138+0000","last_clean":"2024-04-18T21:06:59.858138+0000","last_became_active":"2024-04-18T21:06:36.737416+0000","last_became_peered":"2024-04-18T21:06:36.737416+0000","last_unstale":"2024-04-18T21:06:59.858138+0000","last_undegraded":"2024-04-18T21:06:59.858138+0000","last_fullsized":"2024-04-18T21:06:59.858138+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:20.743288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":1128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.851945+0000","last_change":"2024-04-18T21:06:42.761278+0000","last_active":"2024-04-18T21:06:59.851945+0000","last_peered":"2024-04-18T21:06:59.851945+0000","last_clean":"2024-04-18T21:06:59.851945+0000","last_became_active":"2024-04-18T21:06:42.760377+0000","last_became_peered":"2024-04-18T21:06:42.760377+0000","last_unstale":"2024-04-18T21:06:59.851945+0000","last_undegraded":"2024-04-18T21:06:59.851945+0000","last_fullsized":"2024-04-18T21:06:59.851945+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:13.153204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"63'179","reported_seq":307,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.673722+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:07:00.673722+0000","last_peered":"2024-04-18T21:07:00.673722+0000","last_clean":"2024-04-18T21:07:00.673722+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:07:00.673722+0000","last_undegraded":"2024-04-18T21:07:00.673722+0000","last_fullsized":"2024-04-18T21:07:00.673722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16454018,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":26,"num_read_kb":6799,"num_write":177,"num_write_kb":33724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"63'189","reported_seq":326,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.578553+0000","last_change":"2024-04-18T21:06:42.767671+0000","last_active":"2024-04-18T21:07:00.578553+0000","last_peered":"2024-04-18T21:07:00.578553+0000","last_clean":"2024-04-18T21:07:00.578553+0000","last_became_active":"2024-04-18T21:06:42.764583+0000","last_became_peered":"2024-04-18T21:06:42.764583+0000","last_unstale":"2024-04-18T21:07:00.578553+0000","last_undegraded":"2024-04-18T21:07:00.578553+0000","last_fullsized":"2024-04-18T21:07:00.578553+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:10.843661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39525690,"num_objects":171,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":0,"num_read":30,"num_read_kb":18234,"num_write":189,"num_write_kb":53067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"59'22","reported_seq":131,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.851054+0000","last_change":"2024-04-18T21:06:42.757898+0000","last_active":"2024-04-18T21:06:59.851054+0000","last_peered":"2024-04-18T21:06:59.851054+0000","last_clean":"2024-04-18T21:06:59.851054+0000","last_became_active":"2024-04-18T21:06:42.756852+0000","last_became_peered":"2024-04-18T21:06:42.756852+0000","last_unstale":"2024-04-18T21:06:59.851054+0000","last_undegraded":"2024-04-18T21:06:59.851054+0000","last_fullsized":"2024-04-18T21:06:59.851054+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:08.919283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"63'179","reported_seq":281,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.855635+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:06:59.855635+0000","last_peered":"2024-04-18T21:06:59.855635+0000","last_clean":"2024-04-18T21:06:59.855635+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:06:59.855635+0000","last_undegraded":"2024-04-18T21:06:59.855635+0000","last_fullsized":"2024-04-18T21:06:59.855635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9494019,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":21844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'9","reported_seq":113,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.852245+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:06:59.852245+0000","last_peered":"2024-04-18T21:06:59.852245+0000","last_clean":"2024-04-18T21:06:59.852245+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:06:59.852245+0000","last_undegraded":"2024-04-18T21:06:59.852245+0000","last_fullsized":"2024-04-18T21:06:59.852245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.857738+0000","last_change":"2024-04-18T21:06:42.765175+0000","last_active":"2024-04-18T21:06:59.857738+0000","last_peered":"2024-04-18T21:06:59.857738+0000","last_clean":"2024-04-18T21:06:59.857738+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:06:59.857738+0000","last_undegraded":"2024-04-18T21:06:59.857738+0000","last_fullsized":"2024-04-18T21:06:59.857738+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:26.185227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'228","reported_seq":347,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.690793+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:07:00.690793+0000","last_peered":"2024-04-18T21:07:00.690793+0000","last_clean":"2024-04-18T21:07:00.690793+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:07:00.690793+0000","last_undegraded":"2024-04-18T21:07:00.690793+0000","last_fullsized":"2024-04-18T21:07:00.690793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18564334,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":17,"num_read_kb":8071,"num_write":225,"num_write_kb":52312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"59'1","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.858651+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:06:59.858651+0000","last_peered":"2024-04-18T21:06:59.858651+0000","last_clean":"2024-04-18T21:06:59.858651+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:06:59.858651+0000","last_undegraded":"2024-04-18T21:06:59.858651+0000","last_fullsized":"2024-04-18T21:06:59.858651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"63'207","reported_seq":318,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.697993+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:07:00.697993+0000","last_peered":"2024-04-18T21:07:00.697993+0000","last_clean":"2024-04-18T21:07:00.697993+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:07:00.697993+0000","last_undegraded":"2024-04-18T21:07:00.697993+0000","last_fullsized":"2024-04-18T21:07:00.697993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14616817,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":9,"num_read_kb":993,"num_write":205,"num_write_kb":18063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"63'158","reported_seq":274,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.401167+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:07:00.401167+0000","last_peered":"2024-04-18T21:07:00.401167+0000","last_clean":"2024-04-18T21:07:00.401167+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:07:00.401167+0000","last_undegraded":"2024-04-18T21:07:00.401167+0000","last_fullsized":"2024-04-18T21:07:00.401167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780130,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":14,"num_read_kb":8156,"num_write":157,"num_write_kb":13711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"63'372","reported_seq":476,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.701069+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:07:00.701069+0000","last_peered":"2024-04-18T21:07:00.701069+0000","last_clean":"2024-04-18T21:07:00.701069+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:07:00.701069+0000","last_undegraded":"2024-04-18T21:07:00.701069+0000","last_fullsized":"2024-04-18T21:07:00.701069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"63'186","reported_seq":299,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.421486+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:07:00.421486+0000","last_peered":"2024-04-18T21:07:00.421486+0000","last_clean":"2024-04-18T21:07:00.421486+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:07:00.421486+0000","last_undegraded":"2024-04-18T21:07:00.421486+0000","last_fullsized":"2024-04-18T21:07:00.421486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16083170,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":11,"num_read_kb":3350,"num_write":186,"num_write_kb":27561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":104,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.855796+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:06:59.855796+0000","last_peered":"2024-04-18T21:06:59.855796+0000","last_clean":"2024-04-18T21:06:59.855796+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:06:59.855796+0000","last_undegraded":"2024-04-18T21:06:59.855796+0000","last_fullsized":"2024-04-18T21:06:59.855796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"63'171","reported_seq":285,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.470403+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:07:00.470403+0000","last_peered":"2024-04-18T21:07:00.470403+0000","last_clean":"2024-04-18T21:07:00.470403+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:07:00.470403+0000","last_undegraded":"2024-04-18T21:07:00.470403+0000","last_fullsized":"2024-04-18T21:07:00.470403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26513538,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":169,"num_write_kb":38030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"55'2","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.850893+0000","last_change":"2024-04-18T21:05:07.582769+0000","last_active":"2024-04-18T21:06:59.850893+0000","last_peered":"2024-04-18T21:06:59.850893+0000","last_clean":"2024-04-18T21:06:59.850893+0000","last_became_active":"2024-04-18T21:05:07.581825+0000","last_became_peered":"2024-04-18T21:05:07.581825+0000","last_unstale":"2024-04-18T21:06:59.850893+0000","last_undegraded":"2024-04-18T21:06:59.850893+0000","last_fullsized":"2024-04-18T21:06:59.850893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:08:26.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"63'175","reported_seq":288,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.655556+0000","last_change":"2024-04-18T21:05:08.615096+0000","last_active":"2024-04-18T21:07:00.655556+0000","last_peered":"2024-04-18T21:07:00.655556+0000","last_clean":"2024-04-18T21:07:00.655556+0000","last_became_active":"2024-04-18T21:05:08.607461+0000","last_became_peered":"2024-04-18T21:05:08.607461+0000","last_unstale":"2024-04-18T21:07:00.655556+0000","last_undegraded":"2024-04-18T21:07:00.655556+0000","last_fullsized":"2024-04-18T21:07:00.655556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34558394,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":11,"num_read_kb":3353,"num_write":173,"num_write_kb":54528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"54'5","reported_seq":109,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.852607+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:06:59.852607+0000","last_peered":"2024-04-18T21:06:59.852607+0000","last_clean":"2024-04-18T21:06:59.852607+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:06:59.852607+0000","last_undegraded":"2024-04-18T21:06:59.852607+0000","last_fullsized":"2024-04-18T21:06:59.852607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"63'167","reported_seq":294,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.687947+0000","last_change":"2024-04-18T21:06:42.769314+0000","last_active":"2024-04-18T21:07:00.687947+0000","last_peered":"2024-04-18T21:07:00.687947+0000","last_clean":"2024-04-18T21:07:00.687947+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:07:00.687947+0000","last_undegraded":"2024-04-18T21:07:00.687947+0000","last_fullsized":"2024-04-18T21:07:00.687947+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:29:04.334671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9473814,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":20,"num_read_kb":8808,"num_write":165,"num_write_kb":13223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"63'3","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.856345+0000","last_change":"2024-04-18T21:06:42.771271+0000","last_active":"2024-04-18T21:06:59.856345+0000","last_peered":"2024-04-18T21:06:59.856345+0000","last_clean":"2024-04-18T21:06:59.856345+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:06:59.856345+0000","last_undegraded":"2024-04-18T21:06:59.856345+0000","last_fullsized":"2024-04-18T21:06:59.856345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:08.517484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'192","reported_seq":314,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.693546+0000","last_change":"2024-04-18T21:06:42.768180+0000","last_active":"2024-04-18T21:07:00.693546+0000","last_peered":"2024-04-18T21:07:00.693546+0000","last_clean":"2024-04-18T21:07:00.693546+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:07:00.693546+0000","last_undegraded":"2024-04-18T21:07:00.693546+0000","last_fullsized":"2024-04-18T21:07:00.693546+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:47.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20497436,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":15,"num_read_kb":8441,"num_write":189,"num_write_kb":62990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"59'10","reported_seq":114,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.851884+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:06:59.851884+0000","last_peered":"2024-04-18T21:06:59.851884+0000","last_clean":"2024-04-18T21:06:59.851884+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:06:59.851884+0000","last_undegraded":"2024-04-18T21:06:59.851884+0000","last_fullsized":"2024-04-18T21:06:59.851884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"63'188","reported_seq":305,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:07:00.192537+0000","last_change":"2024-04-18T21:05:08.610452+0000","last_active":"2024-04-18T21:07:00.192537+0000","last_peered":"2024-04-18T21:07:00.192537+0000","last_clean":"2024-04-18T21:07:00.192537+0000","last_became_active":"2024-04-18T21:05:08.606702+0000","last_became_peered":"2024-04-18T21:05:08.606702+0000","last_unstale":"2024-04-18T21:07:00.192537+0000","last_undegraded":"2024-04-18T21:07:00.192537+0000","last_fullsized":"2024-04-18T21:07:00.192537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17708444,"num_objects":173,"num_object_clones":0,"num_object_copies":346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":173,"num_whiteouts":0,"num_read":15,"num_read_kb":4010,"num_write":185,"num_write_kb":38246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"62'103","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.857977+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:06:59.857977+0000","last_peered":"2024-04-18T21:06:59.857977+0000","last_clean":"2024-04-18T21:06:59.857977+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:06:59.857977+0000","last_undegraded":"2024-04-18T21:06:59.857977+0000","last_fullsized":"2024-04-18T21:06:59.857977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"62'191","reported_seq":304,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.855321+0000","last_change":"2024-04-18T21:06:42.764836+0000","last_active":"2024-04-18T21:06:59.855321+0000","last_peered":"2024-04-18T21:06:59.855321+0000","last_clean":"2024-04-18T21:06:59.855321+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:06:59.855321+0000","last_undegraded":"2024-04-18T21:06:59.855321+0000","last_fullsized":"2024-04-18T21:06:59.855321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:18.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6533500,"num_objects":187,"num_object_clones":0,"num_object_copies":374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":191,"num_write_kb":13345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"55'7","reported_seq":111,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T21:06:59.858566+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:06:59.858566+0000","last_peered":"2024-04-18T21:06:59.858566+0000","last_clean":"2024-04-18T21:06:59.858566+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:06:59.858566+0000","last_undegraded":"2024-04-18T21:06:59.858566+0000","last_fullsized":"2024-04-18T21:06:59.858566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":1310700959,"num_objects":11073,"num_object_clones":0,"num_object_copies":22146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11073,"num_whiteouts":0,"num_read":1467,"num_read_kb":711843,"num_write":12041,"num_write_kb":2351434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":304119808,"data_stored":2469012791,"data_compressed":129861416,"data_compressed_allocated":170745856,"data_compressed_original":2389233738,"omap_allocated":0,"internal_metadata":0},"log_size":12114,"ondisk_log_size":12114,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":58748601,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":9,"num_read_kb":15,"num_write":1550,"num_write_kb":59156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32821248,"data_stored":117519504,"data_compressed":17407590,"data_compressed_allocated":21692416,"data_compressed_original":106455040,"omap_allocated":0,"internal_metadata":0},"log_size":1534,"ondisk_log_size":1534,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133852,"kb_used_data":106564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94237988,"statfs":{"total":96636764160,"available":96499699712,"internally_reserved":0,"allocated":109121536,"data_stored":805061672,"data_compressed":45687782,"data_compressed_allocated":59727872,"data_compressed_original":773379814,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738397,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150724,"kb_used_data":101500,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94221116,"statfs":{"total":96636764160,"available":96482422784,"internally_reserved":0,"allocated":103936000,"data_stored":724022618,"data_compressed":42526293,"data_compressed_allocated":55443456,"data_compressed_original":695018132,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150340,"kb_used_data":102964,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94221500,"statfs":{"total":96636764160,"available":96482816000,"internally_reserved":0,"allocated":105435136,"data_stored":779894849,"data_compressed":45625274,"data_compressed_allocated":59269120,"data_compressed_original":750816764,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10981376,"data_stored":41953701,"data_compressed":6302887,"data_compressed_allocated":7712768,"data_compressed_original":38715392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10612736,"data_stored":33596351,"data_compressed":4810205,"data_compressed_allocated":6156288,"data_compressed_original":29151232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":41969452,"data_compressed":6294498,"data_compressed_allocated":7823360,"data_compressed_original":38588416,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94818304,"data_stored":753698625,"data_compressed":40059404,"data_compressed_allocated":52518912,"data_compressed_original":728152815,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107220992,"data_stored":891048936,"data_compressed":47407829,"data_compressed_allocated":62279680,"data_compressed_original":865449247,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102080512,"data_stored":824265230,"data_compressed":42394183,"data_compressed_allocated":55947264,"data_compressed_original":795631676,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:07:05.731 INFO:tasks.thrashosds.thrasher:Setting 4.3e to [2, 0, 1] 2024-04-18T21:07:05.731 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.3e', '2', '0', '1'] 2024-04-18T21:07:05.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.3e 2 0 1 2024-04-18T21:07:05.765 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:05.765+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 117.24941741799999, 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.847 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:07:05.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:05.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 117.24931421399999, 2024-04-18T21:07:05.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:07:05.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:07:05.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:07:05.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:05.857 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 117.249224442, 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:07:05.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:07:05.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 117.24913840400001, 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:05.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:05.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 117.249074319, 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 117.248988721, 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.873 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:05.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:05.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.409147269000002, 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:05.878 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.883 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.9041675380000003, 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:05.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.887 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13512 4.31 e64/53 4:8ffe1591:::10000003389.00000000:head v 64'187, mlcod=63'185)", 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.8967672599999998, 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027252348999999999, 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3499999999999995e-07 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959363+0000", 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00979236 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959391+0000", 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7928000000000001e-05 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959408+0000", 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6957e-05 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959644+0000", 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000235978 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959702+0000", 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8520000000000002e-05 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.976746+0000", 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017043543000000001 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.976822+0000", 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6328000000000005e-05 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.8924066499999999, 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:05.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13787 4.16 e64/16 4:6919f8ec:::10000003105.00000000:head v 64'186, mlcod=62'184)", 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.5850280009999995, 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027010007999999999, 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261310+0000", 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4670000000000001e-06 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270854+0000", 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095437979999999992 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270881+0000", 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6359999999999998e-05 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270891+0000", 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0747000000000001e-05 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.271064+0000", 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017317799999999999 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.271123+0000", 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8832999999999997e-05 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.288221+0000", 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017098153000000001 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.288319+0000", 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7472000000000005e-05 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3963038250000004, 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3707664499999996, 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:05.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3596340769999999, 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:05.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:05.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:05.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:05.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.29249774, 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:05.912 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:05.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.1396612959999999, 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:05.916 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14255 4.25 e64/53 4:a40bdcb2:::1000000353c.00000000:head v 64'184, mlcod=64'182)", 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.078458564, 2024-04-18T21:07:05.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027058845000000002, 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767879+0000", 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1429999999999999e-06 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778477+0000", 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010597304 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778504+0000", 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7480000000000001e-05 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778518+0000", 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3337e-05 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778664+0000", 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014686199999999999 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778725+0000", 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0881999999999997e-05 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.794608+0000", 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015882759999999999 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.794937+0000", 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032907699999999999 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:05.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.5751780119999998, 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.5223246059999997, 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:05.928 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14666 4.2b e64/53 4:d4915728:::10000003524.00000000:head v 64'182, mlcod=64'180)", 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.5146570869999998, 2024-04-18T21:07:05.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026848388000000001, 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331681+0000", 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-06 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340742+0000", 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090612009999999996 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340763+0000", 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0377000000000002e-05 2024-04-18T21:07:05.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340775+0000", 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2053e-05 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340911+0000", 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000136556 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340962+0000", 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1269e-05 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.358469+0000", 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017506121999999999 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.358528+0000", 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9623999999999997e-05 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:05.936 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:05.937 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:05.845+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:05.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:05.938 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:05.981 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:05.981+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:06.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:06.046+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:06.080 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:06.080 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:06.080 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:07:06.080 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:06.087 INFO:teuthology.orchestra.run.smithi096.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-18T21:07:06.093 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:07:06.093 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-18T21:07:06.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:06.149 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:06.149+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:06.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:06.246+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:06.263 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:06.264 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:06.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:06.351 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:06.349+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:06.451 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:06.451+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:06.453 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.859906692999999, 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.847042472999998, 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.846241002999999, 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.845467297999999, 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.838221734000001, 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.835155073999999, 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.817310369000001, 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.816471328999999, 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.812117649000001, 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.811349336999999, 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.807999732999999, 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.794523756, 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.792870252, 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.534 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.789739482999998, 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:06.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.762426772000001, 2024-04-18T21:07:06.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:06.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:06.546 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.761054346000002, 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:06.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:06.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:06.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:06.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:06.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5778475669999992, 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:06.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:06.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:06.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0451870169999999, 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:06.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:06.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:06.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0405017670000003, 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:06.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:06.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0398141059999997, 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:06.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:06.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:06.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:06.575 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:06.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:06.577 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:06.575+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:06.678 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:06.677+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3515 4.2e 4:77f85201:::1000000355c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720842+0000", 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0029418840000000001, 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029842839999999998, 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720842+0000", 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720842+0000", 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720844+0000", 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2529999999999999e-06 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720865+0000", 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056e-05 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720884+0000", 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9453000000000002e-05 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720899+0000", 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5130000000000001e-05 2024-04-18T21:07:06.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721056+0000", 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156663 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721389+0000", 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00033352700000000002 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3517 4.28 4:16644fd9:::10000003561.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720923+0000", 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.002861185, 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030123569999999998, 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720923+0000", 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720923+0000", 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720924+0000", 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2529999999999999e-06 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720930+0000", 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6439999999999997e-06 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721018+0000", 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7829000000000002e-05 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721033+0000", 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5373e-05 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721095+0000", 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1707999999999999e-05 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721246+0000", 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150729 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:3503 4.12 e65/16 4:480583fa:::1000000351d.00000000:head v 65'197, mlcod=65'194)", 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.722098+0000", 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0016864689999999999, 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019323700000000001, 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722098+0000", 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722098+0000", 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722098+0000", 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722104+0000", 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8919999999999997e-06 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722115+0000", 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0869e-05 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722122+0000", 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6039999999999998e-06 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722208+0000", 2024-04-18T21:07:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6343999999999999e-05 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722259+0000", 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0982000000000001e-05 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(4.12 epoch 65/16 rep_tid 7795 entries 65'196 (0'0) error 4:486a6978:::1000000343e.00000000:head by mds.0.3:3483 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 65'194)", 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.717023+0000", 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0067608679999999997, 2024-04-18T21:07:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071217950000000002, 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717023+0000", 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717023+0000", 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717024+0000", 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-07 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717030+0000", 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717043+0000", 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3117e-05 2024-04-18T21:07:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717056+0000", 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3067e-05 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717252+0000", 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019588799999999999 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3494 4.3b 4:dfb5325b:::100000034a6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.717384+0000", 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0064000009999999998, 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006849534, 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717384+0000", 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717384+0000", 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717385+0000", 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9899999999999999e-07 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717388+0000", 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3720000000000001e-06 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717396+0000", 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717401+0000", 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0340000000000004e-06 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717541+0000", 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139846 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717841+0000", 2024-04-18T21:07:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3498 4.27 4:e708eda4:::100000034c4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.717426+0000", 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0063582539999999998, 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069000060000000002, 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717426+0000", 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717426+0000", 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717427+0000", 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717430+0000", 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0309999999999999e-06 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717437+0000", 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3189999999999997e-06 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717441+0000", 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.794e-06 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717488+0000", 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6938999999999999e-05 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717597+0000", 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010969899999999999 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3499 4.32 4:4e688cad:::100000034c8.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.717454+0000", 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0063301329999999999, 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0069656279999999998, 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717454+0000", 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717454+0000", 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717455+0000", 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8500000000000001e-07 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717457+0000", 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7590000000000002e-06 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717464+0000", 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2500000000000003e-06 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717469+0000", 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3240000000000002e-06 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717602+0000", 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013314199999999999 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.717786+0000", 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018404200000000001 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718077+0000", 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029071000000000001 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.723599+0000", 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055222220000000002 2024-04-18T21:07:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(mds.0.3:3493 3.18 e65/15 3:1cc859d9:::200.00000012:head v 65'481, mlcod=65'479)", 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.718402+0000", 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.005382604, 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006130295, 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718402+0000", 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718402+0000", 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718402+0000", 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718411+0000", 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0890000000000006e-06 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718419+0000", 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0770000000000008e-06 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718425+0000", 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6119999999999998e-06 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718664+0000", 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023950499999999999 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.718684+0000", 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9888e-05 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3502 4.32 4:4f6042e9:::10000003512.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720260+0000", 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0035243789999999998, 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044246909999999997, 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720260+0000", 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720260+0000", 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720262+0000", 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2400000000000002e-06 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720273+0000", 2024-04-18T21:07:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0589e-05 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720320+0000", 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.706e-05 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720340+0000", 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.037e-05 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722000+0000", 2024-04-18T21:07:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001659818 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722134+0000", 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013365799999999999 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722238+0000", 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104707 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3504 4.24 4:25ef709d:::10000003520.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720380+0000", 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0034045669999999998, 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045762270000000004, 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720380+0000", 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720380+0000", 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720381+0000", 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4729999999999999e-06 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720388+0000", 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7900000000000002e-06 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720408+0000", 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0383000000000001e-05 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720425+0000", 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6710000000000001e-05 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720510+0000", 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4845000000000005e-05 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720658+0000", 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014804900000000001 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3506 4.d 4:b1e022a3:::100000039e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720475+0000", 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0033094909999999999, 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047047419999999996, 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720475+0000", 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720475+0000", 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720476+0000", 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4729999999999999e-06 2024-04-18T21:07:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720482+0000", 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.84e-06 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720501+0000", 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.916e-05 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720516+0000", 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4766000000000001e-05 2024-04-18T21:07:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720629+0000", 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011272 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720931+0000", 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030239699999999998 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3507 4.5 4:a35c099c:::10000003531.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720542+0000", 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.003242572, 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048245090000000003, 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720542+0000", 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720542+0000", 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720543+0000", 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720549+0000", 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9460000000000003e-06 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720598+0000", 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9057000000000001e-05 2024-04-18T21:07:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720613+0000", 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5019e-05 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720711+0000", 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7980999999999996e-05 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721179+0000", 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046796799999999998 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3509 3.15 3:a9eca768:::10000003542.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720640+0000", 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.003144296, 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049397740000000001, 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720640+0000", 2024-04-18T21:07:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720640+0000", 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720642+0000", 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.75e-06 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720674+0000", 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2786000000000001e-05 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720695+0000", 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0616999999999999e-05 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720713+0000", 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7629999999999999e-05 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721735+0000", 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001022523 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.722056+0000", 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032083699999999998 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:3514 4.3e 4:7e2ad462:::1000000355b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:06.720733+0000", 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0030509339999999999, 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050365239999999997, 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720733+0000", 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720733+0000", 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720735+0000", 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.494e-06 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720740+0000", 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4559999999999999e-06 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720777+0000", 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7217e-05 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720794+0000", 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6223e-05 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.720909+0000", 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011516 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:06.721026+0000", 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011670700000000001 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 14 2024-04-18T21:07:06.775 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:06.776 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:06.778 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:06.779+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:06.874 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:07:06.879 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:06.879+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:06.938 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:06.938 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:06.952 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:06.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:06.978+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:07.081 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:07.079+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:07.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:07.120 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:07.120 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:07.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:07.120 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.512733307000001, 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:07.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.509224051, 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.496030849, 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.478843645000001, 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.475429531, 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.474576016, 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.472039334000002, 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:07.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:07.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.457307117999999, 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.454847287, 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.448928260999999, 2024-04-18T21:07:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.442199367000001, 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.387517318, 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.357930865, 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.346746736, 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.346452544999998, 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.343812017000001, 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.335530422000001, 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.148613095999998, 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.147625328, 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.143320884000001, 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:07.244 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:07.245 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:07.243+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:07.245 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:07.257 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:07.258 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:07.279 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:07.279 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:07.299 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:07.300 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:07.346 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:07.345+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:07.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:07.481 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:07.481+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:07.548 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:07.547+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:07.568 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:07.568 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:07.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:07.649 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:07.647+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:07.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:07.746+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:07.770 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:07.770 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:07.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:07.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:07.850+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:07.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:07.951 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:07.951+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:08.052 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:08.049+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:08.093 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:08.093 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:08.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:08.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:08.154+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:08.228 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:08.228 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:08.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:08.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:08.286+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:08.354 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:08.353+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:08.362 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-18T21:07:08.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-18T21:07:08.376 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:08.376 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:08.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:08.455 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:08.455+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:08.514 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:08.803 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:08.805 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:08.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:08.802+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:08.897 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:07:08.905 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:08.903+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:08.966 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:08.966 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:08.980 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:09.029 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:09.029+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:09.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:09.105+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:09.118 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.118 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:09.208 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:09.211+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:09.300 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.300 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:09.306+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:09.314 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:09.316 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:09.409 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:09.409+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:09.436 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.436 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:09.451 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:09.474 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:09.474 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:09.496 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:09.497 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:09.510 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:09.509+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:6098 3.1c 3:3939b497:::200.00000014:head [write 2635940~32959 [fadvise_dontneed] in=32959b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:07:09.585724+0000", 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001184711, 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012043469999999999, 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.585724+0000", 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.585724+0000", 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.585726+0000", 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.787e-06 2024-04-18T21:07:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.585756+0000", 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0825999999999999e-05 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.585779+0000", 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2436e-05 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.585797+0000", 2024-04-18T21:07:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8414e-05 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.585912+0000", 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114945 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.586041+0000", 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012851200000000001 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:09.586224+0000", 2024-04-18T21:07:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183807 2024-04-18T21:07:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:07:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-04-18T21:07:09.588 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:09.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:09.611 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:09.611+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:09.713 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:09.710+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:09.742 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:09.742 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:09.742 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:09.742 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:09.742 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:09.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:09.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:09.850+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:07:09.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:09.910+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.339041769000001, 2024-04-18T21:07:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.326177549000001, 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.325376079000002, 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.324602374000001, 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.31735681, 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.314290150000001, 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.296445445, 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.295606405000001, 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:09.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:09.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:09.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:09.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.291252725, 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.983 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:09.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:09.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:09.988 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.290484413000001, 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:09.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:09.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:09.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.287134809000001, 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:09.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:09.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:09.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:09.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.000 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.273658831999999, 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.272005327999999, 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.268874559, 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:10.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:10.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:10.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:10.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.019 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.241561848, 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.026 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.240189422, 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.056982643, 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:10.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.039 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.524322093, 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:10.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:10.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.519636843000001, 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:10.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.518949182, 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:10.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:10.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:10.059 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:10.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:10.062 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:10.059+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:10.162 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:10.159+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(mds.0.3:6638 3.1d 3:bec9163d:::200.00000015:head [write 1000586~45875 [fadvise_dontneed] in=45875b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:07:10.197543+0000", 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00046552699999999998, 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048695599999999998, 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.195 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197543+0000", 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197543+0000", 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197544+0000", 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0550000000000001e-06 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197570+0000", 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5714000000000001e-05 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197630+0000", 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0449999999999999e-05 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197640+0000", 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9310000000000003e-06 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197745+0000", 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010493999999999999 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:07:10.197968+0000", 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000223088 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.199 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-04-18T21:07:10.199 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-04-18T21:07:10.199 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:10.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:10.262 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:10.261+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:10.363 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:10.361+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:10.386 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:10.386 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:10.386 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:10.386 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:10.386 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:10.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:10.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:10.466+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.920814630999999, 2024-04-18T21:07:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.537 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.917305375000002, 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:10.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:10.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.904112173000001, 2024-04-18T21:07:10.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:10.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:10.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:10.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:10.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.886924968999999, 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:10.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.883510855000001, 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.882657340000002, 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:10.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.880120657999999, 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:10.569 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:10.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:10.575 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.865388442, 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:10.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:10.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.862928611000001, 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:10.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:10.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.857009585, 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.589 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.595 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.850280691000002, 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:10.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:10.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.795598642000002, 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:10.602 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:10.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.766012189000001, 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:10.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:10.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:10.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:10.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.754828060000001, 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:10.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:10.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:10.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.754533868999999, 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:10.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:10.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.751893340999999, 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.626 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.743611745999999, 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.632 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:10.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:10.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:10.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:10.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.556694419999999, 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:10.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.555706652000001, 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:10.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:10.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:10.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:10.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:10.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.551402207999999, 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:10.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:10.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:10.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:10.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:10.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:10.655 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:10.657 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:10.657 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:10.653+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:10.758 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:10.755+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:10.795 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:10.795 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:10.795 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:10.795 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:10.809 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:10.859 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:10.858+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:10.930 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:10.930 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:10.930 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:10.930 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:10.930 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:10.944 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:10.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:10.962+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:11.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:11.062+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 122.475733312, 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.073 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:07:11.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:07:11.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 122.475630108, 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:07:11.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:07:11.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 122.47554033599999, 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.084 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:07:11.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 122.475454298, 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.089 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:11.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 122.475390213, 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:11.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.099 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 122.475304615, 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:11.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:11.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:11.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.635463162999997, 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:11.105 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:11.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:11.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.130483432, 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13512 4.31 e64/53 4:8ffe1591:::10000003389.00000000:head v 64'187, mlcod=63'185)", 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.123083154, 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027252348999999999, 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.115 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3499999999999995e-07 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959363+0000", 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00979236 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959391+0000", 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7928000000000001e-05 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959408+0000", 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6957e-05 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959644+0000", 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000235978 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959702+0000", 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8520000000000002e-05 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.976746+0000", 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017043543000000001 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.976822+0000", 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6328000000000005e-05 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.119 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.118722544000001, 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:11.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:11.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.123 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13787 4.16 e64/16 4:6919f8ec:::10000003105.00000000:head v 64'186, mlcod=62'184)", 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.8113438950000003, 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027010007999999999, 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261310+0000", 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4670000000000001e-06 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270854+0000", 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095437979999999992 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270881+0000", 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6359999999999998e-05 2024-04-18T21:07:11.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270891+0000", 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0747000000000001e-05 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.271064+0000", 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017317799999999999 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.271123+0000", 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8832999999999997e-05 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.288221+0000", 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017098153000000001 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.288319+0000", 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7472000000000005e-05 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.6226197189999993, 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:11.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:11.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:11.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:11.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.5970823440000004, 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.5859499709999998, 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.136 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:11.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:11.140 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.5188136340000007, 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:11.144 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.3659771900000006, 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:11.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:11.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14255 4.25 e64/53 4:a40bdcb2:::1000000353c.00000000:head v 64'184, mlcod=64'182)", 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:11.148 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.3047744580000007, 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027058845000000002, 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767879+0000", 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1429999999999999e-06 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778477+0000", 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010597304 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778504+0000", 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7480000000000001e-05 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778518+0000", 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3337e-05 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778664+0000", 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014686199999999999 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778725+0000", 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0881999999999997e-05 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.794608+0000", 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015882759999999999 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.794937+0000", 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032907699999999999 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.8014939059999993, 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:11.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7486405000000005, 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14666 4.2b e64/53 4:d4915728:::10000003524.00000000:head v 64'182, mlcod=64'180)", 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7409729810000005, 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026848388000000001, 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:11.161 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331681+0000", 2024-04-18T21:07:11.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-06 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340742+0000", 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090612009999999996 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340763+0000", 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0377000000000002e-05 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340775+0000", 2024-04-18T21:07:11.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2053e-05 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340911+0000", 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000136556 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340962+0000", 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1269e-05 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:11.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.358469+0000", 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017506121999999999 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.358528+0000", 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9623999999999997e-05 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:11.165 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:11.165 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:07:11.165 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:11.166 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-18T21:07:11.166 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.289012 2024-04-18T21:07:11.166 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.2890124128082715 2024-04-18T21:07:11.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:11.169 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:11.167+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:11.268 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:11.265+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:11.301 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:11.301 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:11.301 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:07:11.301 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:11.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:11.369 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:11.367+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:11.431 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:11.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:11.432 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:11.432 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:11.432 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:11.446 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:11.470 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:11.469+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:11.515 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.981401829999999, 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.572 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.968537609999998, 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.96773614, 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.966962434999999, 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.959716871000001, 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.956650210999999, 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.938805506000001, 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.937966465999999, 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.933612786000001, 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:11.570+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.932844473999999, 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.929494869999999, 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.916018893, 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.914365389, 2024-04-18T21:07:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.911234619999998, 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.883921909000001, 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.882549482999998, 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:11.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:11.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.699342703999999, 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.166682154, 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.161996904, 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:11.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:11.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:11.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:11.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.161309243, 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:11.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:11.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:11.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:11.698 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:11.698 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:11.699 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:11.699 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:11.701 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:11.699+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:11.800 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:11.797+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:11.868 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:11.868 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.2 primary-affinity to 0.289012 (8189402) 2024-04-18T21:07:11.890 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:11.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:07:11.934 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:11.935+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:12.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:11.998+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:12.016 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:12.016 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:12.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:12.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:12.102+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:12.195 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:12.195 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:12.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:12.202+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:12.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:12.304 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:12.307+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:12.351 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:12.405 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:12.405+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:12.478 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:12.479 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:12.493 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:12.506 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:12.503+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:12.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:12.606+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:12.663 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:12.663 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:12.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:12.708 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:12.705+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:12.809 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:12.811+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:12.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:12.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:12.906+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:12.911 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:07:12.964 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:12.964 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:12.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:13.011 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:13.009+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:13.112 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:13.111+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:13.196 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:13.196 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:13.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:13.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:13.210+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:13.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:13.310+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:13.330 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:13.330 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:13.344 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:13.414 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:13.413+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:13.469 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:13.469 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:13.483 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:13.516 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:13.517+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:13.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:13.614+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:13.621 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:13.714 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:13.718 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:13.715+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:13.764 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:13.765 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:13.782 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:13.819 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:13.818+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:13.884 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:13.884 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:13.908 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:13.908 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:13.919 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:13.917+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:13.930 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:13.930 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:13.940 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:13.941 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:13.957 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:14.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:14.018+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 125.524716117, 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026676476000000001, 2024-04-18T21:07:14.122 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596919+0000", 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596921+0000", 2024-04-18T21:07:14.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596975+0000", 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4579e-05 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.596995+0000", 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9159000000000001e-05 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597004+0000", 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-04-18T21:07:14.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605206+0000", 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082022139999999993 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.605538+0000", 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000331973 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.606131+0000", 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059308400000000002 2024-04-18T21:07:14.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618400+0000", 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01226907 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623400+0000", 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050002429999999997 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623517+0000", 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011663999999999999 2024-04-18T21:07:14.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623596+0000", 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8918000000000006e-05 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 125.524612913, 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026910044000000001, 2024-04-18T21:07:14.127 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597023+0000", 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597024+0000", 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.294e-06 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597032+0000", 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6359999999999994e-06 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597076+0000", 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4332999999999997e-05 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597091+0000", 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5132e-05 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608522+0000", 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0114311 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.608728+0000", 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020544199999999999 2024-04-18T21:07:14.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.609709+0000", 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098111399999999994 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618463+0000", 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087546929999999992 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623721+0000", 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052574900000000001 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623845+0000", 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123886 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.623933+0000", 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7923999999999994e-05 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 125.524523141, 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027009581000000001, 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597112+0000", 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597114+0000", 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3659999999999999e-06 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597123+0000", 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9069999999999996e-06 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597140+0000", 2024-04-18T21:07:14.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7365999999999999e-05 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597154+0000", 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611258+0000", 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014104525 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611463+0000", 2024-04-18T21:07:14.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000204549 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.611636+0000", 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017363 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618490+0000", 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006854031 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624012+0000", 2024-04-18T21:07:14.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055214859999999999 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624071+0000", 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8999000000000002e-05 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624122+0000", 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1196000000000002e-05 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 125.524437103, 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.138 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:14.143 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 125.52437301800001, 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:14.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:14.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 125.52428741999999, 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.684445967999999, 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.154 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:14.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:14.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.179466237, 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:14.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13512 4.31 e64/53 4:8ffe1591:::10000003389.00000000:head v 64'187, mlcod=63'185)", 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.172065958999999, 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027252348999999999, 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.164 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.949570+0000", 2024-04-18T21:07:14.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3499999999999995e-07 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959363+0000", 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00979236 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959391+0000", 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7928000000000001e-05 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959408+0000", 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6957e-05 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959644+0000", 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000235978 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.959702+0000", 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8520000000000002e-05 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.976746+0000", 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017043543000000001 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.976822+0000", 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6328000000000005e-05 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:14.168 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.167705349, 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:14.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13787 4.16 e64/16 4:6919f8ec:::10000003105.00000000:head v 64'186, mlcod=62'184)", 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.8603267, 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027010007999999999, 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261309+0000", 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.261310+0000", 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4670000000000001e-06 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270854+0000", 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095437979999999992 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270881+0000", 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6359999999999998e-05 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.270891+0000", 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0747000000000001e-05 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.271064+0000", 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017317799999999999 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.271123+0000", 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8832999999999997e-05 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.288221+0000", 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017098153000000001 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.288319+0000", 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7472000000000005e-05 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.671602524000001, 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:14.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.646065149, 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:14.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:14.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:14.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:14.184 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.634932775999999, 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:14.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:14.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:14.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:14.188 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.567796439, 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.414959995, 2024-04-18T21:07:14.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14255 4.25 e64/53 4:a40bdcb2:::1000000353c.00000000:head v 64'184, mlcod=64'182)", 2024-04-18T21:07:14.196 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.353757263, 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027058845000000002, 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767878+0000", 2024-04-18T21:07:14.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.767879+0000", 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1429999999999999e-06 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778477+0000", 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010597304 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778504+0000", 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7480000000000001e-05 2024-04-18T21:07:14.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778518+0000", 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3337e-05 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778664+0000", 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014686199999999999 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.778725+0000", 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0881999999999997e-05 2024-04-18T21:07:14.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.794608+0000", 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015882759999999999 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.794937+0000", 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032907699999999999 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.850476711000001, 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:14.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:14.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.204 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.797623305, 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:14.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14666 4.2b e64/53 4:d4915728:::10000003524.00000000:head v 64'182, mlcod=64'180)", 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.789955786, 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026848388000000001, 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331680+0000", 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331681+0000", 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-06 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340742+0000", 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090612009999999996 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340763+0000", 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0377000000000002e-05 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340775+0000", 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2053e-05 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340911+0000", 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000136556 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.340962+0000", 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1269e-05 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.358469+0000", 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017506121999999999 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.358528+0000", 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9623999999999997e-05 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.212 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:14.213 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:14.213 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:14.213 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:14.121+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:14.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:14.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:14.262+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:14.323 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:14.323+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:14.347 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:14.347 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:14.347 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:07:14.347 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:14.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:14.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:14.454+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:14.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:14.522+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:14.533 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:14.533 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:14.533 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:14.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:14.626 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:14.625+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:14.722 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.128056247000004, 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:14.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.115192026999999, 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.114390557, 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:14.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:14.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:14.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:14.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.113616852, 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.741 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:14.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:14.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:14.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:14.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.106371287999998, 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:14.747 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.103304627999997, 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:14.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:14.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.759 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.085459923000002, 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:14.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:14.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:14.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:14.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:14.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:14.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.084620882999999, 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:14.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.080267202999998, 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:14.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:14.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:14.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.079498891, 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:14.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:14.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.076149287, 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:14.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.062673310000001, 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:14.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:14.796 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.061019805999997, 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:14.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:14.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:14.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.057889037000002, 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:14.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:14.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:14.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:14.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:14.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.030576326000002, 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:14.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029203899999999, 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:14.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:14.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:14.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:14.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.845997121, 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:14.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:14.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:14.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.313336571000001, 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.308651320999999, 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.833 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:14.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:14.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.307963659999999, 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:14.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:14.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:14.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:14.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:14.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:14.845 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:14.843+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:14.935 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:07:14.945 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:14.943+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:15.003 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:15.003 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:15.003 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:07:15.003 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:15.018 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:15.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:15.046+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:15.147 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:15.147+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:15.185 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:15.185 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:15.199 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:15.248 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:15.245+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:15.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:15.350+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.766921083, 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.377 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:15.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:15.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:15.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:15.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:15.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.763411826999999, 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.383 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:15.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:15.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.750218625000002, 2024-04-18T21:07:15.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.733031421, 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.729617306999998, 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.728763792000002, 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:15.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:15.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.726227109999996, 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:15.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:15.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.711494893999998, 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.419 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:15.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:15.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:15.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.709035063000002, 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:15.425 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:15.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:15.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.703116037000001, 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:15.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.696387143000003, 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.437 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:15.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.641705094000002, 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:15.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:15.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.612118641000002, 2024-04-18T21:07:15.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.600934512000002, 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.600640321, 2024-04-18T21:07:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.597999793, 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.589718198, 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:15.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.402800872, 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.401813103999999, 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.481 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.39750866, 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:15.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:15.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:15.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:15.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:15.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:15.491 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:15.492 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:15.493 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:15.489+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:15.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:15.590+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:15.627 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:15.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:15.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.627 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11947 3.14 3:2e600548:::200.0000001a:head [write 2457425~12952 [fadvise_dontneed] in=12952b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:15.627 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:15.628943+0000", 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0011675780000000001, 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012163880000000001, 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.628943+0000", 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.628943+0000", 2024-04-18T21:07:15.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.628944+0000", 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.051e-06 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.628958+0000", 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4029000000000001e-05 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.628973+0000", 2024-04-18T21:07:15.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5443000000000001e-05 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.628982+0000", 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5560000000000008e-06 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.629131+0000", 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014947100000000001 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.629372+0000", 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024016799999999999 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:15.629711+0000", 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033904999999999997 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-04-18T21:07:15.631 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:15.642 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:15.694 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:15.695+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:15.768 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:15.769 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:15.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:15.795 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:15.795+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:15.895 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:15.895+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:15.923 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:15.946 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 127.34945161100001, 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:15.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:15.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:15.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:15.951 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 127.349387526, 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.956 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 127.349301928, 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:15.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:15.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.509460476000001, 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.004480745, 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.992719857000001, 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:15.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.496617032, 2024-04-18T21:07:15.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:15.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:15.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.471079657000001, 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:15.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:15.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.459947284, 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:15.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:15.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.392810946999999, 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:15.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:15.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.991 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.239974502999999, 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.675491219, 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:15.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.622637813000001, 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:16.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:16.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:16.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11068 4.2c e69/53 4:357a8b3d:::10000001074.00000000:head v 69'304, mlcod=69'302)", 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.12523459, 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028186011, 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:16.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821417+0000", 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.198e-06 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821427+0000", 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0155e-05 2024-04-18T21:07:16.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821443+0000", 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6124e-05 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821457+0000", 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4377e-05 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821604+0000", 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014668099999999999 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821639+0000", 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4907999999999998e-05 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849548+0000", 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027908911000000002 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849602+0000", 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3656999999999998e-05 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11073 4.3c e69/53 4:3cac0111:::10000001079.00000000:head v 69'282, mlcod=69'277)", 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1240318659999999, 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028365973999999999, 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822619+0000", 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.127e-06 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822630+0000", 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0560000000000001e-05 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822650+0000", 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9924000000000001e-05 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822663+0000", 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3360000000000001e-05 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848504+0000", 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025840785000000002 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848552+0000", 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8109000000000003e-05 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850936+0000", 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023839260000000002 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850984+0000", 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8183000000000003e-05 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11074 4.17 e69/16 4:eb7482bf:::1000000107a.00000000:head v 69'290, mlcod=69'288)", 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.123952509, 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028062648999999999, 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822706+0000", 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2740000000000002e-06 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822723+0000", 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7297999999999999e-05 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822733+0000", 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848998+0000", 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026265101999999999 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849034+0000", 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6208000000000003e-05 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850704+0000", 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00167005 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850760+0000", 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6314999999999999e-05 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11094 3.14 3:2e600548:::200.0000001a:head [write 887300~13362 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.122387891, 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027388409999999998, 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824264+0000", 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6530000000000001e-06 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824299+0000", 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4866999999999997e-05 2024-04-18T21:07:16.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824317+0000", 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8502e-05 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824327+0000", 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0002e-05 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824409+0000", 2024-04-18T21:07:16.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1372999999999995e-05 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824559+0000", 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015085899999999999 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824739+0000", 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946800000000001 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849612+0000", 2024-04-18T21:07:16.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024873540999999999 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851509+0000", 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001896911 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851593+0000", 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4071000000000002e-05 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851651+0000", 2024-04-18T21:07:16.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7163000000000001e-05 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11082 4.1e e69/16 4:7b9c1f9d:::10000001082.00000000:head v 69'274, mlcod=69'272)", 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1220216940000001, 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027966749999999999, 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824629+0000", 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8800000000000003e-07 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824634+0000", 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.541e-06 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824646+0000", 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1596999999999999e-05 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824658+0000", 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2186e-05 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849556+0000", 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024897433 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849583+0000", 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7302999999999999e-05 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852550+0000", 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029666750000000002 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852595+0000", 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5527e-05 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11091 4.1e e69/16 4:78ff2234:::1000000108b.00000000:head v 69'275, mlcod=69'272)", 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.121662122, 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027645717, 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.025 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824990+0000", 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2840000000000001e-06 2024-04-18T21:07:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825001+0000", 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0733999999999999e-05 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825015+0000", 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3551e-05 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825028+0000", 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2976000000000001e-05 2024-04-18T21:07:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849960+0000", 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024932826000000002 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849981+0000", 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1056999999999998e-05 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852598+0000", 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026168189999999998 2024-04-18T21:07:16.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852634+0000", 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5469999999999998e-05 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11093 4.16 e69/16 4:6b341212:::1000000108d.00000000:head v 69'298, mlcod=69'296)", 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.121366565, 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027628203, 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:16.029 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:16.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825285+0000", 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.88e-06 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825294+0000", 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825306+0000", 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1504e-05 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825315+0000", 2024-04-18T21:07:16.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7799999999999995e-06 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850301+0000", 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024985411999999999 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850322+0000", 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1297e-05 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852862+0000", 2024-04-18T21:07:16.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002539758 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852912+0000", 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9908999999999999e-05 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:16.033 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:16.033 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:16.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:16.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:16.034+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:16.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:16.134+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13276 3.19 3:9d0ed013:::200.0000001b:head [write 76281~36503 [fadvise_dontneed] in=36503b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:07:16.159219+0000", 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001261236, 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013097810000000001, 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159219+0000", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159219+0000", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159221+0000", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.08e-06 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159294+0000", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2404000000000007e-05 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159323+0000", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9312e-05 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159337+0000", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4219999999999999e-05 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159443+0000", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106086 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159565+0000", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012165199999999999 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:07:16.159744+0000", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017880700000000001 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:16.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:16.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:16.222 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:16.236 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:16.239+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:16.240 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:16.263 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:16.337 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:16.339+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:16.339 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:16.339 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:16.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:16.438 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:16.437+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:16.473 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:16.473 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:16.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:16.539 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:16.537+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:16.623 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:16.624 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:16.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:16.640 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:16.638+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:16.741 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:16.739+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:16.776 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:16.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:16.838+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:16.907 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:07:16.907 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:16.907 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-18T21:07:16.908 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-18T21:07:16.943 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:16.941+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:16.963 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:16.963 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:16.977 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:17.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:17.042+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:17.063 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:17.126 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:17.173 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:17.173+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:17.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-18T21:07:17.245 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:17.245 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:17.245 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:17.247+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:17.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:17.346 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:17.345+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:17.428 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:17.428 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:17.444 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:17.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:17.442+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:17.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:17.546+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:17.584 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:17.584 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:17.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:17.649 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:17.645+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:17.749 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:17.751+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:17.775 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:17.775 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:17.798 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:17.850 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:17.849+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:17.934 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:17.934 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:17.948 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:17.951 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:17.951+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:18.038 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:18.051 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:18.049+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:18.076 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.076 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:18.152 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:18.151+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:18.214 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.214 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.228 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:18.270 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:18.271+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:18.280 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:18.353 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:18.351+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:18.392 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.392 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:18.417 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:18.417 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:18.438 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:18.454 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:18.453+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:18.458 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:18.543 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:18.543 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:18.543 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:18.543 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:18.555 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:18.555+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:18.557 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:18.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:18.654+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:18.736 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:18.736 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:18.736 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:18.736 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:18.736 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:18.752 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:18.756 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:18.754+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:18.857 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:18.855+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:18.907 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 130.31087005000001, 2024-04-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:18.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:18.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:18.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:18.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:18.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:18.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:18.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:18.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:18.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:18.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:18.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:18.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:18.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:18.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:18.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:18.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:18.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:18.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:18.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:18.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:18.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:18.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.919 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.919 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:18.919 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:18.920 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 130.31080596499999, 2024-04-18T21:07:18.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:18.920 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.920 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.920 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.920 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:18.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:18.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:18.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:18.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:18.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:18.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:18.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:18.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:18.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:18.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:18.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:18.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:18.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:18.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:18.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:18.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:18.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:18.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:18.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:18.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:18.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 130.31072036699999, 2024-04-18T21:07:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.932 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.932 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.932 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:18.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:18.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:18.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:18.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:18.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:18.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:18.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:18.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:18.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:18.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:18.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:18.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:18.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:18.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:18.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:18.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:18.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:18.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:18.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.945 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.946 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:18.946 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:18.946 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.470878915, 2024-04-18T21:07:18.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:18.947 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.947 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.947 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.947 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:18.948 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:18.948 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:18.948 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:18.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.948 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:18.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:18.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:18.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:18.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:18.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:18.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:18.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:18.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:18.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:18.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:18.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:18.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:18.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:18.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:18.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:18.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:18.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:18.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:18.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:18.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:18.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:18.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:18.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:18.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:18.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:18.960 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.965899184000001, 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:18.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:18.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:18.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.954138296, 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:18.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.458035470999999, 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:18.969 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:18.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:18.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:18.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.432498096, 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:18.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:18.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.978 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.421365723000001, 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:18.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:18.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:18.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.354229386, 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:18.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.201392941999998, 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.987 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.636909658, 2024-04-18T21:07:18.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:18.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.584056252, 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:18.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:18.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:18.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11068 4.2c e69/53 4:357a8b3d:::10000001074.00000000:head v 69'304, mlcod=69'302)", 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0866530289999998, 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028186011, 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821417+0000", 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.198e-06 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821427+0000", 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0155e-05 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821443+0000", 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6124e-05 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821457+0000", 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4377e-05 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821604+0000", 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014668099999999999 2024-04-18T21:07:19.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821639+0000", 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4907999999999998e-05 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849548+0000", 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027908911000000002 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849602+0000", 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3656999999999998e-05 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.003 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11073 4.3c e69/53 4:3cac0111:::10000001079.00000000:head v 69'282, mlcod=69'277)", 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0854503050000002, 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028365973999999999, 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:19.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822619+0000", 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.127e-06 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822630+0000", 2024-04-18T21:07:19.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0560000000000001e-05 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822650+0000", 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9924000000000001e-05 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822663+0000", 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3360000000000001e-05 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:19.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848504+0000", 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025840785000000002 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848552+0000", 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8109000000000003e-05 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850936+0000", 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023839260000000002 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:19.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850984+0000", 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8183000000000003e-05 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11074 4.17 e69/16 4:eb7482bf:::1000000107a.00000000:head v 69'290, mlcod=69'288)", 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0853709479999996, 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028062648999999999, 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:19.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822706+0000", 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2740000000000002e-06 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822723+0000", 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7297999999999999e-05 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822733+0000", 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848998+0000", 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026265101999999999 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849034+0000", 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6208000000000003e-05 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850704+0000", 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00167005 2024-04-18T21:07:19.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850760+0000", 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6314999999999999e-05 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11094 3.14 3:2e600548:::200.0000001a:head [write 887300~13362 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0838063299999998, 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027388409999999998, 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:19.012 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:19.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824264+0000", 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6530000000000001e-06 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824299+0000", 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4866999999999997e-05 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824317+0000", 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8502e-05 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824327+0000", 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0002e-05 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824409+0000", 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1372999999999995e-05 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824559+0000", 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015085899999999999 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:19.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824739+0000", 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946800000000001 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849612+0000", 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024873540999999999 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851509+0000", 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001896911 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:19.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851593+0000", 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4071000000000002e-05 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851651+0000", 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7163000000000001e-05 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11082 4.1e e69/16 4:7b9c1f9d:::10000001082.00000000:head v 69'274, mlcod=69'272)", 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0834401329999999, 2024-04-18T21:07:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027966749999999999, 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824629+0000", 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8800000000000003e-07 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824634+0000", 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.541e-06 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824646+0000", 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1596999999999999e-05 2024-04-18T21:07:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824658+0000", 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2186e-05 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849556+0000", 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024897433 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849583+0000", 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7302999999999999e-05 2024-04-18T21:07:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852550+0000", 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029666750000000002 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852595+0000", 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5527e-05 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.021 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11091 4.1e e69/16 4:78ff2234:::1000000108b.00000000:head v 69'275, mlcod=69'272)", 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0830805610000001, 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027645717, 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:19.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824990+0000", 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2840000000000001e-06 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825001+0000", 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0733999999999999e-05 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825015+0000", 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3551e-05 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825028+0000", 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2976000000000001e-05 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849960+0000", 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024932826000000002 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849981+0000", 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1056999999999998e-05 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852598+0000", 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026168189999999998 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852634+0000", 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5469999999999998e-05 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11093 4.16 e69/16 4:6b341212:::1000000108d.00000000:head v 69'298, mlcod=69'296)", 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0827850039999998, 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027628203, 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:19.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825285+0000", 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.88e-06 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825294+0000", 2024-04-18T21:07:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825306+0000", 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1504e-05 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825315+0000", 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7799999999999995e-06 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850301+0000", 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024985411999999999 2024-04-18T21:07:19.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850322+0000", 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1297e-05 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852862+0000", 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002539758 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852912+0000", 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9908999999999999e-05 2024-04-18T21:07:19.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.030 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:19.030 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:19.030 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:07:19.032 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:19.032 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:19.031+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:19.132 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:19.135+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:19.161 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:07:19.161 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:19.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:19.233 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:19.235+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:19.307 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:19.307 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:19.307 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:19.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:19.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:19.366+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:19.435 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:19.435+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:19.446 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:19.446 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:19.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:19.446 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.853056985999999, 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:19.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:19.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.840192766000001, 2024-04-18T21:07:19.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:19.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:19.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.839391296000002, 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.838617591000002, 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:19.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:19.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:19.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:19.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:19.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.831372027, 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.474 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.828305366999999, 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.810460661999997, 2024-04-18T21:07:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:19.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:19.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:19.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:19.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.492 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.809621622000002, 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.805267942, 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:19.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:19.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:19.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:19.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.804499630000002, 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.801150026000002, 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:19.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:19.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:19.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.787674049000003, 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:19.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.786020545, 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.782889775999998, 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:19.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:19.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:19.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:19.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:19.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:19.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.755577064999997, 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:19.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.754204639000001, 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.570997859999999, 2024-04-18T21:07:19.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:19.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.554 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.038337309999999, 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.560 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.033652060000001, 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:19.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:19.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:19.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.032964399000001, 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:19.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.571 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:19.572 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:19.572 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:19.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:19.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:19.570+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:19.674 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:19.674+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:19.703 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:07:19.703 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:19.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:19.774 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:19.775+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:19.866 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:19.867 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:19.875 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:19.873+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:19.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:19.976 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:19.973+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.450628657999999, 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.447119401999998, 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.433926200000002, 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.416738995999999, 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.413324881999998, 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.412471367000002, 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.409934685000003, 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.395202468999997, 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.392742638000001, 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.386823612000001, 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.380094718000002, 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.325412669000002, 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.295826216000002, 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.284642087000002, 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.284347896, 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.281707367999999, 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.273425773, 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.086508447, 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.085520678999998, 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.081216234999999, 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:20.182 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:20.183 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:20.183+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:20.183 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:20.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:20.282+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:20.315 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:20.315 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:20.315 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:20.315 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:20.330 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:20.385 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:20.383+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:20.452 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:20.452 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:20.452 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:20.452 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:20.452 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:20.466 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:20.474 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:20.486 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:20.487+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 131.989475134, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 131.98941104900001, 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 131.98932545100001, 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 42.149483998999997, 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.644504267999999, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.632743380000001, 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.136640555, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.111103180000001, 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.099970806999998, 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.032834470000001, 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.879998025999999, 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.315514742000001, 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:20.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:20.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:20.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.262661336000001, 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:20.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11068 4.2c e69/53 4:357a8b3d:::10000001074.00000000:head v 69'304, mlcod=69'302)", 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7652581129999998, 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028186011, 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.647 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821417+0000", 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.198e-06 2024-04-18T21:07:20.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821427+0000", 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0155e-05 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821443+0000", 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6124e-05 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821457+0000", 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4377e-05 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821604+0000", 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014668099999999999 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821639+0000", 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4907999999999998e-05 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849548+0000", 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027908911000000002 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849602+0000", 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3656999999999998e-05 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11073 4.3c e69/53 4:3cac0111:::10000001079.00000000:head v 69'282, mlcod=69'277)", 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7640553890000001, 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028365973999999999, 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.651 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822619+0000", 2024-04-18T21:07:20.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.127e-06 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822630+0000", 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0560000000000001e-05 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822650+0000", 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9924000000000001e-05 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822663+0000", 2024-04-18T21:07:20.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3360000000000001e-05 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848504+0000", 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025840785000000002 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848552+0000", 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8109000000000003e-05 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850936+0000", 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023839260000000002 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850984+0000", 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8183000000000003e-05 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11074 4.17 e69/16 4:eb7482bf:::1000000107a.00000000:head v 69'290, mlcod=69'288)", 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:20.655 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7639760320000004, 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028062648999999999, 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:20.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822706+0000", 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2740000000000002e-06 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822723+0000", 2024-04-18T21:07:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7297999999999999e-05 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822733+0000", 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848998+0000", 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026265101999999999 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849034+0000", 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6208000000000003e-05 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850704+0000", 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00167005 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850760+0000", 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6314999999999999e-05 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11094 3.14 3:2e600548:::200.0000001a:head [write 887300~13362 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7624114139999998, 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027388409999999998, 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824264+0000", 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6530000000000001e-06 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824299+0000", 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4866999999999997e-05 2024-04-18T21:07:20.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824317+0000", 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8502e-05 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824327+0000", 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0002e-05 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824409+0000", 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1372999999999995e-05 2024-04-18T21:07:20.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824559+0000", 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015085899999999999 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824739+0000", 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946800000000001 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849612+0000", 2024-04-18T21:07:20.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024873540999999999 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851509+0000", 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001896911 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851593+0000", 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4071000000000002e-05 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851651+0000", 2024-04-18T21:07:20.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7163000000000001e-05 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11082 4.1e e69/16 4:7b9c1f9d:::10000001082.00000000:head v 69'274, mlcod=69'272)", 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7620452169999998, 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027966749999999999, 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824629+0000", 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8800000000000003e-07 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824634+0000", 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.541e-06 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824646+0000", 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1596999999999999e-05 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824658+0000", 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2186e-05 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849556+0000", 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024897433 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849583+0000", 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7302999999999999e-05 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852550+0000", 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029666750000000002 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852595+0000", 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5527e-05 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11091 4.1e e69/16 4:78ff2234:::1000000108b.00000000:head v 69'275, mlcod=69'272)", 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.761685645, 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027645717, 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.669 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824990+0000", 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2840000000000001e-06 2024-04-18T21:07:20.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825001+0000", 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0733999999999999e-05 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825015+0000", 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3551e-05 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825028+0000", 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2976000000000001e-05 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849960+0000", 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024932826000000002 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849981+0000", 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1056999999999998e-05 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852598+0000", 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026168189999999998 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852634+0000", 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5469999999999998e-05 2024-04-18T21:07:20.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11093 4.16 e69/16 4:6b341212:::1000000108d.00000000:head v 69'298, mlcod=69'296)", 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7613900879999997, 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027628203, 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:20.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825285+0000", 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.88e-06 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825294+0000", 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:07:20.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825306+0000", 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1504e-05 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825315+0000", 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7799999999999995e-06 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850301+0000", 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024985411999999999 2024-04-18T21:07:20.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850322+0000", 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1297e-05 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852862+0000", 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002539758 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852912+0000", 2024-04-18T21:07:20.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9908999999999999e-05 2024-04-18T21:07:20.679 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.679 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.679 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.679 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:20.679 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:20.679 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:20.679 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:20.585+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:20.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:20.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:20.681 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:20.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:20.682 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:20.682 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:20.683 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:20.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:20.730+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:20.789 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:20.787+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:20.837 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:20.837 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:20.849 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-18T21:07:20.849 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-18T21:07:20.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:20.889 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:20.887+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:20.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:20.990+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:21.015 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:21.016 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:21.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:21.033 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:07:21.091 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:21.091+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:21.145 DEBUG:teuthology.parallel:result is None 2024-04-18T21:07:21.145 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T21:07:21.163 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T21:07:21.163 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-18T21:07:21.171 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-18T21:07:21.171 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:07:21.171 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T21:07:21.192 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:21.195+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:21.207 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:21.209 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:07:21.209 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T21:07:21.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:07:21.294 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:21.293+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:21.339 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:21.339 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:21.353 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:21.395 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:21.397+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:21.474 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:21.475 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:21.488 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:21.534 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:21.535+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:21.576 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:07:21.577 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":71,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:07:18.923484+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"error_message":"pool 1 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":0.0126190185546875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":0.28900146484375,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:07:21.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}] 2024-04-18T21:07:21.594 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:07:21.596 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:21.593+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:21.604 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:21.604 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:21.619 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:21.697 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:21.697+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:21.766 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:21.798 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:21.799+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:21.888 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T21:07:21.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:21.898+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:21.907 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:07:21.939 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:07:21.958 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:21.958 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:21.972 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:22.017 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:22.017+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:22.088 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.089 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.101 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:22.103+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:22.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:22.202 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:22.201+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:22.204 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-18T21:07:22.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:07:22.235 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.235 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.249 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:22.303 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:22.303+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:07:22.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:22.380 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-18T21:07:22.380 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:07:22.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:22.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:22.426+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:22.499 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.499 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:22.502+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:22.508 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T21:07:22.513 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:22.525 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:07:22.604 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:22.603+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:22.643 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.643 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 72, 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "ce5e2bf2-36af-4d40-a378-74a7158189ef", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T21:04:46.921896+0000", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T21:07:21.933860+0000", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-18T21:04:55.489869+0000", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-18T21:04:47.830213+0000", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5799936, 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-18T21:07:22.661 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 4, 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "luminous", 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "squid", 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-18T21:07:22.662 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:04:55.643422+0000", 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:22.663 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.664 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "11", 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:22.665 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:22.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.667 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "error_message": "pool 1 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 0, 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 0 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:02.119174+0000", 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:22.668 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:22.669 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:22.670 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:22.671 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:22.672 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "error_message": "pool 2 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 0, 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 0 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.266829+0000", 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:22.673 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:22.674 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:22.675 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:22.676 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:22.677 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "error_message": "pool 3 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 0, 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 0 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-18T21:05:06.888450+0000", 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:07:22.679 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.680 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "18", 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-18T21:07:22.681 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:07:22.682 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-18T21:07:22.683 INFO:teuthology.orchestra.run.smithi096.stdout: "error_message": "pool 4 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 0, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 0 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "e255a90f-ab37-44af-9793-7ea323c63959", 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 0.0126190185546875, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:07:22.684 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 68, 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6800", 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6801", 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.685 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6802", 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6803", 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6806", 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6807", 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.687 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6804", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.111:6805", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1095770023 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.111:6801/1095770023", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.111:6803/1095770023", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.111:6807/1095770023", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.111:6805/1095770023", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:07:22.688 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2d189848-7fef-4eed-a1e7-524937587a71", 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 68, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:07:22.689 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.692 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2586340961 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/2586340961", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/2586340961", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2586340961", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2586340961", 2024-04-18T21:07:22.693 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "2de50865-b6ec-4639-a544-dd366b440c50", 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 0.28900146484375, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-18T21:07:22.694 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 8, 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 53, 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6800", 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.695 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6801", 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6802", 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6803", 2024-04-18T21:07:22.696 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6806", 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6807", 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.697 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6804", 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.194:6805", 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2001406304 2024-04-18T21:07:22.698 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.194:6801/2001406304", 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.194:6803/2001406304", 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2001406304", 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2001406304", 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.699 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.192780+0000", 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:07:22.700 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.132213+0000", 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540701547738038271, 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:53.152319+0000", 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.701 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [ 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "pgid": "4.3", 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-18T21:07:22.702 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-18T21:07:22.703 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T21:07:22.704 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:07:22.704 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:22.707 INFO:tasks.thrashosds.thrasher:j is {'epoch': 72, 'fsid': 'ce5e2bf2-36af-4d40-a378-74a7158189ef', 'created': '2024-04-18T21:04:46.921896+0000', 'modified': '2024-04-18T21:07:21.933860+0000', 'last_up_change': '2024-04-18T21:04:55.489869+0000', 'last_in_change': '2024-04-18T21:04:47.830213+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'e255a90f-ab37-44af-9793-7ea323c63959', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.0126190185546875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 68, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 1095770023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 1095770023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 1095770023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 1095770023}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 1095770023}]}, 'public_addr': '172.21.15.111:6801/1095770023', 'cluster_addr': '172.21.15.111:6803/1095770023', 'heartbeat_back_addr': '172.21.15.111:6807/1095770023', 'heartbeat_front_addr': '172.21.15.111:6805/1095770023', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2d189848-7fef-4eed-a1e7-524937587a71', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 68, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2586340961}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2586340961}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2586340961}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2586340961}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2586340961}]}, 'public_addr': '172.21.15.134:6801/2586340961', 'cluster_addr': '172.21.15.134:6803/2586340961', 'heartbeat_back_addr': '172.21.15.134:6807/2586340961', 'heartbeat_front_addr': '172.21.15.134:6805/2586340961', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '2de50865-b6ec-4639-a544-dd366b440c50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.28900146484375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 53, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2001406304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2001406304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2001406304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2001406304}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2001406304}]}, 'public_addr': '172.21.15.194:6801/2001406304', 'cluster_addr': '172.21.15.194:6803/2001406304', 'heartbeat_back_addr': '172.21.15.194:6807/2001406304', 'heartbeat_front_addr': '172.21.15.194:6805/2001406304', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.192780+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.132213+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:53.152319+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.3', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:07:22.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:07:22.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:22.706+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:22.800 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T21:07:22.807 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:22.805+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:22.828 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T21:07:22.837 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.838 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.858 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:22.903 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:22.903 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:22.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:22.906+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:22.920 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:22.921 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:22.941 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:22.998 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.390540039000001, 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:22.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:23.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:23.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.387030783, 2024-04-18T21:07:23.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:23.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:23.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:23.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:23.011 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.373837580999997, 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:23.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.356650377000001, 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.017 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:23.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.353236262999999, 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:23.023 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:23.029 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.352382747999997, 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:23.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.349846065999998, 2024-04-18T21:07:23.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:23.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.335113849999999, 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.332654019000003, 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.048 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.326734993000002, 2024-04-18T21:07:23.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:23.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:23.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.320006098999997, 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:23.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:23.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.265324049999997, 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:23.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:23.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.072 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.235737597000004, 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.073 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.224553468000003, 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:23.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:23.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:23.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.224259277000002, 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:23.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:23.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.221618749000001, 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.213337154000001, 2024-04-18T21:07:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.026419828000002, 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.02543206, 2024-04-18T21:07:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.021127616000001, 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:23.117 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:23.121 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:23.121 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:07:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:07:23.123 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-04-18T21:07:21.944032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":141305659,"num_objects":1973,"num_object_clones":0,"num_object_copies":3946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1973,"num_whiteouts":0,"num_read":2935,"num_read_kb":1423304,"num_write":27221,"num_write_kb":4219222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30143,"ondisk_log_size":30143,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":307300,"kb_used_data":115340,"kb_used_omap":4,"kb_used_meta":191931,"kb_avail":282808220,"statfs":{"total":289910292480,"available":289595617280,"internally_reserved":0,"allocated":118108160,"data_stored":283636731,"data_compressed":43056277,"data_compressed_allocated":55300096,"data_compressed_original":232448000,"omap_allocated":4785,"internal_metadata":196537679},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10831598,"num_objects":-8551,"num_object_clones":0,"num_object_copies":-17102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8551,"num_whiteouts":0,"num_read":24,"num_read_kb":947,"num_write":9688,"num_write_kb":37735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.308336"},"pg_stats":[{"pgid":"4.3f","version":"71'357","reported_seq":537,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.877249+0000","last_change":"2024-04-18T21:07:12.929609+0000","last_active":"2024-04-18T21:07:19.877249+0000","last_peered":"2024-04-18T21:07:19.877249+0000","last_clean":"2024-04-18T21:07:19.877249+0000","last_became_active":"2024-04-18T21:07:12.927152+0000","last_became_peered":"2024-04-18T21:07:12.927152+0000","last_unstale":"2024-04-18T21:07:19.877249+0000","last_undegraded":"2024-04-18T21:07:19.877249+0000","last_fullsized":"2024-04-18T21:07:19.877249+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:26.855903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136483,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":322,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'389","reported_seq":558,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.960718+0000","last_change":"2024-04-18T21:07:12.929459+0000","last_active":"2024-04-18T21:07:19.960718+0000","last_peered":"2024-04-18T21:07:19.960718+0000","last_clean":"2024-04-18T21:07:19.960718+0000","last_became_active":"2024-04-18T21:07:12.926838+0000","last_became_peered":"2024-04-18T21:07:12.926838+0000","last_unstale":"2024-04-18T21:07:19.960718+0000","last_undegraded":"2024-04-18T21:07:19.960718+0000","last_fullsized":"2024-04-18T21:07:19.960718+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:09:04.746315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217022,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":367,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'346","reported_seq":499,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.956216+0000","last_change":"2024-04-18T21:06:42.772100+0000","last_active":"2024-04-18T21:07:19.956216+0000","last_peered":"2024-04-18T21:07:19.956216+0000","last_clean":"2024-04-18T21:07:19.956216+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:07:19.956216+0000","last_undegraded":"2024-04-18T21:07:19.956216+0000","last_fullsized":"2024-04-18T21:07:19.956216+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:42.621459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553223,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":327,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"71'341","reported_seq":488,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.937488+0000","last_change":"2024-04-18T21:06:42.773600+0000","last_active":"2024-04-18T21:07:19.937488+0000","last_peered":"2024-04-18T21:07:19.937488+0000","last_clean":"2024-04-18T21:07:19.937488+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:07:19.937488+0000","last_undegraded":"2024-04-18T21:07:19.937488+0000","last_fullsized":"2024-04-18T21:07:19.937488+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:01.631939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189325,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":312,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"71'419","reported_seq":575,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.937017+0000","last_change":"2024-04-18T21:07:12.926264+0000","last_active":"2024-04-18T21:07:19.937017+0000","last_peered":"2024-04-18T21:07:19.937017+0000","last_clean":"2024-04-18T21:07:19.937017+0000","last_became_active":"2024-04-18T21:07:12.922725+0000","last_became_peered":"2024-04-18T21:07:12.922725+0000","last_unstale":"2024-04-18T21:07:19.937017+0000","last_undegraded":"2024-04-18T21:07:19.937017+0000","last_fullsized":"2024-04-18T21:07:19.937017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:54.952040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116297,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":392,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'363","reported_seq":515,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.956961+0000","last_change":"2024-04-18T21:06:42.762884+0000","last_active":"2024-04-18T21:07:19.956961+0000","last_peered":"2024-04-18T21:07:19.956961+0000","last_clean":"2024-04-18T21:07:19.956961+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:07:19.956961+0000","last_undegraded":"2024-04-18T21:07:19.956961+0000","last_fullsized":"2024-04-18T21:07:19.956961+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:57:06.797511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156442,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":344,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"71'385","reported_seq":561,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.951957+0000","last_change":"2024-04-18T21:06:42.765508+0000","last_active":"2024-04-18T21:07:19.951957+0000","last_peered":"2024-04-18T21:07:19.951957+0000","last_clean":"2024-04-18T21:07:19.951957+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:07:19.951957+0000","last_undegraded":"2024-04-18T21:07:19.951957+0000","last_fullsized":"2024-04-18T21:07:19.951957+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:01:42.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180284,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":357,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"71'338","reported_seq":495,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.905468+0000","last_change":"2024-04-18T21:06:42.764054+0000","last_active":"2024-04-18T21:07:19.905468+0000","last_peered":"2024-04-18T21:07:19.905468+0000","last_clean":"2024-04-18T21:07:19.905468+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:07:19.905468+0000","last_undegraded":"2024-04-18T21:07:19.905468+0000","last_fullsized":"2024-04-18T21:07:19.905468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:15:50.427889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463143,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":308,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"71'405","reported_seq":581,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.955536+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:07:19.955536+0000","last_peered":"2024-04-18T21:07:19.955536+0000","last_clean":"2024-04-18T21:07:19.955536+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:07:19.955536+0000","last_undegraded":"2024-04-18T21:07:19.955536+0000","last_fullsized":"2024-04-18T21:07:19.955536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":385,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"71'373","reported_seq":530,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.923468+0000","last_change":"2024-04-18T21:07:12.924953+0000","last_active":"2024-04-18T21:07:19.923468+0000","last_peered":"2024-04-18T21:07:19.923468+0000","last_clean":"2024-04-18T21:07:19.923468+0000","last_became_active":"2024-04-18T21:07:12.922920+0000","last_became_peered":"2024-04-18T21:07:12.922920+0000","last_unstale":"2024-04-18T21:07:19.923468+0000","last_undegraded":"2024-04-18T21:07:19.923468+0000","last_fullsized":"2024-04-18T21:07:19.923468+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:13.800675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119022,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":345,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'326","reported_seq":482,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.922363+0000","last_change":"2024-04-18T21:06:42.770457+0000","last_active":"2024-04-18T21:07:19.922363+0000","last_peered":"2024-04-18T21:07:19.922363+0000","last_clean":"2024-04-18T21:07:19.922363+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:07:19.922363+0000","last_undegraded":"2024-04-18T21:07:19.922363+0000","last_fullsized":"2024-04-18T21:07:19.922363+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:10.843661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143498,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":312,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"71'312","reported_seq":489,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.930921+0000","last_change":"2024-04-18T21:05:08.606529+0000","last_active":"2024-04-18T21:07:19.930921+0000","last_peered":"2024-04-18T21:07:19.930921+0000","last_clean":"2024-04-18T21:07:19.930921+0000","last_became_active":"2024-04-18T21:05:08.605695+0000","last_became_peered":"2024-04-18T21:05:08.605695+0000","last_unstale":"2024-04-18T21:07:19.930921+0000","last_undegraded":"2024-04-18T21:07:19.930921+0000","last_fullsized":"2024-04-18T21:07:19.930921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107049,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":294,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"71'369","reported_seq":551,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.955869+0000","last_change":"2024-04-18T21:07:12.926307+0000","last_active":"2024-04-18T21:07:19.955869+0000","last_peered":"2024-04-18T21:07:19.955869+0000","last_clean":"2024-04-18T21:07:19.955869+0000","last_became_active":"2024-04-18T21:07:12.924790+0000","last_became_peered":"2024-04-18T21:07:12.924790+0000","last_unstale":"2024-04-18T21:07:19.955869+0000","last_undegraded":"2024-04-18T21:07:19.955869+0000","last_fullsized":"2024-04-18T21:07:19.955869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:48.873309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275143,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":340,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'402","reported_seq":577,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.951926+0000","last_change":"2024-04-18T21:07:12.924661+0000","last_active":"2024-04-18T21:07:19.951926+0000","last_peered":"2024-04-18T21:07:19.951926+0000","last_clean":"2024-04-18T21:07:19.951926+0000","last_became_active":"2024-04-18T21:07:12.921039+0000","last_became_peered":"2024-04-18T21:07:12.921039+0000","last_unstale":"2024-04-18T21:07:19.951926+0000","last_undegraded":"2024-04-18T21:07:19.951926+0000","last_fullsized":"2024-04-18T21:07:19.951926+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:04:04.675154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181123,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":381,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'376","reported_seq":592,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.948603+0000","last_change":"2024-04-18T21:07:12.924081+0000","last_active":"2024-04-18T21:07:19.948603+0000","last_peered":"2024-04-18T21:07:19.948603+0000","last_clean":"2024-04-18T21:07:19.948603+0000","last_became_active":"2024-04-18T21:07:12.921595+0000","last_became_peered":"2024-04-18T21:07:12.921595+0000","last_unstale":"2024-04-18T21:07:19.948603+0000","last_undegraded":"2024-04-18T21:07:19.948603+0000","last_fullsized":"2024-04-18T21:07:19.948603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:05.221224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172295,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":352,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'411","reported_seq":595,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.892811+0000","last_change":"2024-04-18T21:06:42.762039+0000","last_active":"2024-04-18T21:07:19.892811+0000","last_peered":"2024-04-18T21:07:19.892811+0000","last_clean":"2024-04-18T21:07:19.892811+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:07:19.892811+0000","last_undegraded":"2024-04-18T21:07:19.892811+0000","last_fullsized":"2024-04-18T21:07:19.892811+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:27.621896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212385,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":392,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"71'371","reported_seq":518,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.940060+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:07:19.940060+0000","last_peered":"2024-04-18T21:07:19.940060+0000","last_clean":"2024-04-18T21:07:19.940060+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:07:19.940060+0000","last_undegraded":"2024-04-18T21:07:19.940060+0000","last_fullsized":"2024-04-18T21:07:19.940060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165712,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":351,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"71'367","reported_seq":519,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.942685+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:07:19.942685+0000","last_peered":"2024-04-18T21:07:19.942685+0000","last_clean":"2024-04-18T21:07:19.942685+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:07:19.942685+0000","last_undegraded":"2024-04-18T21:07:19.942685+0000","last_fullsized":"2024-04-18T21:07:19.942685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195055,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":336,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"71'388","reported_seq":547,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.938028+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:07:19.938028+0000","last_peered":"2024-04-18T21:07:19.938028+0000","last_clean":"2024-04-18T21:07:19.938028+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:07:19.938028+0000","last_undegraded":"2024-04-18T21:07:19.938028+0000","last_fullsized":"2024-04-18T21:07:19.938028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186025,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":357,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"71'392","reported_seq":548,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.957829+0000","last_change":"2024-04-18T21:06:42.777421+0000","last_active":"2024-04-18T21:07:19.957829+0000","last_peered":"2024-04-18T21:07:19.957829+0000","last_clean":"2024-04-18T21:07:19.957829+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:07:19.957829+0000","last_undegraded":"2024-04-18T21:07:19.957829+0000","last_fullsized":"2024-04-18T21:07:19.957829+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:05.221224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189487,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":363,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"71'359","reported_seq":499,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.937738+0000","last_change":"2024-04-18T21:06:42.776871+0000","last_active":"2024-04-18T21:07:19.937738+0000","last_peered":"2024-04-18T21:07:19.937738+0000","last_clean":"2024-04-18T21:07:19.937738+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:07:19.937738+0000","last_undegraded":"2024-04-18T21:07:19.937738+0000","last_fullsized":"2024-04-18T21:07:19.937738+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:16.876164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":563976,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":344,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"71'399","reported_seq":555,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.930888+0000","last_change":"2024-04-18T21:05:08.604807+0000","last_active":"2024-04-18T21:07:19.930888+0000","last_peered":"2024-04-18T21:07:19.930888+0000","last_clean":"2024-04-18T21:07:19.930888+0000","last_became_active":"2024-04-18T21:05:08.603895+0000","last_became_peered":"2024-04-18T21:05:08.603895+0000","last_unstale":"2024-04-18T21:07:19.930888+0000","last_undegraded":"2024-04-18T21:07:19.930888+0000","last_fullsized":"2024-04-18T21:07:19.930888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:58.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147837,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":383,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"71'370","reported_seq":509,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.949974+0000","last_change":"2024-04-18T21:05:08.608749+0000","last_active":"2024-04-18T21:07:19.949974+0000","last_peered":"2024-04-18T21:07:19.949974+0000","last_clean":"2024-04-18T21:07:19.949974+0000","last_became_active":"2024-04-18T21:05:08.607929+0000","last_became_peered":"2024-04-18T21:05:08.607929+0000","last_unstale":"2024-04-18T21:07:19.949974+0000","last_undegraded":"2024-04-18T21:07:19.949974+0000","last_fullsized":"2024-04-18T21:07:19.949974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:43.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199467,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":340,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"71'397","reported_seq":563,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.941256+0000","last_change":"2024-04-18T21:07:12.923962+0000","last_active":"2024-04-18T21:07:19.941256+0000","last_peered":"2024-04-18T21:07:19.941256+0000","last_clean":"2024-04-18T21:07:19.941256+0000","last_became_active":"2024-04-18T21:07:12.922243+0000","last_became_peered":"2024-04-18T21:07:12.922243+0000","last_unstale":"2024-04-18T21:07:19.941256+0000","last_undegraded":"2024-04-18T21:07:19.941256+0000","last_fullsized":"2024-04-18T21:07:19.941256+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:09.028970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170534,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":372,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'381","reported_seq":517,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.952281+0000","last_change":"2024-04-18T21:05:08.604611+0000","last_active":"2024-04-18T21:07:19.952281+0000","last_peered":"2024-04-18T21:07:19.952281+0000","last_clean":"2024-04-18T21:07:19.952281+0000","last_became_active":"2024-04-18T21:05:08.603838+0000","last_became_peered":"2024-04-18T21:05:08.603838+0000","last_unstale":"2024-04-18T21:07:19.952281+0000","last_undegraded":"2024-04-18T21:07:19.952281+0000","last_fullsized":"2024-04-18T21:07:19.952281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404291,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":363,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'447","reported_seq":652,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.957598+0000","last_change":"2024-04-18T21:05:08.610124+0000","last_active":"2024-04-18T21:07:19.957598+0000","last_peered":"2024-04-18T21:07:19.957598+0000","last_clean":"2024-04-18T21:07:19.957598+0000","last_became_active":"2024-04-18T21:05:08.609368+0000","last_became_peered":"2024-04-18T21:05:08.609368+0000","last_unstale":"2024-04-18T21:07:19.957598+0000","last_undegraded":"2024-04-18T21:07:19.957598+0000","last_fullsized":"2024-04-18T21:07:19.957598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:13.319360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262751,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":417,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"71'361","reported_seq":529,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.960798+0000","last_change":"2024-04-18T21:07:12.927956+0000","last_active":"2024-04-18T21:07:19.960798+0000","last_peered":"2024-04-18T21:07:19.960798+0000","last_clean":"2024-04-18T21:07:19.960798+0000","last_became_active":"2024-04-18T21:07:12.923332+0000","last_became_peered":"2024-04-18T21:07:12.923332+0000","last_unstale":"2024-04-18T21:07:19.960798+0000","last_undegraded":"2024-04-18T21:07:19.960798+0000","last_fullsized":"2024-04-18T21:07:19.960798+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:24:18.868293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172270,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":336,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'359","reported_seq":569,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.960520+0000","last_change":"2024-04-18T21:05:08.617662+0000","last_active":"2024-04-18T21:07:19.960520+0000","last_peered":"2024-04-18T21:07:19.960520+0000","last_clean":"2024-04-18T21:07:19.960520+0000","last_became_active":"2024-04-18T21:05:08.613124+0000","last_became_peered":"2024-04-18T21:05:08.613124+0000","last_unstale":"2024-04-18T21:07:19.960520+0000","last_undegraded":"2024-04-18T21:07:19.960520+0000","last_fullsized":"2024-04-18T21:07:19.960520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:47.732815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201772,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":335,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"71'363","reported_seq":510,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.943669+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:07:19.943669+0000","last_peered":"2024-04-18T21:07:19.943669+0000","last_clean":"2024-04-18T21:07:19.943669+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:07:19.943669+0000","last_undegraded":"2024-04-18T21:07:19.943669+0000","last_fullsized":"2024-04-18T21:07:19.943669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150014,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":341,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"71'425","reported_seq":602,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.936528+0000","last_change":"2024-04-18T21:05:08.613262+0000","last_active":"2024-04-18T21:07:19.936528+0000","last_peered":"2024-04-18T21:07:19.936528+0000","last_clean":"2024-04-18T21:07:19.936528+0000","last_became_active":"2024-04-18T21:05:08.610711+0000","last_became_peered":"2024-04-18T21:05:08.610711+0000","last_unstale":"2024-04-18T21:07:19.936528+0000","last_undegraded":"2024-04-18T21:07:19.936528+0000","last_fullsized":"2024-04-18T21:07:19.936528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192223,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":396,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"71'410","reported_seq":588,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.958136+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:07:19.958136+0000","last_peered":"2024-04-18T21:07:19.958136+0000","last_clean":"2024-04-18T21:07:19.958136+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:07:19.958136+0000","last_undegraded":"2024-04-18T21:07:19.958136+0000","last_fullsized":"2024-04-18T21:07:19.958136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124321,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":391,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"71'401","reported_seq":563,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.959462+0000","last_change":"2024-04-18T21:06:42.764233+0000","last_active":"2024-04-18T21:07:19.959462+0000","last_peered":"2024-04-18T21:07:19.959462+0000","last_clean":"2024-04-18T21:07:19.959462+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:07:19.959462+0000","last_undegraded":"2024-04-18T21:07:19.959462+0000","last_fullsized":"2024-04-18T21:07:19.959462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:09.928737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1640027,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":378,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"71'369","reported_seq":540,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.941249+0000","last_change":"2024-04-18T21:07:12.926518+0000","last_active":"2024-04-18T21:07:19.941249+0000","last_peered":"2024-04-18T21:07:19.941249+0000","last_clean":"2024-04-18T21:07:19.941249+0000","last_became_active":"2024-04-18T21:07:12.922514+0000","last_became_peered":"2024-04-18T21:07:12.922514+0000","last_unstale":"2024-04-18T21:07:19.941249+0000","last_undegraded":"2024-04-18T21:07:19.941249+0000","last_fullsized":"2024-04-18T21:07:19.941249+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:10.575743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141317,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":344,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'633","reported_seq":686,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.881100+0000","last_change":"2024-04-18T21:06:42.767288+0000","last_active":"2024-04-18T21:07:19.881100+0000","last_peered":"2024-04-18T21:07:19.881100+0000","last_clean":"2024-04-18T21:07:19.881100+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:07:19.881100+0000","last_undegraded":"2024-04-18T21:07:19.881100+0000","last_fullsized":"2024-04-18T21:07:19.881100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:20.327001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"71'378","reported_seq":534,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.931062+0000","last_change":"2024-04-18T21:07:12.923355+0000","last_active":"2024-04-18T21:07:19.931062+0000","last_peered":"2024-04-18T21:07:19.931062+0000","last_clean":"2024-04-18T21:07:19.931062+0000","last_became_active":"2024-04-18T21:07:12.922415+0000","last_became_peered":"2024-04-18T21:07:12.922415+0000","last_unstale":"2024-04-18T21:07:19.931062+0000","last_undegraded":"2024-04-18T21:07:19.931062+0000","last_fullsized":"2024-04-18T21:07:19.931062+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:46:41.175167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260582,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":343,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'41","reported_seq":161,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.938114+0000","last_change":"2024-04-18T21:05:07.590716+0000","last_active":"2024-04-18T21:07:19.938114+0000","last_peered":"2024-04-18T21:07:19.938114+0000","last_clean":"2024-04-18T21:07:19.938114+0000","last_became_active":"2024-04-18T21:05:07.589616+0000","last_became_peered":"2024-04-18T21:05:07.589616+0000","last_unstale":"2024-04-18T21:07:19.938114+0000","last_undegraded":"2024-04-18T21:07:19.938114+0000","last_fullsized":"2024-04-18T21:07:19.938114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:53:13.468783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"71'376","reported_seq":541,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.954266+0000","last_change":"2024-04-18T21:05:08.616326+0000","last_active":"2024-04-18T21:07:19.954266+0000","last_peered":"2024-04-18T21:07:19.954266+0000","last_clean":"2024-04-18T21:07:19.954266+0000","last_became_active":"2024-04-18T21:05:08.615393+0000","last_became_peered":"2024-04-18T21:05:08.615393+0000","last_unstale":"2024-04-18T21:07:19.954266+0000","last_undegraded":"2024-04-18T21:07:19.954266+0000","last_fullsized":"2024-04-18T21:07:19.954266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327908,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":353,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'66","reported_seq":186,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.904005+0000","last_change":"2024-04-18T21:05:07.593100+0000","last_active":"2024-04-18T21:07:19.904005+0000","last_peered":"2024-04-18T21:07:19.904005+0000","last_clean":"2024-04-18T21:07:19.904005+0000","last_became_active":"2024-04-18T21:05:07.592273+0000","last_became_peered":"2024-04-18T21:05:07.592273+0000","last_unstale":"2024-04-18T21:07:19.904005+0000","last_undegraded":"2024-04-18T21:07:19.904005+0000","last_fullsized":"2024-04-18T21:07:19.904005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:24:36.031836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'360","reported_seq":536,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.954495+0000","last_change":"2024-04-18T21:05:08.616914+0000","last_active":"2024-04-18T21:07:19.954495+0000","last_peered":"2024-04-18T21:07:19.954495+0000","last_clean":"2024-04-18T21:07:19.954495+0000","last_became_active":"2024-04-18T21:05:08.615937+0000","last_became_peered":"2024-04-18T21:05:08.615937+0000","last_unstale":"2024-04-18T21:07:19.954495+0000","last_undegraded":"2024-04-18T21:07:19.954495+0000","last_fullsized":"2024-04-18T21:07:19.954495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:07.865419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100318,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":335,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"71'51","reported_seq":127,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.951577+0000","last_change":"2024-04-18T21:07:12.922262+0000","last_active":"2024-04-18T21:07:19.951577+0000","last_peered":"2024-04-18T21:07:19.951577+0000","last_clean":"2024-04-18T21:07:19.951577+0000","last_became_active":"2024-04-18T21:07:12.921334+0000","last_became_peered":"2024-04-18T21:07:12.921334+0000","last_unstale":"2024-04-18T21:07:19.951577+0000","last_undegraded":"2024-04-18T21:07:19.951577+0000","last_fullsized":"2024-04-18T21:07:19.951577+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:08.618521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'149","reported_seq":203,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.938786+0000","last_change":"2024-04-18T21:06:42.769260+0000","last_active":"2024-04-18T21:07:19.938786+0000","last_peered":"2024-04-18T21:07:19.938786+0000","last_clean":"2024-04-18T21:07:19.938786+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:07:19.938786+0000","last_undegraded":"2024-04-18T21:07:19.938786+0000","last_fullsized":"2024-04-18T21:07:19.938786+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:12:01.164268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"71'378","reported_seq":523,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.958722+0000","last_change":"2024-04-18T21:05:08.608482+0000","last_active":"2024-04-18T21:07:19.958722+0000","last_peered":"2024-04-18T21:07:19.958722+0000","last_clean":"2024-04-18T21:07:19.958722+0000","last_became_active":"2024-04-18T21:05:08.604974+0000","last_became_peered":"2024-04-18T21:05:08.604974+0000","last_unstale":"2024-04-18T21:07:19.958722+0000","last_undegraded":"2024-04-18T21:07:19.958722+0000","last_fullsized":"2024-04-18T21:07:19.958722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:51.002091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181739,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":351,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"71'277","reported_seq":397,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.950717+0000","last_change":"2024-04-18T21:05:07.592807+0000","last_active":"2024-04-18T21:07:19.950717+0000","last_peered":"2024-04-18T21:07:19.950717+0000","last_clean":"2024-04-18T21:07:19.950717+0000","last_became_active":"2024-04-18T21:05:07.591938+0000","last_became_peered":"2024-04-18T21:05:07.591938+0000","last_unstale":"2024-04-18T21:07:19.950717+0000","last_undegraded":"2024-04-18T21:07:19.950717+0000","last_fullsized":"2024-04-18T21:07:19.950717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"71'415","reported_seq":593,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.935166+0000","last_change":"2024-04-18T21:07:12.934567+0000","last_active":"2024-04-18T21:07:19.935166+0000","last_peered":"2024-04-18T21:07:19.935166+0000","last_clean":"2024-04-18T21:07:19.935166+0000","last_became_active":"2024-04-18T21:07:12.923131+0000","last_became_peered":"2024-04-18T21:07:12.923131+0000","last_unstale":"2024-04-18T21:07:19.935166+0000","last_undegraded":"2024-04-18T21:07:19.935166+0000","last_fullsized":"2024-04-18T21:07:19.935166+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:47:59.262179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226545,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":391,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'545","reported_seq":581,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.941101+0000","last_change":"2024-04-18T21:07:12.928952+0000","last_active":"2024-04-18T21:07:18.941101+0000","last_peered":"2024-04-18T21:07:18.941101+0000","last_clean":"2024-04-18T21:07:18.941101+0000","last_became_active":"2024-04-18T21:07:12.927646+0000","last_became_peered":"2024-04-18T21:07:12.927646+0000","last_unstale":"2024-04-18T21:07:18.941101+0000","last_undegraded":"2024-04-18T21:07:18.941101+0000","last_fullsized":"2024-04-18T21:07:18.941101+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:45:30.300295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'432","reported_seq":650,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.906764+0000","last_change":"2024-04-18T21:06:42.773762+0000","last_active":"2024-04-18T21:07:19.906764+0000","last_peered":"2024-04-18T21:07:19.906764+0000","last_clean":"2024-04-18T21:07:19.906764+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:07:19.906764+0000","last_undegraded":"2024-04-18T21:07:19.906764+0000","last_fullsized":"2024-04-18T21:07:19.906764+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:42.621459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263522,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":410,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"71'35","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.895894+0000","last_change":"2024-04-18T21:06:42.775878+0000","last_active":"2024-04-18T21:07:19.895894+0000","last_peered":"2024-04-18T21:07:19.895894+0000","last_clean":"2024-04-18T21:07:19.895894+0000","last_became_active":"2024-04-18T21:06:42.772647+0000","last_became_peered":"2024-04-18T21:06:42.772647+0000","last_unstale":"2024-04-18T21:07:19.895894+0000","last_undegraded":"2024-04-18T21:07:19.895894+0000","last_fullsized":"2024-04-18T21:07:19.895894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:15.012341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"71'404","reported_seq":610,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.952147+0000","last_change":"2024-04-18T21:05:08.617266+0000","last_active":"2024-04-18T21:07:19.952147+0000","last_peered":"2024-04-18T21:07:19.952147+0000","last_clean":"2024-04-18T21:07:19.952147+0000","last_became_active":"2024-04-18T21:05:08.616595+0000","last_became_peered":"2024-04-18T21:05:08.616595+0000","last_unstale":"2024-04-18T21:07:19.952147+0000","last_undegraded":"2024-04-18T21:07:19.952147+0000","last_fullsized":"2024-04-18T21:07:19.952147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:32:44.697500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215666,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":377,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"71'159","reported_seq":279,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.938164+0000","last_change":"2024-04-18T21:05:07.591873+0000","last_active":"2024-04-18T21:07:18.938164+0000","last_peered":"2024-04-18T21:07:18.938164+0000","last_clean":"2024-04-18T21:07:18.938164+0000","last_became_active":"2024-04-18T21:05:07.589961+0000","last_became_peered":"2024-04-18T21:05:07.589961+0000","last_unstale":"2024-04-18T21:07:18.938164+0000","last_undegraded":"2024-04-18T21:07:18.938164+0000","last_fullsized":"2024-04-18T21:07:18.938164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:45.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"71'419","reported_seq":577,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.952300+0000","last_change":"2024-04-18T21:06:42.775218+0000","last_active":"2024-04-18T21:07:19.952300+0000","last_peered":"2024-04-18T21:07:19.952300+0000","last_clean":"2024-04-18T21:07:19.952300+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:07:19.952300+0000","last_undegraded":"2024-04-18T21:07:19.952300+0000","last_fullsized":"2024-04-18T21:07:19.952300+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:09.627976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367356,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":388,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"71'97","reported_seq":142,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.880688+0000","last_change":"2024-04-18T21:06:42.762081+0000","last_active":"2024-04-18T21:07:19.880688+0000","last_peered":"2024-04-18T21:07:19.880688+0000","last_clean":"2024-04-18T21:07:19.880688+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:07:19.880688+0000","last_undegraded":"2024-04-18T21:07:19.880688+0000","last_fullsized":"2024-04-18T21:07:19.880688+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:14.883260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"71'392","reported_seq":554,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.958466+0000","last_change":"2024-04-18T21:07:12.928700+0000","last_active":"2024-04-18T21:07:19.958466+0000","last_peered":"2024-04-18T21:07:19.958466+0000","last_clean":"2024-04-18T21:07:19.958466+0000","last_became_active":"2024-04-18T21:07:12.925464+0000","last_became_peered":"2024-04-18T21:07:12.925464+0000","last_unstale":"2024-04-18T21:07:19.958466+0000","last_undegraded":"2024-04-18T21:07:19.958466+0000","last_fullsized":"2024-04-18T21:07:19.958466+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:05:28.017522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99897,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":370,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'41","reported_seq":162,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:20.026001+0000","last_change":"2024-04-18T21:05:07.592701+0000","last_active":"2024-04-18T21:07:20.026001+0000","last_peered":"2024-04-18T21:07:20.026001+0000","last_clean":"2024-04-18T21:07:20.026001+0000","last_became_active":"2024-04-18T21:05:07.592041+0000","last_became_peered":"2024-04-18T21:05:07.592041+0000","last_unstale":"2024-04-18T21:07:20.026001+0000","last_undegraded":"2024-04-18T21:07:20.026001+0000","last_fullsized":"2024-04-18T21:07:20.026001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:06:32.993462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"71'339","reported_seq":486,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.959228+0000","last_change":"2024-04-18T21:06:42.763294+0000","last_active":"2024-04-18T21:07:19.959228+0000","last_peered":"2024-04-18T21:07:19.959228+0000","last_clean":"2024-04-18T21:07:19.959228+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:07:19.959228+0000","last_undegraded":"2024-04-18T21:07:19.959228+0000","last_fullsized":"2024-04-18T21:07:19.959228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:27.194682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102997,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":314,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"71'458","reported_seq":552,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.938750+0000","last_change":"2024-04-18T21:07:12.927346+0000","last_active":"2024-04-18T21:07:18.938750+0000","last_peered":"2024-04-18T21:07:18.938750+0000","last_clean":"2024-04-18T21:07:18.938750+0000","last_became_active":"2024-04-18T21:07:12.926853+0000","last_became_peered":"2024-04-18T21:07:12.926853+0000","last_unstale":"2024-04-18T21:07:18.938750+0000","last_undegraded":"2024-04-18T21:07:18.938750+0000","last_fullsized":"2024-04-18T21:07:18.938750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:01.769545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'377","reported_seq":589,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.943110+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:07:19.943110+0000","last_peered":"2024-04-18T21:07:19.943110+0000","last_clean":"2024-04-18T21:07:19.943110+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:07:19.943110+0000","last_undegraded":"2024-04-18T21:07:19.943110+0000","last_fullsized":"2024-04-18T21:07:19.943110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172569,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":354,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":304,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.937518+0000","last_change":"2024-04-18T21:07:12.924448+0000","last_active":"2024-04-18T21:07:18.937518+0000","last_peered":"2024-04-18T21:07:18.937518+0000","last_clean":"2024-04-18T21:07:18.937518+0000","last_became_active":"2024-04-18T21:07:12.923313+0000","last_became_peered":"2024-04-18T21:07:12.923313+0000","last_unstale":"2024-04-18T21:07:18.937518+0000","last_undegraded":"2024-04-18T21:07:18.937518+0000","last_fullsized":"2024-04-18T21:07:18.937518+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:03:09.118716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.938264+0000","last_change":"2024-04-18T21:06:42.775112+0000","last_active":"2024-04-18T21:07:18.938264+0000","last_peered":"2024-04-18T21:07:18.938264+0000","last_clean":"2024-04-18T21:07:18.938264+0000","last_became_active":"2024-04-18T21:06:42.770706+0000","last_became_peered":"2024-04-18T21:06:42.770706+0000","last_unstale":"2024-04-18T21:07:18.938264+0000","last_undegraded":"2024-04-18T21:07:18.938264+0000","last_fullsized":"2024-04-18T21:07:18.938264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:24:32.220495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"71'334","reported_seq":455,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.832152+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:07:19.832152+0000","last_peered":"2024-04-18T21:07:19.832152+0000","last_clean":"2024-04-18T21:07:19.832152+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:07:19.832152+0000","last_undegraded":"2024-04-18T21:07:19.832152+0000","last_fullsized":"2024-04-18T21:07:19.832152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"71'390","reported_seq":541,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.952222+0000","last_change":"2024-04-18T21:07:12.928411+0000","last_active":"2024-04-18T21:07:19.952222+0000","last_peered":"2024-04-18T21:07:19.952222+0000","last_clean":"2024-04-18T21:07:19.952222+0000","last_became_active":"2024-04-18T21:07:12.924384+0000","last_became_peered":"2024-04-18T21:07:12.924384+0000","last_unstale":"2024-04-18T21:07:19.952222+0000","last_undegraded":"2024-04-18T21:07:19.952222+0000","last_fullsized":"2024-04-18T21:07:19.952222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117540,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":358,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.937517+0000","last_change":"2024-04-18T21:07:12.922508+0000","last_active":"2024-04-18T21:07:18.937517+0000","last_peered":"2024-04-18T21:07:18.937517+0000","last_clean":"2024-04-18T21:07:18.937517+0000","last_became_active":"2024-04-18T21:07:12.921686+0000","last_became_peered":"2024-04-18T21:07:12.921686+0000","last_unstale":"2024-04-18T21:07:18.937517+0000","last_undegraded":"2024-04-18T21:07:18.937517+0000","last_fullsized":"2024-04-18T21:07:18.937517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:11.842257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'105","reported_seq":279,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.929213+0000","last_change":"2024-04-18T21:05:07.591986+0000","last_active":"2024-04-18T21:07:19.929213+0000","last_peered":"2024-04-18T21:07:19.929213+0000","last_clean":"2024-04-18T21:07:19.929213+0000","last_became_active":"2024-04-18T21:05:07.590427+0000","last_became_peered":"2024-04-18T21:05:07.590427+0000","last_unstale":"2024-04-18T21:07:19.929213+0000","last_undegraded":"2024-04-18T21:07:19.929213+0000","last_fullsized":"2024-04-18T21:07:19.929213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:37:45.609539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235331,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":1242,"num_write":53,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"71'418","reported_seq":625,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.946116+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:07:19.946116+0000","last_peered":"2024-04-18T21:07:19.946116+0000","last_clean":"2024-04-18T21:07:19.946116+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:07:19.946116+0000","last_undegraded":"2024-04-18T21:07:19.946116+0000","last_fullsized":"2024-04-18T21:07:19.946116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165572,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":399,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":127,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.937306+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:07:18.937306+0000","last_peered":"2024-04-18T21:07:18.937306+0000","last_clean":"2024-04-18T21:07:18.937306+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:07:18.937306+0000","last_undegraded":"2024-04-18T21:07:18.937306+0000","last_fullsized":"2024-04-18T21:07:18.937306+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"71'277","reported_seq":398,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.898956+0000","last_change":"2024-04-18T21:05:07.593576+0000","last_active":"2024-04-18T21:07:19.898956+0000","last_peered":"2024-04-18T21:07:19.898956+0000","last_clean":"2024-04-18T21:07:19.898956+0000","last_became_active":"2024-04-18T21:05:07.592210+0000","last_became_peered":"2024-04-18T21:05:07.592210+0000","last_unstale":"2024-04-18T21:07:19.898956+0000","last_undegraded":"2024-04-18T21:07:19.898956+0000","last_fullsized":"2024-04-18T21:07:19.898956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:32:05.691127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"71'312","reported_seq":468,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.942519+0000","last_change":"2024-04-18T21:05:08.606523+0000","last_active":"2024-04-18T21:07:19.942519+0000","last_peered":"2024-04-18T21:07:19.942519+0000","last_clean":"2024-04-18T21:07:19.942519+0000","last_became_active":"2024-04-18T21:05:08.605034+0000","last_became_peered":"2024-04-18T21:05:08.605034+0000","last_unstale":"2024-04-18T21:07:19.942519+0000","last_undegraded":"2024-04-18T21:07:19.942519+0000","last_fullsized":"2024-04-18T21:07:19.942519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:15.736850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123516,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":292,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.937398+0000","last_change":"2024-04-18T21:06:42.771115+0000","last_active":"2024-04-18T21:07:18.937398+0000","last_peered":"2024-04-18T21:07:18.937398+0000","last_clean":"2024-04-18T21:07:18.937398+0000","last_became_active":"2024-04-18T21:06:42.769644+0000","last_became_peered":"2024-04-18T21:06:42.769644+0000","last_unstale":"2024-04-18T21:07:18.937398+0000","last_undegraded":"2024-04-18T21:07:18.937398+0000","last_fullsized":"2024-04-18T21:07:18.937398+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:57.139815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"71'55","reported_seq":100,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.937701+0000","last_change":"2024-04-18T21:06:42.769806+0000","last_active":"2024-04-18T21:07:18.937701+0000","last_peered":"2024-04-18T21:07:18.937701+0000","last_clean":"2024-04-18T21:07:18.937701+0000","last_became_active":"2024-04-18T21:06:42.766399+0000","last_became_peered":"2024-04-18T21:06:42.766399+0000","last_unstale":"2024-04-18T21:07:18.937701+0000","last_undegraded":"2024-04-18T21:07:18.937701+0000","last_fullsized":"2024-04-18T21:07:18.937701+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:14.377108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"71'360","reported_seq":510,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.906338+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:07:19.906338+0000","last_peered":"2024-04-18T21:07:19.906338+0000","last_clean":"2024-04-18T21:07:19.906338+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:07:19.906338+0000","last_undegraded":"2024-04-18T21:07:19.906338+0000","last_fullsized":"2024-04-18T21:07:19.906338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107781,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":335,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"71'239","reported_seq":284,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:20.021859+0000","last_change":"2024-04-18T21:06:42.771952+0000","last_active":"2024-04-18T21:07:20.021859+0000","last_peered":"2024-04-18T21:07:20.021859+0000","last_clean":"2024-04-18T21:07:20.021859+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:07:20.021859+0000","last_undegraded":"2024-04-18T21:07:20.021859+0000","last_fullsized":"2024-04-18T21:07:20.021859+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:41.248683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":127,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.938225+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:07:18.938225+0000","last_peered":"2024-04-18T21:07:18.938225+0000","last_clean":"2024-04-18T21:07:18.938225+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:07:18.938225+0000","last_undegraded":"2024-04-18T21:07:18.938225+0000","last_fullsized":"2024-04-18T21:07:18.938225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'339","reported_seq":496,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.952334+0000","last_change":"2024-04-18T21:05:08.611190+0000","last_active":"2024-04-18T21:07:19.952334+0000","last_peered":"2024-04-18T21:07:19.952334+0000","last_clean":"2024-04-18T21:07:19.952334+0000","last_became_active":"2024-04-18T21:05:08.610412+0000","last_became_peered":"2024-04-18T21:05:08.610412+0000","last_unstale":"2024-04-18T21:07:19.952334+0000","last_undegraded":"2024-04-18T21:07:19.952334+0000","last_fullsized":"2024-04-18T21:07:19.952334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:13:10.790040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158344,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":308,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"71'55","reported_seq":176,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.871204+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:07:19.871204+0000","last_peered":"2024-04-18T21:07:19.871204+0000","last_clean":"2024-04-18T21:07:19.871204+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:07:19.871204+0000","last_undegraded":"2024-04-18T21:07:19.871204+0000","last_fullsized":"2024-04-18T21:07:19.871204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.942771+0000","last_change":"2024-04-18T21:07:12.927683+0000","last_active":"2024-04-18T21:07:18.942771+0000","last_peered":"2024-04-18T21:07:18.942771+0000","last_clean":"2024-04-18T21:07:18.942771+0000","last_became_active":"2024-04-18T21:07:12.927179+0000","last_became_peered":"2024-04-18T21:07:12.927179+0000","last_unstale":"2024-04-18T21:07:18.942771+0000","last_undegraded":"2024-04-18T21:07:18.942771+0000","last_fullsized":"2024-04-18T21:07:18.942771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:47.123481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'370","reported_seq":520,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.896465+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:07:19.896465+0000","last_peered":"2024-04-18T21:07:19.896465+0000","last_clean":"2024-04-18T21:07:19.896465+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:07:19.896465+0000","last_undegraded":"2024-04-18T21:07:19.896465+0000","last_fullsized":"2024-04-18T21:07:19.896465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91414,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":339,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"71'52","reported_seq":173,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.958110+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:07:19.958110+0000","last_peered":"2024-04-18T21:07:19.958110+0000","last_clean":"2024-04-18T21:07:19.958110+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:07:19.958110+0000","last_undegraded":"2024-04-18T21:07:19.958110+0000","last_fullsized":"2024-04-18T21:07:19.958110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":127,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.940787+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:07:18.940787+0000","last_peered":"2024-04-18T21:07:18.940787+0000","last_clean":"2024-04-18T21:07:18.940787+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:07:18.940787+0000","last_undegraded":"2024-04-18T21:07:18.940787+0000","last_fullsized":"2024-04-18T21:07:18.940787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"71'356","reported_seq":481,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.951690+0000","last_change":"2024-04-18T21:05:08.610801+0000","last_active":"2024-04-18T21:07:19.951690+0000","last_peered":"2024-04-18T21:07:19.951690+0000","last_clean":"2024-04-18T21:07:19.951690+0000","last_became_active":"2024-04-18T21:05:08.610260+0000","last_became_peered":"2024-04-18T21:05:08.610260+0000","last_unstale":"2024-04-18T21:07:19.951690+0000","last_undegraded":"2024-04-18T21:07:19.951690+0000","last_fullsized":"2024-04-18T21:07:19.951690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162601,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":328,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"71'91","reported_seq":179,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:20.660605+0000","last_change":"2024-04-18T21:06:36.741511+0000","last_active":"2024-04-18T21:07:20.660605+0000","last_peered":"2024-04-18T21:07:20.660605+0000","last_clean":"2024-04-18T21:07:20.660605+0000","last_became_active":"2024-04-18T21:06:36.737416+0000","last_became_peered":"2024-04-18T21:06:36.737416+0000","last_unstale":"2024-04-18T21:07:20.660605+0000","last_undegraded":"2024-04-18T21:07:20.660605+0000","last_fullsized":"2024-04-18T21:07:20.660605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:20.743288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":1300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:18.938395+0000","last_change":"2024-04-18T21:07:12.924923+0000","last_active":"2024-04-18T21:07:18.938395+0000","last_peered":"2024-04-18T21:07:18.938395+0000","last_clean":"2024-04-18T21:07:18.938395+0000","last_became_active":"2024-04-18T21:07:12.924103+0000","last_became_peered":"2024-04-18T21:07:12.924103+0000","last_unstale":"2024-04-18T21:07:18.938395+0000","last_undegraded":"2024-04-18T21:07:18.938395+0000","last_fullsized":"2024-04-18T21:07:18.938395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:06:01.540302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'360","reported_seq":531,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.938125+0000","last_change":"2024-04-18T21:05:08.605006+0000","last_active":"2024-04-18T21:07:19.938125+0000","last_peered":"2024-04-18T21:07:19.938125+0000","last_clean":"2024-04-18T21:07:19.938125+0000","last_became_active":"2024-04-18T21:05:08.603636+0000","last_became_peered":"2024-04-18T21:05:08.603636+0000","last_unstale":"2024-04-18T21:07:19.938125+0000","last_undegraded":"2024-04-18T21:07:19.938125+0000","last_fullsized":"2024-04-18T21:07:19.938125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:13:46.513747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":229934,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":337,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"71'371","reported_seq":567,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.932818+0000","last_change":"2024-04-18T21:07:12.925036+0000","last_active":"2024-04-18T21:07:19.932818+0000","last_peered":"2024-04-18T21:07:19.932818+0000","last_clean":"2024-04-18T21:07:19.932818+0000","last_became_active":"2024-04-18T21:07:12.921325+0000","last_became_peered":"2024-04-18T21:07:12.921325+0000","last_unstale":"2024-04-18T21:07:19.932818+0000","last_undegraded":"2024-04-18T21:07:19.932818+0000","last_fullsized":"2024-04-18T21:07:19.932818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:01.487977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178224,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":357,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'242","reported_seq":357,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.893433+0000","last_change":"2024-04-18T21:07:12.922296+0000","last_active":"2024-04-18T21:07:19.893433+0000","last_peered":"2024-04-18T21:07:19.893433+0000","last_clean":"2024-04-18T21:07:19.893433+0000","last_became_active":"2024-04-18T21:07:12.921484+0000","last_became_peered":"2024-04-18T21:07:12.921484+0000","last_unstale":"2024-04-18T21:07:19.893433+0000","last_undegraded":"2024-04-18T21:07:19.893433+0000","last_fullsized":"2024-04-18T21:07:19.893433+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:15.012341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'356","reported_seq":489,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.931436+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:07:19.931436+0000","last_peered":"2024-04-18T21:07:19.931436+0000","last_clean":"2024-04-18T21:07:19.931436+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:07:19.931436+0000","last_undegraded":"2024-04-18T21:07:19.931436+0000","last_fullsized":"2024-04-18T21:07:19.931436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360793,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":329,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"71'61","reported_seq":181,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.911693+0000","last_change":"2024-04-18T21:05:07.594965+0000","last_active":"2024-04-18T21:07:19.911693+0000","last_peered":"2024-04-18T21:07:19.911693+0000","last_clean":"2024-04-18T21:07:19.911693+0000","last_became_active":"2024-04-18T21:05:07.594388+0000","last_became_peered":"2024-04-18T21:05:07.594388+0000","last_unstale":"2024-04-18T21:07:19.911693+0000","last_undegraded":"2024-04-18T21:07:19.911693+0000","last_fullsized":"2024-04-18T21:07:19.911693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"71'226","reported_seq":271,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.908661+0000","last_change":"2024-04-18T21:06:42.765175+0000","last_active":"2024-04-18T21:07:19.908661+0000","last_peered":"2024-04-18T21:07:19.908661+0000","last_clean":"2024-04-18T21:07:19.908661+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:07:19.908661+0000","last_undegraded":"2024-04-18T21:07:19.908661+0000","last_fullsized":"2024-04-18T21:07:19.908661+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:26.185227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"71'434","reported_seq":582,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.938439+0000","last_change":"2024-04-18T21:05:08.608539+0000","last_active":"2024-04-18T21:07:19.938439+0000","last_peered":"2024-04-18T21:07:19.938439+0000","last_clean":"2024-04-18T21:07:19.938439+0000","last_became_active":"2024-04-18T21:05:08.607775+0000","last_became_peered":"2024-04-18T21:05:08.607775+0000","last_unstale":"2024-04-18T21:07:19.938439+0000","last_undegraded":"2024-04-18T21:07:19.938439+0000","last_fullsized":"2024-04-18T21:07:19.938439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:09.178788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227994,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":407,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"71'52","reported_seq":172,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.940461+0000","last_change":"2024-04-18T21:05:07.591477+0000","last_active":"2024-04-18T21:07:19.940461+0000","last_peered":"2024-04-18T21:07:19.940461+0000","last_clean":"2024-04-18T21:07:19.940461+0000","last_became_active":"2024-04-18T21:05:07.589465+0000","last_became_peered":"2024-04-18T21:05:07.589465+0000","last_unstale":"2024-04-18T21:07:19.940461+0000","last_undegraded":"2024-04-18T21:07:19.940461+0000","last_fullsized":"2024-04-18T21:07:19.940461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:30.101917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"71'416","reported_seq":552,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.936077+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:07:19.936077+0000","last_peered":"2024-04-18T21:07:19.936077+0000","last_clean":"2024-04-18T21:07:19.936077+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:07:19.936077+0000","last_undegraded":"2024-04-18T21:07:19.936077+0000","last_fullsized":"2024-04-18T21:07:19.936077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164905,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":395,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"71'318","reported_seq":459,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.888023+0000","last_change":"2024-04-18T21:05:08.606742+0000","last_active":"2024-04-18T21:07:19.888023+0000","last_peered":"2024-04-18T21:07:19.888023+0000","last_clean":"2024-04-18T21:07:19.888023+0000","last_became_active":"2024-04-18T21:05:08.605511+0000","last_became_peered":"2024-04-18T21:05:08.605511+0000","last_unstale":"2024-04-18T21:07:19.888023+0000","last_undegraded":"2024-04-18T21:07:19.888023+0000","last_fullsized":"2024-04-18T21:07:19.888023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:21:49.363170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87728,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":299,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"71'603","reported_seq":723,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.885243+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:07:19.885243+0000","last_peered":"2024-04-18T21:07:19.885243+0000","last_clean":"2024-04-18T21:07:19.885243+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:07:19.885243+0000","last_undegraded":"2024-04-18T21:07:19.885243+0000","last_fullsized":"2024-04-18T21:07:19.885243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"71'360","reported_seq":504,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.926154+0000","last_change":"2024-04-18T21:05:08.616349+0000","last_active":"2024-04-18T21:07:19.926154+0000","last_peered":"2024-04-18T21:07:19.926154+0000","last_clean":"2024-04-18T21:07:19.926154+0000","last_became_active":"2024-04-18T21:05:08.615402+0000","last_became_peered":"2024-04-18T21:05:08.615402+0000","last_unstale":"2024-04-18T21:07:19.926154+0000","last_undegraded":"2024-04-18T21:07:19.926154+0000","last_fullsized":"2024-04-18T21:07:19.926154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:33.953753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1590178,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":337,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"71'191","reported_seq":311,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.885473+0000","last_change":"2024-04-18T21:05:07.592564+0000","last_active":"2024-04-18T21:07:19.885473+0000","last_peered":"2024-04-18T21:07:19.885473+0000","last_clean":"2024-04-18T21:07:19.885473+0000","last_became_active":"2024-04-18T21:05:07.591556+0000","last_became_peered":"2024-04-18T21:05:07.591556+0000","last_unstale":"2024-04-18T21:07:19.885473+0000","last_undegraded":"2024-04-18T21:07:19.885473+0000","last_fullsized":"2024-04-18T21:07:19.885473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:22.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"71'355","reported_seq":516,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.938300+0000","last_change":"2024-04-18T21:05:08.617736+0000","last_active":"2024-04-18T21:07:19.938300+0000","last_peered":"2024-04-18T21:07:19.938300+0000","last_clean":"2024-04-18T21:07:19.938300+0000","last_became_active":"2024-04-18T21:05:08.610274+0000","last_became_peered":"2024-04-18T21:05:08.610274+0000","last_unstale":"2024-04-18T21:07:19.938300+0000","last_undegraded":"2024-04-18T21:07:19.938300+0000","last_fullsized":"2024-04-18T21:07:19.938300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187872,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":327,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"71'154","reported_seq":241,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:20.712925+0000","last_change":"2024-04-18T21:07:12.929412+0000","last_active":"2024-04-18T21:07:20.712925+0000","last_peered":"2024-04-18T21:07:20.712925+0000","last_clean":"2024-04-18T21:07:20.712925+0000","last_became_active":"2024-04-18T21:07:12.927169+0000","last_became_peered":"2024-04-18T21:07:12.927169+0000","last_unstale":"2024-04-18T21:07:20.712925+0000","last_undegraded":"2024-04-18T21:07:20.712925+0000","last_fullsized":"2024-04-18T21:07:20.712925+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:47:04.180388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10719526,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":10524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'363","reported_seq":523,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.931455+0000","last_change":"2024-04-18T21:07:12.923107+0000","last_active":"2024-04-18T21:07:19.931455+0000","last_peered":"2024-04-18T21:07:19.931455+0000","last_clean":"2024-04-18T21:07:19.931455+0000","last_became_active":"2024-04-18T21:07:12.922271+0000","last_became_peered":"2024-04-18T21:07:12.922271+0000","last_unstale":"2024-04-18T21:07:19.931455+0000","last_undegraded":"2024-04-18T21:07:19.931455+0000","last_fullsized":"2024-04-18T21:07:19.931455+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:19:38.719747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133050,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":347,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'46","reported_seq":166,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.794686+0000","last_change":"2024-04-18T21:05:07.589737+0000","last_active":"2024-04-18T21:07:19.794686+0000","last_peered":"2024-04-18T21:07:19.794686+0000","last_clean":"2024-04-18T21:07:19.794686+0000","last_became_active":"2024-04-18T21:05:07.589103+0000","last_became_peered":"2024-04-18T21:05:07.589103+0000","last_unstale":"2024-04-18T21:07:19.794686+0000","last_undegraded":"2024-04-18T21:07:19.794686+0000","last_fullsized":"2024-04-18T21:07:19.794686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:16.856766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"71'335","reported_seq":494,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.906924+0000","last_change":"2024-04-18T21:06:42.769314+0000","last_active":"2024-04-18T21:07:19.906924+0000","last_peered":"2024-04-18T21:07:19.906924+0000","last_clean":"2024-04-18T21:07:19.906924+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:07:19.906924+0000","last_undegraded":"2024-04-18T21:07:19.906924+0000","last_fullsized":"2024-04-18T21:07:19.906924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:29:04.334671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143704,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":314,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'166","reported_seq":279,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.881140+0000","last_change":"2024-04-18T21:06:42.771271+0000","last_active":"2024-04-18T21:07:19.881140+0000","last_peered":"2024-04-18T21:07:19.881140+0000","last_clean":"2024-04-18T21:07:19.881140+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:07:19.881140+0000","last_undegraded":"2024-04-18T21:07:19.881140+0000","last_fullsized":"2024-04-18T21:07:19.881140+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:08.517484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"71'374","reported_seq":531,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.952345+0000","last_change":"2024-04-18T21:06:42.768180+0000","last_active":"2024-04-18T21:07:19.952345+0000","last_peered":"2024-04-18T21:07:19.952345+0000","last_clean":"2024-04-18T21:07:19.952345+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:07:19.952345+0000","last_undegraded":"2024-04-18T21:07:19.952345+0000","last_fullsized":"2024-04-18T21:07:19.952345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:47.403962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125553,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":347,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"71'179","reported_seq":299,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.892907+0000","last_change":"2024-04-18T21:05:07.592976+0000","last_active":"2024-04-18T21:07:19.892907+0000","last_peered":"2024-04-18T21:07:19.892907+0000","last_clean":"2024-04-18T21:07:19.892907+0000","last_became_active":"2024-04-18T21:05:07.592349+0000","last_became_peered":"2024-04-18T21:05:07.592349+0000","last_unstale":"2024-04-18T21:07:19.892907+0000","last_undegraded":"2024-04-18T21:07:19.892907+0000","last_fullsized":"2024-04-18T21:07:19.892907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:53.712672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"71'374","reported_seq":518,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.958258+0000","last_change":"2024-04-18T21:07:12.935357+0000","last_active":"2024-04-18T21:07:19.958258+0000","last_peered":"2024-04-18T21:07:19.958258+0000","last_clean":"2024-04-18T21:07:19.958258+0000","last_became_active":"2024-04-18T21:07:12.932863+0000","last_became_peered":"2024-04-18T21:07:12.932863+0000","last_unstale":"2024-04-18T21:07:19.958258+0000","last_undegraded":"2024-04-18T21:07:19.958258+0000","last_fullsized":"2024-04-18T21:07:19.958258+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:39.808171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128458,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":350,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'158","reported_seq":279,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.941302+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:07:19.941302+0000","last_peered":"2024-04-18T21:07:19.941302+0000","last_clean":"2024-04-18T21:07:19.941302+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:07:19.941302+0000","last_undegraded":"2024-04-18T21:07:19.941302+0000","last_fullsized":"2024-04-18T21:07:19.941302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"71'398","reported_seq":558,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.938108+0000","last_change":"2024-04-18T21:06:42.764836+0000","last_active":"2024-04-18T21:07:19.938108+0000","last_peered":"2024-04-18T21:07:19.938108+0000","last_clean":"2024-04-18T21:07:19.938108+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:07:19.938108+0000","last_undegraded":"2024-04-18T21:07:19.938108+0000","last_fullsized":"2024-04-18T21:07:19.938108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:18.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182507,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":368,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'48","reported_seq":169,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-18T21:07:19.926098+0000","last_change":"2024-04-18T21:05:07.589493+0000","last_active":"2024-04-18T21:07:19.926098+0000","last_peered":"2024-04-18T21:07:19.926098+0000","last_clean":"2024-04-18T21:07:19.926098+0000","last_became_active":"2024-04-18T21:05:07.587298+0000","last_became_peered":"2024-04-18T21:05:07.587298+0000","last_unstale":"2024-04-18T21:07:19.926098+0000","last_undegraded":"2024-04-18T21:07:19.926098+0000","last_fullsized":"2024-04-18T21:07:19.926098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:37.008147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":15512756,"num_objects":1919,"num_object_clones":0,"num_object_copies":3838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1919,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":22536,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30023680,"data_stored":31025512,"data_compressed":5470800,"data_compressed_allocated":6569984,"data_compressed_original":16932864,"omap_allocated":0,"internal_metadata":0},"log_size":24100,"ondisk_log_size":24100,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":125202535,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":53,"num_read_kb":1242,"num_write":4482,"num_write_kb":125657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84017152,"data_stored":250414746,"data_compressed":37332216,"data_compressed_allocated":48480256,"data_compressed_original":214941696,"omap_allocated":0,"internal_metadata":0},"log_size":5886,"ondisk_log_size":5886,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738401,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89272,"kb_used_data":35888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94282568,"statfs":{"total":96636764160,"available":96545349632,"internally_reserved":0,"allocated":36749312,"data_stored":88596382,"data_compressed":13023398,"data_compressed_allocated":16867328,"data_compressed_original":72155136,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738401,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109376,"kb_used_data":38008,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94262464,"statfs":{"total":96636764160,"available":96524763136,"internally_reserved":0,"allocated":38920192,"data_stored":90927012,"data_compressed":13800547,"data_compressed_allocated":17768448,"data_compressed_original":73453568,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108652,"kb_used_data":41444,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94263188,"statfs":{"total":96636764160,"available":96525504512,"internally_reserved":0,"allocated":42438656,"data_stored":104113337,"data_compressed":16232332,"data_compressed_allocated":20664320,"data_compressed_original":86839296,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28897280,"data_stored":89317185,"data_compressed":13516999,"data_compressed_allocated":17457152,"data_compressed_original":77905920,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27496448,"data_stored":79074013,"data_compressed":11716518,"data_compressed_allocated":15290368,"data_compressed_original":66879488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27623424,"data_stored":82023548,"data_compressed":12098699,"data_compressed_allocated":15732736,"data_compressed_original":70156288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9871360,"data_stored":11384450,"data_compressed":2106974,"data_compressed_allocated":2510848,"data_compressed_original":6922240,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10989568,"data_stored":12036398,"data_compressed":2161637,"data_compressed_allocated":2572288,"data_compressed_original":6975488,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9162752,"data_stored":7604664,"data_compressed":1202189,"data_compressed_allocated":1486848,"data_compressed_original":3035136,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:07:23.127 INFO:tasks.thrashosds.thrasher:Setting 4.7 to [2, 1] 2024-04-18T21:07:23.127 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.7', '2', '1'] 2024-04-18T21:07:23.127 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.7 2 1 2024-04-18T21:07:23.128 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:23.121+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:23.157 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-18T21:07:23.175 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T21:07:23.175 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T21:07:23.219 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:23.217+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:23.224 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:07:23.260 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:23.260 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:23.260 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:23.260 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:23.274 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:23.320 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:23.319+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:23.421 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:23.423+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:23.440 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:23.440 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:23.440 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:23.440 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:23.440 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:23.456 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:23.522 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:23.523+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:23.534 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:07:23.534 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":72,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:07:21.933860+0000","last_up_change":"2024-04-18T21:04:55.489869+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"error_message":"pool 1 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":0.0126190185546875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6801","nonce":1095770023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6803","nonce":1095770023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6807","nonce":1095770023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1095770023},{"type":"v1","addr":"172.21.15.111:6805","nonce":1095770023}]},"public_addr":"172.21.15.111:6801/1095770023","cluster_addr":"172.21.15.111:6803/1095770023","heartbeat_back_addr":"172.21.15.111:6807/1095770023","heartbeat_front_addr":"172.21.15.111:6805/1095770023","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":0.28900146484375,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:07:23.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:55.643422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:05:02.119174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:06.266829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:06.888450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}] 2024-04-18T21:07:23.552 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:07:23.583 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:23.583 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 134.98760032999999, 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:23.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:23.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:23.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:23.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.588 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 134.987536245, 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:23.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 134.987450647, 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:23.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:23.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:23.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.147609195000001, 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.599 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.642629463999999, 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:23.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:23.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.630868576000001, 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.134765751, 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:23.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.109228376000001, 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:23.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.098096002999998, 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:23.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:23.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.030959666000001, 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.625 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:23.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:23.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.878123221999999, 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:23.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.313639938000001, 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:23.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:23.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.260786532000001, 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:23.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:23.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:23.640 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11068 4.2c e69/53 4:357a8b3d:::10000001074.00000000:head v 69'304, mlcod=69'302)", 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.763383309, 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028186011, 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821417+0000", 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.198e-06 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821427+0000", 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0155e-05 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821443+0000", 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6124e-05 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821457+0000", 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4377e-05 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821604+0000", 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014668099999999999 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821639+0000", 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4907999999999998e-05 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849548+0000", 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027908911000000002 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849602+0000", 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3656999999999998e-05 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11073 4.3c e69/53 4:3cac0111:::10000001079.00000000:head v 69'282, mlcod=69'277)", 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7621805849999994, 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028365973999999999, 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:23.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822619+0000", 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.127e-06 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822630+0000", 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0560000000000001e-05 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822650+0000", 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9924000000000001e-05 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822663+0000", 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3360000000000001e-05 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848504+0000", 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025840785000000002 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848552+0000", 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8109000000000003e-05 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850936+0000", 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023839260000000002 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850984+0000", 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8183000000000003e-05 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.648 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11074 4.17 e69/16 4:eb7482bf:::1000000107a.00000000:head v 69'290, mlcod=69'288)", 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7621012280000006, 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028062648999999999, 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822706+0000", 2024-04-18T21:07:23.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2740000000000002e-06 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822723+0000", 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7297999999999999e-05 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822733+0000", 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848998+0000", 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026265101999999999 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849034+0000", 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6208000000000003e-05 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850704+0000", 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00167005 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850760+0000", 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6314999999999999e-05 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11094 3.14 3:2e600548:::200.0000001a:head [write 887300~13362 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7605366099999991, 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027388409999999998, 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824264+0000", 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6530000000000001e-06 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824299+0000", 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4866999999999997e-05 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824317+0000", 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8502e-05 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824327+0000", 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0002e-05 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824409+0000", 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1372999999999995e-05 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824559+0000", 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015085899999999999 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824739+0000", 2024-04-18T21:07:23.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946800000000001 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849612+0000", 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024873540999999999 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851509+0000", 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001896911 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851593+0000", 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4071000000000002e-05 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851651+0000", 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7163000000000001e-05 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11082 4.1e e69/16 4:7b9c1f9d:::10000001082.00000000:head v 69'274, mlcod=69'272)", 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7601704130000009, 2024-04-18T21:07:23.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027966749999999999, 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824629+0000", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8800000000000003e-07 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824634+0000", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.541e-06 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824646+0000", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1596999999999999e-05 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824658+0000", 2024-04-18T21:07:23.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2186e-05 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849556+0000", 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024897433 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849583+0000", 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7302999999999999e-05 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852550+0000", 2024-04-18T21:07:23.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029666750000000002 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852595+0000", 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5527e-05 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11091 4.1e e69/16 4:78ff2234:::1000000108b.00000000:head v 69'275, mlcod=69'272)", 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7598108410000002, 2024-04-18T21:07:23.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027645717, 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:23.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824990+0000", 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2840000000000001e-06 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825001+0000", 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0733999999999999e-05 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825015+0000", 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3551e-05 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825028+0000", 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2976000000000001e-05 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849960+0000", 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024932826000000002 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849981+0000", 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1056999999999998e-05 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852598+0000", 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026168189999999998 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852634+0000", 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5469999999999998e-05 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.666 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11093 4.16 e69/16 4:6b341212:::1000000108d.00000000:head v 69'298, mlcod=69'296)", 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7595152840000008, 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027628203, 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825285+0000", 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.88e-06 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825294+0000", 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825306+0000", 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1504e-05 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825315+0000", 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7799999999999995e-06 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850301+0000", 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024985411999999999 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850322+0000", 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1297e-05 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852862+0000", 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002539758 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852912+0000", 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9908999999999999e-05 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.670 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:23.671 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:23.671 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:23.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:23.673 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:23.669+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:23.773 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:23.770+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:23.804 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:23.805 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:23.805 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:07:23.805 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:23.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:23.826 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T21:07:23.845 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:07:23.874 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:23.877+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:23.940 INFO:teuthology.orchestra.run.smithi096.stderr:set 4.7 pg_upmap mapping to [2,1] 2024-04-18T21:07:23.959 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:07:23.975 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:23.975+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:23.991 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:23.991 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:24.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:24.076 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:24.073+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:24.127 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-18T21:07:24.131 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.538069919000002, 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:24.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:24.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.525205698999997, 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.524404228999998, 2024-04-18T21:07:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.523630523999998, 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.516384960000003, 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.513318300000002, 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.495473595, 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.494634554999998, 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.490280875000003, 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.489512562999998, 2024-04-18T21:07:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.486162958999998, 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.472686981999999, 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.471033478000003, 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.467902709000001, 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.440589998, 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.439217571999997, 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.256010793000002, 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.723350242999999, 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.718664993000001, 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.717977332, 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:24.254 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:24.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:07:24.256 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:24.257 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:24.257+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:24.356 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:24.355+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:24.387 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:24.387 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:24.387 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:07:24.387 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:24.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:24.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:24.458+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:24.526 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T21:07:24.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:07:24.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:24.558+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:24.565 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:24.566 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:24.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:24.658 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:24.659+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:24.703 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.096055798000002, 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.092546542000001, 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.079353339999997, 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.062166136000002, 2024-04-18T21:07:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.058752022, 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.057898506999997, 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.055361824999999, 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.040629609, 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.038169777999997, 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.032250752000003, 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:24.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:24.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.764 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.025521857999998, 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:24.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.970839808999997, 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:24.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:24.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.941253355999997, 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:24.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:24.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.930069226999997, 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.929775036000002, 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:24.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.927134508000002, 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:24.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.918852913000002, 2024-04-18T21:07:24.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.731935587000002, 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:24.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:24.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:24.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.730947819000001, 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:24.810 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:24.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:24.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.815 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.726643375000002, 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:24.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:24.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:24.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:24.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:24.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.821 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:24.821 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:24.821 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:24.822 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:24.823+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:24.822 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:24.823 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T21:07:24.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T21:07:24.923 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:24.921+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:24.960 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:24.969 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:25.057 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:25.057+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:25.086 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:25.086 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:25.105 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:25.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:25.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:25.126+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:25.132 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:25.132 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:25.146 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:25.152 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-18T21:07:25.170 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2024-04-18T21:07:25.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:25.170 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-18T21:07:25.226 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:25.223+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:25.226 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:07:25.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[22872]: fuse finished with error 0 and tester_r 0 2024-04-18T21:07:25.323 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:25.323 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:25.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:25.322+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:25.338 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:25.427 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:25.427+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:25.474 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:25.474 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:25.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:25.528 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:25.527+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:25.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:25.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:25.666+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:25.729 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:25.729+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:25.738 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:25.739 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:25.753 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:25.830 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:25.827+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:25.885 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:25.885 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:25.901 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:25.946 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:25.947+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:26.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:26.034+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.083 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:26.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:26.134+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:26.200 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.200 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.215 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:26.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:26.234+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:26.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:26.334+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:26.347 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.347 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.362 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:26.436 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:26.435+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:26.482 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.482 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.497 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:26.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:26.538+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:26.618 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.619 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:26.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:26.678+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:26.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:26.738+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:26.764 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.764 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:26.839 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:26.839+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:26.941 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:26.943+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:26.944 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.944 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:26.973 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:07:27.041 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:27.043+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:27.076 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.076 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:27.141 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:27.142 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:27.141+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:27.221 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.221 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:27.282 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:27.282 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:27.283 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:27.283+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:27.303 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:27.324 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:27.343 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:27.343+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:27.353 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:27.353 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:27.353 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:27.354 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:27.354 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:27.368 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:27.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:27.442+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:27.538 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.928734016, 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.925224759999999, 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.912031558000002, 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.894844354, 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:27.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:27.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.568 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.891430239999998, 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.569 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:27.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:27.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:27.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.890576725000003, 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:27.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:27.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.888040042999997, 2024-04-18T21:07:27.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:27.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:27.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.873307826999998, 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.591 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:27.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.870847996000002, 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:27.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:27.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:27.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.606 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.864928970000001, 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.612 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.858200076000003, 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:27.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.803518027000003, 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.619 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:27.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:27.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:27.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:27.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.773931574000002, 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:27.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:27.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.762747445000002, 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:27.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:27.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:27.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.762453254, 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.759812726, 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.751531131, 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:27.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:27.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:27.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:27.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:27.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.564613805, 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:27.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.563626036999999, 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:27.664 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.559321593, 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:27.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:27.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:27.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:27.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:27.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:27.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:27.670 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:27.671 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:27.671+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:27.672 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:27.772 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:27.775+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:27.802 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:27.802 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:27.802 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:07:27.803 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:27.816 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:27.873 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:27.875+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:27.938 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:27.938 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:07:27.938 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-04-18T21:07:27.938 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-04-18T21:07:27.938 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:27.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:27.973 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:27.975+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:27.976 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-18T21:07:28.072 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:07:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-04-18T21:07:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-04-18T21:07:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-04-18T21:07:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 139.474954873, 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027258339999999999, 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597198+0000", 2024-04-18T21:07:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597200+0000", 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2100000000000001e-06 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597208+0000", 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5529999999999993e-06 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597228+0000", 2024-04-18T21:07:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9830000000000002e-05 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597243+0000", 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4479e-05 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612124+0000", 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014881435 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.612346+0000", 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022161199999999999 2024-04-18T21:07:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.613953+0000", 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001607764 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618496+0000", 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004542819 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624239+0000", 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057425339999999997 2024-04-18T21:07:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624368+0000", 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000129092 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624457+0000", 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9011999999999994e-05 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:28.077 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 139.47489078800001, 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027399392000000002, 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597263+0000", 2024-04-18T21:07:28.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597264+0000", 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597271+0000", 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3900000000000004e-06 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597289+0000", 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8233e-05 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597308+0000", 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8923000000000002e-05 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.614744+0000", 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017436112 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615062+0000", 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000317647 2024-04-18T21:07:28.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.615370+0000", 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0003078 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.618741+0000", 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033710739999999999 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624558+0000", 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058167039999999998 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624619+0000", 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1372999999999997e-05 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624662+0000", 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2976000000000003e-05 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 139.47480519000001, 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027619385, 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597348+0000", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597349+0000", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1170000000000001e-06 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597356+0000", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.63e-06 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597378+0000", 2024-04-18T21:07:28.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1702999999999999e-05 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.597393+0000", 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5345999999999998e-05 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617362+0000", 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019969163000000002 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617568+0000", 2024-04-18T21:07:28.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000205856 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.617953+0000", 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000384702 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.619987+0000", 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020346539999999999 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624761+0000", 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047739330000000002 2024-04-18T21:07:28.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624879+0000", 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118212 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:05:08.624968+0000", 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8069e-05 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.087 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4707.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 49.634963738000003, 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031240667999999999, 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4707", 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 4 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:28.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437190+0000", 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.437194+0000", 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2470000000000002e-06 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443720+0000", 2024-04-18T21:07:28.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065263430000000004 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443745+0000", 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4922999999999998e-05 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443757+0000", 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1956999999999999e-05 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443846+0000", 2024-04-18T21:07:28.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8585000000000007e-05 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.443932+0000", 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6082999999999996e-05 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.444055+0000", 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123559 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:28.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.459931+0000", 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015875284999999999 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468263+0000", 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083327880000000007 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468356+0000", 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2145000000000006e-05 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:06:38.468430+0000", 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4752999999999994e-05 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13509 4.a e64/53 4:516d17a9:::100000031cd.00000000:head v 64'227, mlcod=63'225)", 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.129984007000001, 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027451293000000002, 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942169+0000", 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.942171+0000", 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.474e-06 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953129+0000", 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010957819000000001 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953153+0000", 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4579e-05 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953167+0000", 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4035e-05 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953328+0000", 2024-04-18T21:07:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016063500000000001 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953398+0000", 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9836e-05 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969565+0000", 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016167302000000001 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.969621+0000", 2024-04-18T21:07:28.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5612999999999998e-05 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13519 4.39 e64/53 4:9ed2d522:::10000003260.00000002:head v 64'198, mlcod=63'196)", 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.118223119, 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033726636999999997, 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953930+0000", 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.953932+0000", 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.291e-06 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967697+0000", 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013765433000000001 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967726+0000", 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9388000000000001e-05 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967743+0000", 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6806000000000001e-05 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967908+0000", 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016463400000000001 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.967972+0000", 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4473000000000004e-05 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987612+0000", 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019639383 2024-04-18T21:07:28.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:00.987657+0000", 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5228999999999997e-05 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13979 4.5 e64/53 4:a10b49d7:::10000003367.00000000:head v 64'191, mlcod=63'189)", 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.622120293999998, 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028637540999999999, 2024-04-18T21:07:28.101 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450033+0000", 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.450035+0000", 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.843e-06 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459630+0000", 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095948960000000003 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459667+0000", 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7570000000000001e-05 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459681+0000", 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.403e-05 2024-04-18T21:07:28.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459850+0000", 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168312 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.459916+0000", 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6759000000000002e-05 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478422+0000", 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018505035999999999 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.478671+0000", 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024909500000000001 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:13992 4.26 e64/16 4:651b4d08:::1000000358f.00000000:head v 64'229, mlcod=64'227)", 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.596582918999999, 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.038810419999999998, 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475570+0000", 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.475571+0000", 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8400000000000003e-07 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486463+0000", 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010891792000000001 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486485+0000", 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2336000000000001e-05 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486500+0000", 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4326e-05 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486601+0000", 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010138599999999999 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486640+0000", 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.913e-05 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514293+0000", 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027652427 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.514381+0000", 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8239000000000007e-05 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14000 4.1e e64/16 4:78d9e0f9:::10000003739.00000000:head v 64'190, mlcod=64'188)", 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.585450546000001, 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029533159999999999, 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.109 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.486703+0000", 2024-04-18T21:07:28.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7400000000000003e-07 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492156+0000", 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054527330000000004 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492197+0000", 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1183999999999997e-05 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492212+0000", 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492387+0000", 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017543499999999999 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.492456+0000", 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8873000000000003e-05 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516069+0000", 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023613505999999999 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.516236+0000", 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016654199999999999 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14050 4.2 e64/16 4:41189c8a:::10000003294.00000001:head v 64'170, mlcod=64'168)", 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.518314209, 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027698317, 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553839+0000", 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.553841+0000", 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.03e-06 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.565981+0000", 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012139741000000001 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566009+0000", 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7636000000000001e-05 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566032+0000", 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2989999999999998e-05 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566179+0000", 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014699900000000001 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.566277+0000", 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8468999999999995e-05 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581479+0000", 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015202324 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.581537+0000", 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8128000000000003e-05 2024-04-18T21:07:28.116 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14192 4.26 e64/16 4:679d829b:::100000033cc.00000000:head v 64'232, mlcod=64'230)", 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.365477765000001, 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033520197000000002, 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.706676+0000", 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717216+0000", 2024-04-18T21:07:28.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010539043 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717234+0000", 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8320000000000001e-05 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717246+0000", 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2252000000000001e-05 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717406+0000", 2024-04-18T21:07:28.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000160218 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.717832+0000", 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042561600000000003 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740149+0000", 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022317370999999999 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:01.740196+0000", 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6480000000000002e-05 2024-04-18T21:07:28.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14615 4.a e64/53 4:51f0a183:::10000003900.00000000:head v 64'240, mlcod=64'238)", 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.800994481, 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028691112000000001, 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271159+0000", 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.271160+0000", 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3370000000000001e-06 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281376+0000", 2024-04-18T21:07:28.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010216161 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281395+0000", 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8661999999999999e-05 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281412+0000", 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6711999999999999e-05 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281525+0000", 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113577 2024-04-18T21:07:28.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.281568+0000", 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2576e-05 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299763+0000", 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018194897000000002 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.299850+0000", 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7189999999999997e-05 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.124 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4707.0:14665 4.b e64/16 4:d1ba6b2c:::1000000348d.00000000:head v 64'217, mlcod=64'215)", 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.748141074999999, 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032118024000000002, 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324012+0000", 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.324014+0000", 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4419999999999999e-06 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330807+0000", 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067932349999999999 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330828+0000", 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1132e-05 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330838+0000", 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5920000000000007e-06 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.330957+0000", 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011977 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.331028+0000", 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0859999999999996e-05 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.355918+0000", 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024889207 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:02.356130+0000", 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021278599999999999 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11068 4.2c e69/53 4:357a8b3d:::10000001074.00000000:head v 69'304, mlcod=69'302)", 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.250737852, 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028186011, 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821416+0000", 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821417+0000", 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.198e-06 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821427+0000", 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0155e-05 2024-04-18T21:07:28.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821443+0000", 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6124e-05 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821457+0000", 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4377e-05 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821604+0000", 2024-04-18T21:07:28.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014668099999999999 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.821639+0000", 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4907999999999998e-05 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849548+0000", 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027908911000000002 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849602+0000", 2024-04-18T21:07:28.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3656999999999998e-05 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11073 4.3c e69/53 4:3cac0111:::10000001079.00000000:head v 69'282, mlcod=69'277)", 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.249535128, 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028365973999999999, 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822618+0000", 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822619+0000", 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.127e-06 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822630+0000", 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0560000000000001e-05 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822650+0000", 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9924000000000001e-05 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822663+0000", 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3360000000000001e-05 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848504+0000", 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025840785000000002 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848552+0000", 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8109000000000003e-05 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850936+0000", 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023839260000000002 2024-04-18T21:07:28.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850984+0000", 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8183000000000003e-05 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11074 4.17 e69/16 4:eb7482bf:::1000000107a.00000000:head v 69'290, mlcod=69'288)", 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.249455770999999, 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028062648999999999, 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.137 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822698+0000", 2024-04-18T21:07:28.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822706+0000", 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2740000000000002e-06 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822723+0000", 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7297999999999999e-05 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.822733+0000", 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.848998+0000", 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026265101999999999 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849034+0000", 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6208000000000003e-05 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850704+0000", 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00167005 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850760+0000", 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6314999999999999e-05 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:11094 3.14 3:2e600548:::200.0000001a:head [write 887300~13362 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.247891152999999, 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027388409999999998, 2024-04-18T21:07:28.141 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824262+0000", 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824264+0000", 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6530000000000001e-06 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824299+0000", 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4866999999999997e-05 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824317+0000", 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8502e-05 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824327+0000", 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0002e-05 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824409+0000", 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1372999999999995e-05 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824559+0000", 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015085899999999999 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824739+0000", 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017946800000000001 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849612+0000", 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024873540999999999 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851509+0000", 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001896911 2024-04-18T21:07:28.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851593+0000", 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4071000000000002e-05 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.851651+0000", 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7163000000000001e-05 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.146 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11082 4.1e e69/16 4:7b9c1f9d:::10000001082.00000000:head v 69'274, mlcod=69'272)", 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.247524955999999, 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027966749999999999, 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824628+0000", 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824629+0000", 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8800000000000003e-07 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824634+0000", 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.541e-06 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824646+0000", 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1596999999999999e-05 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824658+0000", 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2186e-05 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849556+0000", 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024897433 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849583+0000", 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7302999999999999e-05 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852550+0000", 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029666750000000002 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852595+0000", 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5527e-05 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.150 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11091 4.1e e69/16 4:78ff2234:::1000000108b.00000000:head v 69'275, mlcod=69'272)", 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.247165384000001, 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027645717, 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:28.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824988+0000", 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.824990+0000", 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2840000000000001e-06 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825001+0000", 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0733999999999999e-05 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825015+0000", 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3551e-05 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825028+0000", 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2976000000000001e-05 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849960+0000", 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024932826000000002 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.849981+0000", 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1056999999999998e-05 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852598+0000", 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026168189999999998 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852634+0000", 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5469999999999998e-05 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.154 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:11093 4.16 e69/16 4:6b341212:::1000000108d.00000000:head v 69'298, mlcod=69'296)", 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.246869826999999, 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027628203, 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:28.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825284+0000", 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825285+0000", 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.88e-06 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825294+0000", 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:07:28.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825306+0000", 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1504e-05 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.825315+0000", 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7799999999999995e-06 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850301+0000", 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024985411999999999 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.850322+0000", 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1297e-05 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852862+0000", 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002539758 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-04-18T21:07:14.852912+0000", 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9908999999999999e-05 2024-04-18T21:07:28.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-18T21:07:28.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-18T21:07:28.159 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:07:28.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:28.161 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:28.157+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:28.261 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:28.259+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:28.293 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:28.293 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:07:28.293 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:28.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:28.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:28.358+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:28.428 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:28.428 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:28.428 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T21:07:28.428 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T21:07:28.428 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:28.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:28.463 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:28.463+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:28.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:28.562+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3050 4.1b 4:d8c98118:::10000000f43.00000000:head [write 0~8183] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.020471983, 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23509507099999999, 2024-04-18T21:07:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3050 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591460+0000", 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591462+0000", 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.483e-06 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591481+0000", 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591503+0000", 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2432000000000001e-05 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591515+0000", 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1617000000000001e-05 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591657+0000", 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014196 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.591699+0000", 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2132999999999998e-05 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819663+0000", 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22796456400000001 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.819846+0000", 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018270499999999999 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820035+0000", 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018938099999999999 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.823019+0000", 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029834219999999999 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826409+0000", 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033906940000000001 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826492+0000", 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2434000000000004e-05 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826555+0000", 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3329000000000003e-05 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3053 4.35 4:add7b7a8:::10000000f47.00000000:head [write 0~1307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.007607763000003, 2024-04-18T21:07:28.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.204320591, 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3053 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604324+0000", 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604327+0000", 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604342+0000", 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604385+0000", 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3028999999999997e-05 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604406+0000", 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1149999999999999e-05 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604537+0000", 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013061999999999999 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.604554+0000", 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801591+0000", 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.197036828 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.801852+0000", 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261575 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.802162+0000", 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030966400000000002 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807634+0000", 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054725720000000002 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808059+0000", 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000424492 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808157+0000", 2024-04-18T21:07:28.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808645+0000", 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048769200000000002 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3054 4.1b 4:d8bcaa75:::10000000f48.00000000:head [write 0~978] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.006806292999997, 2024-04-18T21:07:28.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.221667894, 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3054 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605126+0000", 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605128+0000", 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605139+0000", 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0926e-05 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605178+0000", 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8847000000000003e-05 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605192+0000", 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4739000000000001e-05 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605398+0000", 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020519599999999999 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605429+0000", 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1826000000000003e-05 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822011+0000", 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.216581199 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822178+0000", 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016704 2024-04-18T21:07:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822344+0000", 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016609400000000001 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.825631+0000", 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032871889999999998 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826628+0000", 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099672999999999993 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826738+0000", 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110172 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.826794+0000", 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5785999999999997e-05 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3055 4.38 4:1e3e8f29:::10000000f49.00000000:head [write 0~1023] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.006032587999997, 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.23994810999999999, 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3055 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605900+0000", 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605902+0000", 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3360000000000002e-06 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605914+0000", 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605939+0000", 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5913000000000001e-05 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.605953+0000", 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3315999999999999e-05 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606149+0000", 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019594 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.606165+0000", 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6713000000000001e-05 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843176+0000", 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.237010216 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843257+0000", 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0915999999999996e-05 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843337+0000", 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0746000000000002e-05 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.844644+0000", 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001306476 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845798+0000", 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001154195 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845826+0000", 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7792000000000001e-05 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845848+0000", 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1871000000000001e-05 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3061 4.20 4:05897972:::10000000f4f.00000000:head [write 0~1015] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.998787024000002, 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.22540411399999999, 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3061 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613145+0000", 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613148+0000", 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4839999999999998e-06 2024-04-18T21:07:28.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613159+0000", 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613190+0000", 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0942999999999998e-05 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613204+0000", 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4222999999999999e-05 2024-04-18T21:07:28.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613354+0000", 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014975399999999999 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.613382+0000", 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8085e-05 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831734+0000", 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.21835184799999999 2024-04-18T21:07:28.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.831856+0000", 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122032 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.832062+0000", 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205849 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834858+0000", 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027959109999999999 2024-04-18T21:07:28.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838445+0000", 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035875170000000001 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838505+0000", 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9070999999999997e-05 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838549+0000", 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-18T21:07:28.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3064 4.2b 4:d4a82b0b:::10000000f52.00000000:head [write 0~980] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.995720364, 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.206741496, 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.645 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3064 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616212+0000", 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616214+0000", 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2299999999999998e-06 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616227+0000", 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3506000000000001e-05 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616253+0000", 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5945999999999999e-05 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616270+0000", 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6146000000000001e-05 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616404+0000", 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013444800000000001 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.616428+0000", 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3819e-05 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808661+0000", 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19223335799999999 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808924+0000", 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026276000000000001 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.809250+0000", 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032640000000000002 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.818407+0000", 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091570490000000004 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822865+0000", 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004457814 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822905+0000", 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0014e-05 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.822953+0000", 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8006000000000001e-05 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3081 4.a 4:5243d446:::10000000f65.00000000:head [write 0~1395] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.977875658999999, 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17372975700000001, 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3081 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634056+0000", 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634059+0000", 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.119e-06 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634072+0000", 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3303e-05 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634098+0000", 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6420000000000001e-05 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634125+0000", 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6758999999999999e-05 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634266+0000", 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014102099999999999 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634299+0000", 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2910000000000002e-05 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.791765+0000", 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.157465575 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792086+0000", 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032194899999999998 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792359+0000", 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027216499999999999 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803920+0000", 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011560928999999999 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807699+0000", 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037797949999999999 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807749+0000", 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9604000000000001e-05 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807786+0000", 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7208e-05 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3082 4.39 4:9d9e0a25:::10000000f66.00000000:head [write 0~1492] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.977036619000003, 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16932892699999999, 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3082 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634895+0000", 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634898+0000", 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634911+0000", 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3073e-05 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634931+0000", 2024-04-18T21:07:28.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.982e-05 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.634943+0000", 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2802999999999999e-05 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635036+0000", 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2575e-05 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.635049+0000", 2024-04-18T21:07:28.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3305999999999999e-05 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.792880+0000", 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15783017499999999 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793133+0000", 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025352600000000001 2024-04-18T21:07:28.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.793417+0000", 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028392599999999999 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803869+0000", 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010452417 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803989+0000", 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119348 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804091+0000", 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010208300000000001 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804224+0000", 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133559 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3087 4.a 4:50ba186c:::10000000f6b.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.972682939000002, 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.168801427, 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3087 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639249+0000", 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639251+0000", 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.317e-06 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639264+0000", 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2686e-05 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639290+0000", 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5729999999999999e-05 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639309+0000", 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9208999999999999e-05 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639477+0000", 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168297 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.639515+0000", 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7141999999999998e-05 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794245+0000", 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15473089900000001 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794490+0000", 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024501299999999998 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794773+0000", 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028213700000000001 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804366+0000", 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095936619999999993 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807885+0000", 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035189869999999999 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.807973+0000", 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7365000000000001e-05 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.808051+0000", 2024-04-18T21:07:28.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7983000000000002e-05 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3088 4.39 4:9d717a3d:::10000000f6c.00000000:head [write 0~1382] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.971914626999997, 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16453863699999999, 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.670 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3088 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640017+0000", 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640025+0000", 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6629999999999993e-06 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640037+0000", 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640058+0000", 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0956000000000001e-05 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640074+0000", 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5566e-05 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640199+0000", 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012539800000000001 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.640216+0000", 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6526000000000001e-05 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794466+0000", 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15425003200000001 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794634+0000", 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016818700000000001 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.794864+0000", 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023035300000000001 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.803879+0000", 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090151759999999997 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804329+0000", 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000449667 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804467+0000", 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138021 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.804556+0000", 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9169e-05 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3092 4.3a 4:5e81e13c:::10000000f70.00000000:head [write 0~1431] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.968565022999996, 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19544801000000001, 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.676 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3092 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643367+0000", 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643369+0000", 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643381+0000", 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.133e-05 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643407+0000", 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6023000000000001e-05 2024-04-18T21:07:28.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643459+0000", 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2052000000000002e-05 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643620+0000", 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016112099999999999 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.643638+0000", 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8454999999999999e-05 2024-04-18T21:07:28.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834781+0000", 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19114241900000001 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.834948+0000", 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167625 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.835125+0000", 2024-04-18T21:07:28.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017703400000000001 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.837735+0000", 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026100400000000001 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838723+0000", 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098759600000000009 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838773+0000", 2024-04-18T21:07:28.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0351e-05 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.838815+0000", 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1758000000000002e-05 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3108 4.18 4:1b1c955e:::10000000f80.00000000:head [write 0~4325] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.955089045999998, 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17031323800000001, 2024-04-18T21:07:28.682 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3108 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656843+0000", 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656849+0000", 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2639999999999997e-06 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656864+0000", 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656884+0000", 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0415999999999999e-05 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.656899+0000", 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647000000000001e-05 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657043+0000", 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144404 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.657059+0000", 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5852999999999999e-05 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810247+0000", 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15318816099999999 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810691+0000", 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044361699999999999 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.810898+0000", 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020666799999999999 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820520+0000", 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096228870000000001 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827021+0000", 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065006899999999999 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827107+0000", 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5918e-05 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827156+0000", 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9283999999999998e-05 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3110 4.1a 4:5a43c913:::10000000f82.00000000:head [write 0~1463] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.953435542000001, 2024-04-18T21:07:28.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.17218286399999999, 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3110 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658497+0000", 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658498+0000", 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5230000000000001e-06 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658511+0000", 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3354e-05 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658529+0000", 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7773000000000001e-05 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658540+0000", 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658683+0000", 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014296400000000001 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.658715+0000", 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820721+0000", 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16200664100000001 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.820899+0000", 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017742699999999999 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.821105+0000", 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206181 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.827034+0000", 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059290549999999999 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.829814+0000", 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027798580000000001 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830613+0000", 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079868199999999999 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.830679+0000", 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6727e-05 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3113 4.30 4:0d565732:::10000000f85.00000000:head [write 0~2201] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.694 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.950304772999999, 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472349799999999, 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3113 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:28.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661627+0000", 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661630+0000", 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661642+0000", 2024-04-18T21:07:28.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1989e-05 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661692+0000", 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661708+0000", 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5407e-05 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661848+0000", 2024-04-18T21:07:28.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014074000000000001 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.661879+0000", 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0564000000000001e-05 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852676+0000", 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19079700599999999 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852796+0000", 2024-04-18T21:07:28.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119929 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.852885+0000", 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9189000000000003e-05 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.854072+0000", 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011868149999999999 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856216+0000", 2024-04-18T21:07:28.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442610000000002 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856289+0000", 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2840000000000001e-05 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856351+0000", 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1935999999999998e-05 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.700 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3142 4.38 4:1cadba7f:::10000000fa4.00000000:head [write 0~33252] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.922992061999999, 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15996380700000001, 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3142 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688940+0000", 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688942+0000", 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1900000000000002e-06 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.688981+0000", 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9125999999999998e-05 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689007+0000", 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5896000000000001e-05 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689020+0000", 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3159000000000001e-05 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689116+0000", 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5921999999999994e-05 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.689133+0000", 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6833e-05 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843670+0000", 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.15453691899999999 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843804+0000", 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013347200000000001 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.843971+0000", 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016733399999999999 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.845899+0000", 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001928152 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848819+0000", 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002920401 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848853+0000", 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3504000000000003e-05 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.848904+0000", 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0899000000000002e-05 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:3143 4.30 4:0e14eda7:::10000000fa6.00000000:head [write 0~2402] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.921619636000003, 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16620509, 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3143 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690312+0000", 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690315+0000", 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.154e-06 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690326+0000", 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1289e-05 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690356+0000", 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0076000000000001e-05 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690370+0000", 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4477e-05 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690536+0000", 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016570300000000001 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.690555+0000", 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8783e-05 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853164+0000", 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.16260875499999999 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853310+0000", 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145966 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.853453+0000", 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014372699999999999 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.855201+0000", 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001747948 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856401+0000", 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011997819999999999 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856464+0000", 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3238000000000007e-05 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:42.856518+0000", 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3192000000000002e-05 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.712 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10786 4.3 4:c35dbe7f:::10000003151.00000000:head [write 174333~54500] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.738412857, 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80883325399999995, 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10786 2024-04-18T21:07:28.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873519+0000", 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873520+0000", 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7800000000000002e-07 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873552+0000", 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2097000000000001e-05 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873559+0000", 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5519999999999999e-06 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873563+0000", 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8399999999999997e-06 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873612+0000", 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9326000000000002e-05 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:56.873620+0000", 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2980000000000003e-06 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674112+0000", 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.80049197500000002 2024-04-18T21:07:28.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674277+0000", 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016566399999999999 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.674441+0000", 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163766 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682103+0000", 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076615320000000004 2024-04-18T21:07:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682253+0000", 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015051299999999999 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682306+0000", 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2395000000000002e-05 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682352+0000", 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6918e-05 2024-04-18T21:07:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10843 4.3 4:c0886fb9:::100000031a1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.205752307000001, 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28831848100000002, 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.719 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10843 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406180+0000", 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.406182+0000", 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0370000000000001e-06 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410817+0000", 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046346709999999999 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410834+0000", 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354e-05 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410842+0000", 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1669999999999999e-06 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411004+0000", 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016176600000000001 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411013+0000", 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6379999999999999e-06 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675479+0000", 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.26446523700000002 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675627+0000", 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148465 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.675779+0000", 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151757 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684027+0000", 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082484959999999993 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694377+0000", 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010349854 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694451+0000", 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4227000000000006e-05 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694498+0000", 2024-04-18T21:07:28.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6811999999999998e-05 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10844 4.3 4:c0886fb9:::100000031a1.00000000:head [write 142312~18744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.201067056999999, 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.28382919499999998, 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.725 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10844 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410865+0000", 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410866+0000", 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410883+0000", 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7703999999999999e-05 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410892+0000", 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3599999999999996e-06 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.410901+0000", 2024-04-18T21:07:28.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411168+0000", 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000267607 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411182+0000", 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3594000000000001e-05 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681221+0000", 2024-04-18T21:07:28.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27003928900000002 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681289+0000", 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7321000000000001e-05 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.681442+0000", 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153852 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-18T21:07:28.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.684164+0000", 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027211480000000001 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694570+0000", 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010406766 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694658+0000", 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7861000000000005e-05 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.694694+0000", 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6086e-05 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4707.0:10845 4.3 4:c35dbe7f:::10000003151.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.200379395999999, 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27108789100000003, 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T21:07:28.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4707", 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10845 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411553+0000", 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000003e-07 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411556+0000", 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5950000000000001e-06 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411564+0000", 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5250000000000005e-06 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411569+0000", 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4700000000000004e-06 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411608+0000", 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8980999999999998e-05 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.411614+0000", 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682390+0000", 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.27077633600000001 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682489+0000", 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8807000000000005e-05 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T21:06:57.682641+0000", 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151719 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T21:07:28.736 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T21:07:28.736 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:28.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:28.738 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:28.737+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:28.838 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:28.839+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:28.868 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:28.868 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-04-18T21:07:28.868 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:28.882 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:28.939 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:07:28.937+0000 7fbc2ad24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21592) UID: 0 2024-04-18T21:07:28.963 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:07:28.963 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:28.963 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-18T21:07:28.963 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:07:28.963 INFO:teuthology.orchestra.console.smithi111:Power off 2024-04-18T21:07:28.963 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T21:07:28.987 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-04-18T21:07:28.988 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:29.011 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-18T21:07:29.040 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:29.039+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:29.050 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:29.051 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:29.065 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:29.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:29.142+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:29.233 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.623637459999998, 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:29.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:29.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.620128203999997, 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.241 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:29.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:29.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.247 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.606935002, 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:29.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.253 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.589747797999998, 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.254 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.586333684000003, 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.260 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:29.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.585480169, 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.268 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:29.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:29.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.274 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.582943487000001, 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:29.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.568211271000003, 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.281 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:29.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:29.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.56575144, 2024-04-18T21:07:29.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:29.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:29.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:29.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:29.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.559832413999999, 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.297 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:29.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.303 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.553103520000001, 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:29.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:29.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.498421471, 2024-04-18T21:07:29.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:29.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:29.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.468835018, 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.317 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:29.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:29.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.323 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.457650889, 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:29.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:29.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.457356697999998, 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:29.329 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:29.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:29.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.335 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.454716169999998, 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.446434574999998, 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:29.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:29.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.259517248999998, 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:29.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:29.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.258529480999997, 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:29.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:29.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:29.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:29.359 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.254225036999998, 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:29.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:29.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:29.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:29.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:29.365 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:29.366 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:29.368 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:29.367+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:29.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:29.467 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:29.467+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:29.499 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T21:07:29.499 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T21:07:29.500 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T21:07:29.500 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T21:07:29.513 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:29.527 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:29.547 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:29.567 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:29.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:29.566+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:29.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:29.687 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:29.686+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:29.770 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:29.771+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:29.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:29.871 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:29.871+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:29.956 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:29.970 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:29.972 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:29.974+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.004 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:30.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:30.074+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.137 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:30.138 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:30.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:30.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:30.174+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:30.273 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:30.271+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:30.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:30.374 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:30.375+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:30.416 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:30.416 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:30.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:30.475 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:30.475+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:30.547 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:30.548 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:30.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:30.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:30.606+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:30.674+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:30.701 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:30.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:30.774+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.832 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:30.832 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:30.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:30.878 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:30.878+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.966 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:30.966 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:30.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:30.977+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:30.980 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:30.983 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:07:31.080 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:31.079+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:31.101 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.101 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:07:31.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:31.177+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:31.245 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.245 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:07:31.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-18T21:07:31.301+0000 7fb54571f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21625) UID: 0 2024-04-18T21:07:31.329 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T21:07:31.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:31.329 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-18T21:07:31.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:31.354 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-18T21:07:31.383 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:31.383+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:31.401 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T21:07:31.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:31.401 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:07:31.423 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.423 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:07:31.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:31.457 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-18T21:07:31.484 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:31.486+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:31.553 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.553 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.567 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:31.585 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:31.610 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-04-18T21:07:31.610+0000 7fdbad4d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21735) UID: 0 2024-04-18T21:07:31.642 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-18T21:07:31.650 INFO:tasks.thrashosds:joining thrashosds 2024-04-18T21:07:31.699 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.699 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-18T21:07:31.759 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-18T21:07:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:07:31.799 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-18T21:07:31.800 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:31.884 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:31.884 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-04-18T21:07:31.884 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-04-18T21:07:31.884 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-04-18T21:07:31.884 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:31.898 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:32.024 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-18T21:07:32.024 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-04-18T21:07:32.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-04-18T21:07:32.024 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3058 4.e 4:70d51104:::10000000f4c.00000000:head [write 0~1298] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.415024916, 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18711776099999999, 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3058 2024-04-18T21:07:32.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608428+0000", 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608430+0000", 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2529999999999999e-06 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608442+0000", 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1939999999999999e-05 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608469+0000", 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6869e-05 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608483+0000", 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4574e-05 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608659+0000", 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175885 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.608688+0000", 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8413000000000001e-05 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786392+0000", 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.177704642 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786644+0000", 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025202299999999998 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.786941+0000", 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029648599999999999 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794527+0000", 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075857900000000002 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795314+0000", 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078770100000000003 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795458+0000", 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014364 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795545+0000", 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7545000000000003e-05 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3060 4.32 4:4edbf81e:::10000000f4e.00000000:head [write 0~997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.411515659999999, 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.194408198, 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3060 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611937+0000", 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611939+0000", 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9429999999999999e-06 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611949+0000", 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0163000000000001e-05 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611974+0000", 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.474e-05 2024-04-18T21:07:32.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.611987+0000", 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-05 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612117+0000", 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013016199999999999 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.612146+0000", 2024-04-18T21:07:32.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9502999999999999e-05 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.800974+0000", 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.18882743699999999 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801233+0000", 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025913200000000003 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801544+0000", 2024-04-18T21:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000311453 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803775+0000", 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022303710000000001 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806150+0000", 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023753340000000002 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806238+0000", 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7936999999999995e-05 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806345+0000", 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107063 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3073 4.32 4:4f535c53:::10000000f5c.00000000:head [write 0~3941] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.398322458000003, 2024-04-18T21:07:32.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.183863148, 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3073 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625130+0000", 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625132+0000", 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625150+0000", 2024-04-18T21:07:32.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7586000000000001e-05 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625179+0000", 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8856e-05 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625212+0000", 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3436999999999999e-05 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625369+0000", 2024-04-18T21:07:32.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015731499999999999 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.625395+0000", 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5846e-05 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.803841+0000", 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.178446034 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804012+0000", 2024-04-18T21:07:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017108 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804151+0000", 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013899499999999999 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808727+0000", 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045758789999999997 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808840+0000", 2024-04-18T21:07:32.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112271 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808931+0000", 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1793999999999996e-05 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.808993+0000", 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1847999999999995e-05 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3091 4.e 4:71f2e80e:::10000000f6f.00000000:head [write 0~1424] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.381135254, 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15354066199999999, 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3091 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642317+0000", 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642319+0000", 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642331+0000", 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.187e-05 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642369+0000", 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7765999999999997e-05 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642389+0000", 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0000000000000002e-05 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642554+0000", 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016449800000000001 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.642570+0000", 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6473e-05 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.787795+0000", 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145225308 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788160+0000", 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036413400000000001 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.788888+0000", 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072836199999999998 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794541+0000", 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056528840000000004 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795655+0000", 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001114599 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795765+0000", 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010966199999999999 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795858+0000", 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2899000000000006e-05 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.049 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3095 4.e 4:713cc7f5:::10000000f73.00000000:head [write 0~2006] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.377721139999998, 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.15041621399999999, 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3095 2024-04-18T21:07:32.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645731+0000", 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645734+0000", 2024-04-18T21:07:32.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.176e-06 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645746+0000", 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2173e-05 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645776+0000", 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.989e-05 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645792+0000", 2024-04-18T21:07:32.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6286999999999998e-05 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645901+0000", 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010889499999999999 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.645920+0000", 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8953999999999998e-05 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790150+0000", 2024-04-18T21:07:32.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.144230109 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790456+0000", 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030631499999999998 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.790894+0000", 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043796500000000001 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.794552+0000", 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036581840000000001 2024-04-18T21:07:32.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795945+0000", 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001392739 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796061+0000", 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115553 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.796148+0000", 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6973999999999998e-05 2024-04-18T21:07:32.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3096 4.25 4:a41bac39:::10000000f74.00000000:head [write 0~1938] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.376867625000003, 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.20151286500000001, 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3096 2024-04-18T21:07:32.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646585+0000", 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646587+0000", 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1639999999999999e-06 2024-04-18T21:07:32.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646599+0000", 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2353e-05 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646630+0000", 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0722999999999997e-05 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646652+0000", 2024-04-18T21:07:32.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2007000000000001e-05 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646784+0000", 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013197799999999999 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.646804+0000", 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9383000000000001e-05 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843234+0000", 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.19643055400000001 2024-04-18T21:07:32.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843334+0000", 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010028 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843467+0000", 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132254 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845658+0000", 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002190956 2024-04-18T21:07:32.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848041+0000", 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023835219999999999 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848072+0000", 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0691000000000001e-05 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848098+0000", 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5999999999999998e-05 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.061 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3099 4.31 4:8cd33917:::10000000f77.00000000:head [write 0~1641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.374330942999997, 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.152957545, 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3099 2024-04-18T21:07:32.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649122+0000", 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649124+0000", 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4099999999999998e-06 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649137+0000", 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2516e-05 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649163+0000", 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6267000000000001e-05 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649182+0000", 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9366999999999999e-05 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649305+0000", 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012233900000000001 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.649340+0000", 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5719000000000001e-05 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795126+0000", 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145785684 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795335+0000", 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020906200000000001 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.795595+0000", 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000260408 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801871+0000", 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062759460000000001 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.801909+0000", 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7489e-05 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802004+0000", 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5630000000000004e-05 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802079+0000", 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4708000000000004e-05 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3116 4.32 4:4ce4e606:::10000000f88.00000000:head [write 0~1174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.359598726999998, 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.145432002, 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.068 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3116 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663854+0000", 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663856+0000", 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8899999999999999e-06 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663866+0000", 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0056e-05 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663888+0000", 2024-04-18T21:07:32.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2076e-05 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.663901+0000", 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2937e-05 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664030+0000", 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129412 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.664048+0000", 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.827e-05 2024-04-18T21:07:32.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.804783+0000", 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.140734268 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805083+0000", 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030065700000000002 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.805315+0000", 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000231974 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809099+0000", 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037837639999999998 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809127+0000", 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8218e-05 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809213+0000", 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5790000000000004e-05 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.809286+0000", 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2689999999999997e-05 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3119 4.3d 4:be0aadf8:::10000000f8b.00000000:head [write 0~1124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.357138896000002, 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.158816714, 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3119 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666314+0000", 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666316+0000", 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7999999999999999e-06 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666331+0000", 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666369+0000", 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506999999999999e-05 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666394+0000", 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5303000000000002e-05 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666533+0000", 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013848800000000001 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.666552+0000", 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9086999999999999e-05 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813695+0000", 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14714382400000001 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.813945+0000", 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024904199999999999 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.814268+0000", 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032389700000000002 2024-04-18T21:07:32.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.817435+0000", 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031668859999999998 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824935+0000", 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074996350000000002 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825049+0000", 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113627 2024-04-18T21:07:32.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825130+0000", 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800999999999998e-05 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3126 4.5 4:a08f2937:::10000000f92.00000000:head [write 0~2550] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.351219870000001, 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.135480876, 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3126 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672233+0000", 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672236+0000", 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0730000000000001e-06 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672250+0000", 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.397e-05 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672280+0000", 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672305+0000", 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5372999999999999e-05 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672431+0000", 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012514899999999999 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.672446+0000", 2024-04-18T21:07:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5549999999999999e-05 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798551+0000", 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.12610507000000001 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798872+0000", 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032132599999999998 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.799172+0000", 2024-04-18T21:07:32.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029928600000000001 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802525+0000", 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033533439999999999 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807496+0000", 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049707880000000003 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807628+0000", 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013175599999999999 2024-04-18T21:07:32.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.807714+0000", 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5925000000000001e-05 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3132 4.32 4:4d5a4bd1:::10000000f99.00000000:head [write 0~17019] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.344490976000003, 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.14531064199999999, 2024-04-18T21:07:32.086 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3132 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678962+0000", 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678963+0000", 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.204e-06 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.678985+0000", 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2039999999999999e-05 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679000+0000", 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5665999999999999e-05 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679011+0000", 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-05 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679136+0000", 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012508300000000001 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.679153+0000", 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6719e-05 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806425+0000", 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.127272468 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806582+0000", 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156556 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.806860+0000", 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027843099999999999 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.811719+0000", 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048583130000000004 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824124+0000", 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012405388 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824204+0000", 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0304999999999998e-05 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.824272+0000", 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7818999999999996e-05 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3168 4.31 4:8c3db50b:::10000000fc1.00000000:head [write 0~1716] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:32.092 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.289808927000003, 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068697910000000001, 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3168 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:32.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733644+0000", 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733645+0000", 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8169999999999999e-06 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733655+0000", 2024-04-18T21:07:32.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.893e-06 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733676+0000", 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0233000000000001e-05 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733693+0000", 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-05 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733832+0000", 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139522 2024-04-18T21:07:32.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.733853+0000", 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0533000000000001e-05 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797628+0000", 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.063775529999999997 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.797854+0000", 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022584100000000001 2024-04-18T21:07:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.798125+0000", 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027114499999999998 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802098+0000", 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039731870000000004 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802166+0000", 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7949999999999998e-05 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802270+0000", 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103303 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.802342+0000", 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1956e-05 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.098 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3188 4.3d 4:bdc9e0af:::10000000fd7.00000000:head [write 0~1832] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.260222474000003, 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062376133, 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3188 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:32.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763230+0000", 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763232+0000", 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763243+0000", 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1202999999999999e-05 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763268+0000", 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763287+0000", 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763418+0000", 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000131352 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.763443+0000", 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4576e-05 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815113+0000", 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051669682000000001 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815282+0000", 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016900800000000001 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.815454+0000", 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017256899999999999 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.819808+0000", 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043540000000000002 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825225+0000", 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054164299999999999 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825332+0000", 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106877 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.825606+0000", 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027460899999999999 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3197 4.25 4:a768b5f2:::10000000fe1.00000000:head [write 0~41337] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.249038345000002, 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073784732000000006, 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3197 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774414+0000", 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774416+0000", 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2340000000000001e-06 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774479+0000", 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2311999999999996e-05 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774506+0000", 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7593000000000002e-05 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774525+0000", 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9143999999999998e-05 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.843932+0000", 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.069406232999999998 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844184+0000", 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025268000000000003 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.844411+0000", 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022671599999999999 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845733+0000", 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001322007 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848142+0000", 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002408501 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848173+0000", 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1712999999999999e-05 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848199+0000", 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5599e-05 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3200 4.5 4:a1a952d2:::10000000fe4.00000000:head [write 0~20241] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.248744154000001, 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.073689143999999998, 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.110 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3200 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774708+0000", 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774710+0000", 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.26e-06 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774748+0000", 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7972999999999997e-05 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774768+0000", 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.774783+0000", 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4534e-05 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845731+0000", 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070947811999999999 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845922+0000", 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019095200000000001 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846157+0000", 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023594999999999999 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848306+0000", 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021484640000000001 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848338+0000", 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2162000000000001e-05 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848373+0000", 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5003999999999999e-05 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848398+0000", 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4450000000000001e-05 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3204 4.d 4:b11fe80e:::10000000fe8.00000000:head [write 0~1332] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.246103626, 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070927534, 2024-04-18T21:07:32.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3204 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777349+0000", 2024-04-18T21:07:32.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777351+0000", 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777363+0000", 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1905999999999999e-05 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777384+0000", 2024-04-18T21:07:32.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0962999999999999e-05 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.777397+0000", 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3036e-05 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.845973+0000", 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.068576421999999998 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846069+0000", 2024-04-18T21:07:32.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5455e-05 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846166+0000", 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7231999999999993e-05 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848132+0000", 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019664040000000002 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848206+0000", 2024-04-18T21:07:32.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3837000000000005e-05 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848247+0000", 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1331999999999997e-05 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848276+0000", 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8977000000000001e-05 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.120 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:3213 4.d 4:b3dfbb43:::10000000ff1.00000000:head [write 0~5000] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.237822031, 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.065192946000000002, 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3213 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:32.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785631+0000", 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785633+0000", 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2230000000000001e-06 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785654+0000", 2024-04-18T21:07:32.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1257e-05 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785708+0000", 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3696999999999998e-05 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.785726+0000", 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8005000000000001e-05 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846585+0000", 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060859657999999997 2024-04-18T21:07:32.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846690+0000", 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104277 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.846807+0000", 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011729499999999999 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.848966+0000", 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021591230000000002 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850756+0000", 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001790104 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850792+0000", 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6223999999999997e-05 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:42.850823+0000", 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1083e-05 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7566 4.15 4:ab681489:::10000002287.00000000:head [write 0~6193] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.050904705000001, 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.062700868000000007, 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7566 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972548+0000", 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972549+0000", 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6130000000000001e-06 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972561+0000", 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1566000000000001e-05 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972578+0000", 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6810999999999999e-05 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972588+0000", 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0261000000000001e-05 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972644+0000", 2024-04-18T21:07:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6375000000000001e-05 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972732+0000", 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7811000000000003e-05 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.972811+0000", 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8540000000000004e-05 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973442+0000", 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063138799999999998 2024-04-18T21:07:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.034898+0000", 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061455325999999998 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035139+0000", 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000241952 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035249+0000", 2024-04-18T21:07:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109225 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7567 4.19 4:98860628:::10000002288.00000000:head [write 0~2345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.049916936999999, 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.061959986000000002, 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7567 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973536+0000", 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973537+0000", 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973542+0000", 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973556+0000", 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3524e-05 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973564+0000", 2024-04-18T21:07:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2640000000000008e-06 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973619+0000", 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4970999999999999e-05 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973726+0000", 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010635 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.973831+0000", 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010534799999999999 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.974644+0000", 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081333399999999998 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035401+0000", 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.060756759 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035454+0000", 2024-04-18T21:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3062999999999997e-05 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.035496+0000", 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1572000000000001e-05 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4707.0:7571 4.6 4:6382b5ac:::1000000228c.00000000:head [write 0~6794] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.045612493, 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.059727875, 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-04-18T21:07:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4707", 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "192.168.0.1:0/2808124644", 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7571 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977840+0000", 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-04-18T21:07:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977841+0000", 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2099999999999995e-07 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977850+0000", 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977861+0000", 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1215e-05 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977868+0000", 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.977922+0000", 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4144000000000002e-05 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978036+0000", 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011360499999999999 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978142+0000", 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106901 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:48.978814+0000", 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067156300000000002 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037468+0000", 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.058653904 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037517+0000", 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9302999999999999e-05 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-04-18T21:06:49.037568+0000", 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0658000000000002e-05 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-18T21:07:32.141 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-18T21:07:33.010 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:33.012 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:33.122 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-18T21:07:34.023 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-18T21:07:34.048 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:07:35.034 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-18T21:07:35.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-18T21:07:37.123 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:37.233 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-18T21:07:41.234 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:41.344 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-18T21:07:41.446 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-04-18T21:07:41.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-18T21:07:46.547 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-18T21:07:46.547 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-18T21:07:46.548 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:07:46.548 INFO:teuthology.orchestra.console.smithi111:Power on 2024-04-18T21:07:46.548 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T21:07:46.571 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2024-04-18T21:07:46.571 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:46.593 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-18T21:07:47.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-18T21:07:50.593 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:50.703 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-18T21:07:50.804 INFO:teuthology.orchestra.console.smithi111:Power on completed 2024-04-18T21:07:50.905 DEBUG:teuthology.orchestra.console.smithi111:Waiting for login prompt 2024-04-18T21:07:50.906 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi111 2024-04-18T21:07:53.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~17s 2024-04-18T21:07:58.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-04-18T21:08:04.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-18T21:08:10.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-18T21:08:16.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-18T21:08:22.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2024-04-18T21:08:27.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~52s 2024-04-18T21:08:33.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2024-04-18T21:08:39.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-04-18T21:08:45.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-04-18T21:08:51.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2024-04-18T21:08:56.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~81s 2024-04-18T21:09:02.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~87s 2024-04-18T21:09:08.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2024-04-18T21:09:14.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-04-18T21:09:20.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-04-18T21:09:25.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-04-18T21:09:31.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2024-04-18T21:09:37.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2024-04-18T21:09:43.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-04-18T21:09:49.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~134s 2024-04-18T21:09:55.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~139s 2024-04-18T21:10:00.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2024-04-18T21:10:06.333 DEBUG:teuthology.orchestra.console.smithi111:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ct                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F CC 2F GUID: 00000000 0000 0000 0000 0CC47AD8A124 DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.111 MAS : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.111 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:cc:2f)... Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CC 2F GUID: 00000000 0000 0000 0000 0CC47AD8A124 CLIENT IP: 172.21.15.111 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   Configuring (net0 0c:c4:7a:8f:cc:2f).... Configuring (net0 0c:c4:7a:8f:cc:2f)..... PXE-E61: Media test failure, check cable   GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************  Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.     The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-102-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-102-generic (buildd@lcy02-amd64-080) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #112-Ubuntu SMP Tue Mar 5 16:50:32 UTC 2024 (Ubuntu 5.15.0-102.112-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f76000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.718 MHz processor [ 0.000418] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000599] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001895] last_pfn = 0x78ec4 max_arch_pfn = 0x400000000 [ 0.008263] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008277] Using GB pages for direct mapping [ 0.008416] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008422] ACPI: Early table checksum verification disabled [ 0.008425] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008429] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.008434] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008439] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008442] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.008444] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008447] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008450] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008453] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008456] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008458] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008461] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008464] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008467] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008470] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008473] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008475] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008478] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008481] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008484] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008487] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008489] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008492] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.008493] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.008495] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.008496] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.008497] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.008498] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.008498] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.008499] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.008500] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.008501] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.008502] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.008503] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.008504] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.008505] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.008506] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.008507] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.008508] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.008509] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.008510] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.008511] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.008606] No NUMA configuration found [ 0.008607] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008616] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008947] Zone ranges: [ 0.008948] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008950] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008952] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008953] Device empty [ 0.008954] Movable zone start for each node [ 0.008957] Early memory node ranges [ 0.008958] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008959] node 0: [mem 0x0000000000100000-0x0000000078ec3fff] [ 0.008961] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008965] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008969] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009004] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.078038] On node 0, zone Normal: 28988 pages in unavailable ranges [ 0.078153] ACPI: PM-Timer IO Port: 0x408 [ 0.078160] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.078162] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.078163] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.078164] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.078165] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.078165] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.078166] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.078167] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.078177] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.078181] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.078183] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.078185] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.078189] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.078191] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.078195] TSC deadline timer available [ 0.078196] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.078206] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.078208] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.078209] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.078210] PM: hibernation: Registered nosave memory: [mem 0x78ec4000-0x78f75fff] [ 0.078211] PM: hibernation: Registered nosave memory: [mem 0x78f76000-0x798affff] [ 0.078212] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.078213] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.078214] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.078215] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.078216] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.078216] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.078218] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.078220] Booting paravirtualized kernel on bare hardware [ 0.078222] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.078229] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.078435] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.078465] Built 1 zonelists, mobility grouping on. Total pages: 8228744 [ 0.078467] Policy zone: Normal [ 0.078468] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.078526] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic", will be passed to user space. [ 0.080674] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.081816] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.081904] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.166243] Memory: 32672712K/33438008K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765036K reserved, 0K cma-reserved) [ 0.166527] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.166542] Kernel/User page tables isolation: enabled [ 0.166572] ftrace: allocating 50694 entries in 199 pages [ 0.186397] ftrace: allocated 199 pages with 5 groups [ 0.186512] rcu: Hierarchical RCU implementation. [ 0.186513] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.186515] Rude variant of Tasks RCU enabled. [ 0.186515] Tracing variant of Tasks RCU enabled. [ 0.186516] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.186517] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.189929] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.190127] random: crng init done [ 0.195045] Console: colour VGA+ 80x25 [ 0.206319] printk: console [tty0] enabled [ 1.177607] printk: console [ttyS1] enabled [ 1.181866] ACPI: Core revision 20210730 [ 1.186034] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.195267] APIC: Switch to symmetric I/O mode setup [ 1.200312] DMAR: Host address width 46 [ 1.204221] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.209609] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.217701] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.224041] DMAR: ATSR flags: 0x0 [ 1.228520] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.234857] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.241280] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.247702] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.253169] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.253170] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.268348] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.273723] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.280028] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.303275] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272464c153, max_idle_ns: 440795289617 ns [ 1.313888] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.43 BogoMIPS (lpj=13998872) [ 1.317903] CPU0: Thermal monitoring enabled (TM1) [ 1.321939] process: using mwait in idle threads [ 1.325887] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.329886] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.333888] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.337886] Spectre V2 : Mitigation: Retpolines [ 1.341886] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.345886] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.349886] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.353886] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.357886] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.361886] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.365889] MDS: Mitigation: Clear CPU buffers [ 1.369886] TAA: Mitigation: Clear CPU buffers [ 1.373886] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.377891] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.381886] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.385886] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.389886] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.393886] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.415439] Freeing SMP alternatives memory: 44K [ 1.417887] pid_max: default: 32768 minimum: 301 [ 1.421907] LSM: Security Framework initializing [ 1.425894] landlock: Up and running. [ 1.429886] Yama: becoming mindful. [ 1.433903] AppArmor: AppArmor initialized [ 1.437946] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.441925] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.446241] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.449891] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.453994] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.457887] ... version: 3 [ 1.461886] ... bit width: 48 [ 1.465886] ... generic registers: 4 [ 1.469886] ... value mask: 0000ffffffffffff [ 1.473886] ... max period: 00007fffffffffff [ 1.477886] ... fixed-purpose events: 3 [ 1.481886] ... event mask: 000000070000000f [ 1.485946] signal: max sigframe size: 1776 [ 1.489900] rcu: Hierarchical SRCU implementation. [ 1.494599] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.497950] smp: Bringing up secondary CPUs ... [ 1.501966] x86: Booting SMP configuration: [ 1.505888] .... node #0, CPUs: #1 #2 #3 #4 [ 1.513966] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.521886] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.525886] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.529983] #5 #6 #7 [ 1.530437] smp: Brought up 1 node, 8 CPUs [ 1.537888] smpboot: Max logical packages: 1 [ 1.541886] smpboot: Total of 8 processors activated (55995.48 BogoMIPS) [ 1.550020] devtmpfs: initialized [ 1.553300] x86/mm: Memory block size: 128MB [ 1.555486] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.557963] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.561896] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.565932] pinctrl core: initialized pinctrl subsystem [ 1.569977] PM: RTC time: 21:09:32, date: 2024-04-18 [ 1.573991] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.578217] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.582184] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.586217] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.589895] audit: initializing netlink subsys (disabled) [ 1.593903] audit: type=2000 audit(1713474571.356:1): state=initialized audit_enabled=0 res=1 [ 1.594000] thermal_sys: Registered thermal governor 'fair_share' [ 1.597888] thermal_sys: Registered thermal governor 'bang_bang' [ 1.601887] thermal_sys: Registered thermal governor 'step_wise' [ 1.605886] thermal_sys: Registered thermal governor 'user_space' [ 1.609886] thermal_sys: Registered thermal governor 'power_allocator' [ 1.613891] EISA bus registered [ 1.621102] cpuidle: using governor ladder [ 1.621888] cpuidle: using governor menu [ 1.625902] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.629887] ACPI: bus type PCI registered [ 1.633887] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.637941] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.641887] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.645899] PCI: Using configuration type 1 for base access [ 1.650903] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.653902] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.657887] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.661960] ACPI: Added _OSI(Module Device) [ 1.665888] ACPI: Added _OSI(Processor Device) [ 1.669893] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.673886] ACPI: Added _OSI(Processor Aggregator Device) [ 1.677886] ACPI: Added _OSI(Linux-Dell-Video) [ 1.681886] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.685886] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.736833] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.741214] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.746037] ACPI: Dynamic OEM Table Load: [ 1.777566] ACPI: Interpreter enabled [ 1.777897] ACPI: PM: (supports S0 S4 S5) [ 1.781886] ACPI: Using IOAPIC for interrupt routing [ 1.785910] HEST: Enabling Firmware First mode for corrected errors. [ 1.789964] HEST: Table parsing has been initialized. [ 1.794034] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.797888] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.801886] PCI: Using E820 reservations for host bridge windows [ 1.806575] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.843132] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.845889] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.851869] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.854931] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.857886] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.861918] PCI host bridge to bus 0000:ff [ 1.865887] pci_bus 0000:ff: root bus resource [bus ff] [ 1.869896] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.873952] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.877938] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.881937] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.885938] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.889944] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.893937] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.897938] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.901941] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.905936] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.909938] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.913937] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.917937] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.921939] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.925939] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.929938] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.933940] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.937936] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.941937] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.945911] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.950042] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.953990] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.957951] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.961950] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.965953] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.969950] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.973950] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.977939] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.981940] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.985951] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.989950] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.993951] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.997952] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.001939] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.005939] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.009938] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.013941] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.017950] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.021950] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.025951] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.029954] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.033943] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.037939] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.041940] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.045942] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.049939] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.053939] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.057940] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.061944] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.065941] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.069938] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.073938] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.077911] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.081939] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.085938] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.094313] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.097888] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.102228] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.106359] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.109886] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.114178] PCI host bridge to bus 0000:00 [ 2.117887] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.121886] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.125886] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.129886] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.133886] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.137886] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.141886] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.145993] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.150097] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.153953] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.158059] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.161951] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.166053] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.169951] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.174047] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.177905] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.182080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.185905] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.190078] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.193905] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.198078] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.201905] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.206077] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.209905] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.214083] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.217905] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.222078] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.225905] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.230078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.233906] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.238031] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.242107] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.246034] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.250056] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.253900] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.258126] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.262179] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.265908] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.269897] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.273897] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.277897] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.281897] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.285897] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.289926] pci 0000:00:11.4: PME# supported from D3hot [ 2.294041] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.297912] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.301962] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.306035] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.309912] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.313963] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.318031] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.321912] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.325963] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.330044] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.333909] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.337991] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.342047] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.345976] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.350048] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.353979] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.358048] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.361978] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.366056] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.369909] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.373991] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.378043] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.382162] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.385905] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.389896] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.393896] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.397896] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.401896] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.405896] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.409920] pci 0000:00:1f.2: PME# supported from D3hot [ 2.414030] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.417911] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.421917] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.426100] acpiphp: Slot [1] registered [ 2.429903] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.434065] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.437906] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.441927] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.445889] pci 0000:02:00.0: enabling Extended Tags [ 2.449991] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.453888] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.458067] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.461908] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.465895] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.469908] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.473896] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.477927] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.481907] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.485886] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.489899] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.493886] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.498048] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.501907] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.505895] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.509908] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.513895] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.517926] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.521903] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.525886] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.529898] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.533886] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.538019] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.541887] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.545887] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.549887] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.553916] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.557952] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.561975] pci 0000:05:00.0: enabling Extended Tags [ 2.565959] pci 0000:05:00.0: supports D1 D2 [ 2.569886] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.574074] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.577888] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.581887] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.585934] pci_bus 0000:06: extended config space not accessible [ 2.589917] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.593920] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.597903] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.601903] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.605970] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.609928] pci 0000:06:00.0: supports D1 D2 [ 2.613886] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.617998] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.621892] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.625889] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.629983] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.633913] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.637914] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.641900] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.646021] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.649924] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.653887] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.657912] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.661886] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.666062] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.669913] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.673914] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.677900] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.682016] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.685923] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.689886] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.693912] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.697886] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.702042] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.705888] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.709887] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.713890] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.718808] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.721936] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.725934] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.729934] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.733936] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.737886] ACPI: PCI: Interrupt link LNKE disabled [ 2.741934] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.745886] ACPI: PCI: Interrupt link LNKF disabled [ 2.749934] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.753886] ACPI: PCI: Interrupt link LNKG disabled [ 2.757934] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.761886] ACPI: PCI: Interrupt link LNKH disabled [ 2.766075] iommu: Default domain type: Translated [ 2.769887] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.774011] SCSI subsystem initialized [ 2.777895] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.781885] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.781886] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.785886] vgaarb: loaded [ 2.788665] ACPI: bus type USB registered [ 2.789896] usbcore: registered new interface driver usbfs [ 2.793890] usbcore: registered new interface driver hub [ 2.797891] usbcore: registered new device driver usb [ 2.801901] pps_core: LinuxPPS API ver. 1 registered [ 2.805886] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.809889] PTP clock support registered [ 2.813900] EDAC MC: Ver: 3.0.0 [ 2.817205] NetLabel: Initializing [ 2.817887] NetLabel: domain hash size = 128 [ 2.821886] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.825896] NetLabel: unlabeled traffic allowed by default [ 2.829896] PCI: Using ACPI for IRQ routing [ 2.839164] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.841886] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.847925] clocksource: Switched to clocksource tsc-early [ 2.860049] VFS: Disk quotas dquot_6.6.0 [ 2.864055] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.871097] AppArmor: AppArmor Filesystem Enabled [ 2.875895] pnp: PnP ACPI init [ 2.879476] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.885469] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.891454] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.897444] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.903430] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.909419] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.915400] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.922084] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.928769] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.935450] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.942132] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.948816] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.955497] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.962384] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.968370] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.974356] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.980337] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.986326] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.993273] pnp: PnP ACPI: found 5 devices [ 3.002788] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.011795] NET: Registered PF_INET protocol family [ 3.016907] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.026199] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.035023] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.043017] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.051426] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.058956] TCP: Hash tables configured (established 262144 bind 65536) [ 3.065782] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.073564] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.080590] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.088048] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.093782] NET: Registered PF_XDP protocol family [ 3.098659] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.110234] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.118147] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.123192] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.128230] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.135094] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.142746] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.150747] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.158485] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.166574] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.174226] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.182227] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.189967] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.198055] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.205707] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.213708] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.221448] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.229534] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.237186] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.245190] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.252926] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.261016] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.266044] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.272206] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.279061] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.286895] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.291943] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.296969] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.303133] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.309999] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.315292] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.321454] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.328319] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.336148] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.344071] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.351906] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.359828] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.364862] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.371024] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.377878] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.385714] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.391959] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.398209] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.412863] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.419801] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.426743] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.433686] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.440021] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.445661] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.451991] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.459301] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.464937] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.471268] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.476910] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.483246] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.488887] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.495223] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.502856] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.531916] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21270 usecs [ 3.559911] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 20014 usecs [ 3.567412] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.573966] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.573975] Trying to unpack rootfs image as initramfs... [ 3.580469] software IO TLB: mapped [mem 0x0000000074ec4000-0x0000000078ec4000] (64MB) [ 3.594423] Initialise system trusted keyrings [ 3.598950] Key type blacklist registered [ 3.603075] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.610551] zbud: loaded [ 3.613355] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.619423] fuse: init (API version 7.34) [ 3.623645] integrity: Platform Keyring initialized [ 3.636255] Key type asymmetric registered [ 3.640425] Asymmetric key parser 'x509' registered [ 3.645394] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.652928] io scheduler mq-deadline registered [ 3.657954] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.664000] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.670022] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.675999] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.681977] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.687937] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.693905] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.700815] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.706717] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.715183] ACPI: button: Power Button [PWRB] [ 3.719640] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.727152] ACPI: button: Power Button [PWRF] [ 3.732894] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.740474] pstore: Registered erst as persistent store backend [ 3.746594] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.773527] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.802443] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.812051] Linux agpgart interface v0.103 [ 3.817793] loop: module loaded [ 3.821233] tun: Universal TUN/TAP device driver, 1.6 [ 3.826374] PPP generic driver version 2.4.2 [ 3.830758] VFIO - User Level meta-driver version: 0.3 [ 3.836051] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.842653] ehci-pci: EHCI PCI platform driver [ 3.847322] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.852618] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.860114] ehci-pci 0000:00:1a.0: debug port 2 [ 3.868642] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.887798] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.893661] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.902020] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.909332] usb usb1: Product: EHCI Host Controller [ 3.914282] usb usb1: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 3.920795] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.925625] hub 1-0:1.0: USB hub found [ 3.927800] Freeing initrd memory: 65088K [ 3.929460] hub 1-0:1.0: 2 ports detected [ 3.937864] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.943156] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.950648] ehci-pci 0000:00:1d.0: debug port 2 [ 3.959155] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.979815] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.985657] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.994014] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.001326] usb usb2: Product: EHCI Host Controller [ 4.006267] usb usb2: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 4.012774] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.017567] hub 2-0:1.0: USB hub found [ 4.021389] hub 2-0:1.0: 2 ports detected [ 4.025583] ehci-platform: EHCI generic platform driver [ 4.030892] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.037139] ohci-pci: OHCI PCI platform driver [ 4.041668] ohci-platform: OHCI generic platform driver [ 4.046961] uhci_hcd: USB Universal Host Controller Interface driver [ 4.053428] i8042: PNP: No PS/2 controller found. [ 4.058259] mousedev: PS/2 mouse device common for all mice [ 4.063973] rtc_cmos 00:00: RTC can wake from S4 [ 4.068877] rtc_cmos 00:00: registered as rtc0 [ 4.073420] rtc_cmos 00:00: setting system clock to 2024-04-18T21:09:36 UTC (1713474576) [ 4.081617] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.088400] i2c_dev: i2c /dev entries driver [ 4.092904] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.105187] device-mapper: uevent: version 1.0.3 [ 4.109937] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.118479] platform eisa.0: Probing EISA bus 0 [ 4.123073] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.129926] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.136433] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.142942] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.149450] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.155960] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.162471] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.168978] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.175489] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.181998] platform eisa.0: EISA: Detected 0 cards [ 4.186950] intel_pstate: Intel P-state driver initializing [ 4.193648] ledtrig-cpu: registered to indicate activity on CPUs [ 4.199872] drop_monitor: Initializing network drop monitor service [ 4.206326] NET: Registered PF_INET6 protocol family [ 4.215857] Segment Routing with IPv6 [ 4.219586] In-situ OAM (IOAM) with IPv6 [ 4.223589] NET: Registered PF_PACKET protocol family [ 4.228758] Key type dns_resolver registered [ 4.233646] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.239647] microcode: Microcode Update Driver: v2.2. [ 4.239728] resctrl: L3 allocation detected [ 4.249086] resctrl: L3 monitoring detected [ 4.253339] IPI shorthand broadcast: enabled [ 4.257691] sched_clock: Marking stable (3209911390, 1047764676)->(5246447479, -988771413) [ 4.266287] registered taskstats version 1 [ 4.270625] Loading compiled-in X.509 certificates [ 4.275807] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.276040] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.292843] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.303080] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.313165] blacklist: Loading compiled-in revocation X.509 certificates [ 4.319947] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.329867] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.340398] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.351277] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.361808] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.363824] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.372614] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.390014] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.400929] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.412685] zswap: loaded using pool lzo/zbud [ 4.417378] Key type .fscrypt registered [ 4.421367] Key type fscrypt-provisioning registered [ 4.426450] pstore: Using crash dump compression: deflate [ 4.435880] Key type encrypted registered [ 4.439964] AppArmor: AppArmor sha1 policy hashing enabled [ 4.445526] ima: No TPM chip found, activating TPM-bypass! [ 4.451086] Loading compiled-in module X.509 certificates [ 4.451165] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.457008] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.464834] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.482647] ima: Allocated hash algorithm: sha1 [ 4.494458] ima: No architecture policies found [ 4.494578] hub 1-1:1.0: USB hub found [ 4.499076] evm: Initialising EVM extended attributes: [ 4.508119] evm: security.selinux [ 4.511500] evm: security.SMACK64 [ 4.514892] evm: security.SMACK64EXEC [ 4.518625] evm: security.SMACK64TRANSMUTE [ 4.518674] hub 1-1:1.0: 6 ports detected [ 4.522782] evm: security.SMACK64MMAP [ 4.522783] evm: security.apparmor [ 4.522783] evm: security.ima [ 4.522784] evm: security.capability [ 4.522784] evm: HMAC attrs: 0x1 [ 4.523062] PM: Magic number: 4:186:197 [ 4.544161] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.548246] acpi device:1b4: hash matches [ 4.556452] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.567839] acpi device:52: hash matches [ 4.571857] acpi PNP0100:00: hash matches [ 4.576124] hub 2-1:1.0: USB hub found [ 4.576132] RAS: Correctable Errors collector initialized. [ 4.585539] hub 2-1:1.0: 8 ports detected [ 4.590573] Freeing unused decrypted memory: 2036K [ 4.595787] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.595930] Freeing unused kernel image (initmem) memory: 3352K [ 4.602074] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.618250] clocksource: Switched to clocksource tsc [ 4.623799] Write protecting the kernel read-only data: 30720k [ 4.630118] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.637039] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.681823] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.688331] x86/mm: Checking user space page tables [ 4.730262] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.736774] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.900925] dca service started, version 1.12.1 [ 4.908478] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.916665] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.959979] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.965456] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.968167] scsi host0: ahci [ 4.974184] scsi host1: ahci [ 4.974319] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.977247] scsi host2: ahci [ 4.982427] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.985494] scsi host3: ahci [ 4.985566] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.986845] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.986846] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.993971] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.995864] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.001973] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.007459] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.016771] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.026009] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.028414] igb 0000:07:00.0: added PHC on eth0 [ 5.028443] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.028445] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:24 [ 5.028524] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.028525] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.033494] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.033681] nvme nvme0: pci function 0000:02:00.0 [ 5.036483] nvme nvme0: 8/0/0 default/read/poll queues [ 5.038784] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.046323] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.053997] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.061245] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.061247] usb usb3: Product: xHCI Host Controller [ 5.065848] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.072788] usb usb3: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.083111] igb 0000:07:00.1: added PHC on eth1 [ 5.085201] usb usb3: SerialNumber: 0000:00:14.0 [ 5.086548] hub 3-0:1.0: USB hub found [ 5.092887] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.093048] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.093049] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.099236] hub 3-0:1.0: 15 ports detected [ 5.103970] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:25 [ 5.111515] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.116725] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.125011] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.133282] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.140590] usb usb4: Product: xHCI Host Controller [ 5.148201] scsi host4: ahci [ 5.153203] usb usb4: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.159849] scsi host5: ahci [ 5.164309] usb usb4: SerialNumber: 0000:00:14.0 [ 5.169131] scsi host6: ahci [ 5.172970] hub 4-0:1.0: USB hub found [ 5.179866] scsi host7: ahci [ 5.185961] hub 4-0:1.0: 6 ports detected [ 5.191857] scsi host8: ahci [ 5.270568] scsi host9: ahci [ 5.273568] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 5.281054] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 5.288538] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 5.296018] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 5.303498] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 5.310977] ata10: SATA max UDMA/133 abar m2048@0xfb432000 porxfb432380 irq 63 [ 5.372221] ata3: SATA link down (SStatus 0 SControl 300) [ 5.377710] ata2: SATA link down (SStatus 0 SControl 300) [ 5.383212] ata4: SATA link down (SStatus 0 SControl 300) [ 5.388712] ata1: SATA link down (SStatus 0 SControl 300) [ 5.443823] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.600090] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.608478] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.616240] hub 3-12:1.0: USB hub found [ 5.620242] hub 3-12:1.0: 4 ports detected [ 5.628836] ata9: SATA link down (SStatus 0 SControl 300) [ 5.634351] ata10: SATA link down (SStatus 0 SControl 300) [ 5.639941] ata7: SATA link down (SStatus 0 SControl 300) [ 5.645445] ata6: SATA link down (SStatus 0 SControl 300) [ 5.650945] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.657219] ata8: SATA link down (SStatus 0 SControl 300) [ 5.662896] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.669763] ata5.00: NCQ Send/Recv Log not supported [ 5.674821] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.683320] ata5.00: NCQ Send/Recv Log not supported [ 5.688380] ata5.00: configured for UDMA/133 [ 5.692962] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.701484] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.701614] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.714632] sd 4:0:0:0: [sda] Write Protect is off [ 5.719502] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.737763] sda: sda1 [ 5.740329] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.746366] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.772212] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.931794] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.064163] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.072703] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.088369] hid: raw HID events driver (C) Jiri Kosina [ 6.096304] usbcore: registered new interface driver usbhid [ 6.101949] usbhid: USB HID core driver [ 6.108134] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.180006] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.191997] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.203894] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.276636] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.287038] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.303640] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.309894] ixgbe 0000:03:00.0: 0c:c4:7a:8f:cc:2e [ 6.319067] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.492551] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.502951] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.511577] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.518705] ixgbe 0000:03:00.1: 0c:c4:7a:8f:cc:2f [ 6.527813] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.536483] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.568200] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 198150/61054976 files, 6567679/244190336 blocks done. [ 13.672025] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.474859] systemd[1]: Inserted module 'autofs4' [ 14.592422] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.639965] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.687270] systemd[1]: Hostname set to . [ 15.974046] systemd[1]: Queued start job for default target Graphical Interface. [ 15.982767] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.004225] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.028484] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.051998] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.071998] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.096264] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.123965] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.151927] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.179914] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.207937] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.235908] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.263907] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.292003] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.315948] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.335974] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.360048] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.384171] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.410343] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.436182] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.456172] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.480076] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.504344] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.524140] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.544173] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.564276] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.588192] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.608116] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.629617] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.649602] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.673408] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.697575] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.717704] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.736605] RPC: Registered named UNIX socket transport module. [ 16.742607] RPC: Registered udp transport module. [ 16.747388] RPC: Registered tcp transport module. [ 16.752164] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.759991] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.779941] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.791224] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.812898] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.836664] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.865064] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 16.888606] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 16.908836] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.928549] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 16.952551] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 16.972518] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 16.996855] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.021496] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.039907] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.049848] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.072680] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules[[ 17.081288] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). 0m... [ 17.101333] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.124735] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.149757] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.166907] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debu[ 17.226955] lp: driver loaded but no devices found g File System. [ OK ] Mounted Kernel Trace File System. [ 17.253084] Loading iSCSI transport class v2.0-870. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mountin[ 17.485749] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS g FUSE Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.567130] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Set console font and keymap. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Finished Load AppArmor profiles. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. Starting Network Configuration... [ OK ] Started RPC bind portmap service. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started ifup for enp3s0f1. [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Started User Login Management. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] A start job is running for Raise network interfaces (7s / 5min 3s) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting NFS status monitor for NFSv2/3 locking.... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... + myips=172.21.15.111 + attempts=1 + sleep 1 [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. [ OK ] Finished Availability of block devices. Starting NFS server and services... [ OK ] Started Network Time Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.111 '!=' '' ']' + set -e + '[' -n 172.21.15.111 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.111 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.111 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi111.front.sepia.ceph.com + '[' -n smithi111.front.sepia.ceph.com ']' + hostname smithi111.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi111 + echo smithi111 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.111 smithi111.front.sepia.ceph.com smithi111/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started (i)SCSI target daemon. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Started The Apache HTTP Server. [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi111.front.sepia.ceph.com ttyS1 2024-04-18T21:10:06.334 DEBUG:teuthology.orchestra.console.smithi111:expect after: smithi111 login: 2024-04-18T21:10:06.388 DEBUG:teuthology.orchestra.console.smithi111:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ct                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F CC 2F GUID: 00000000 0000 0000 0000 0CC47AD8A124 DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.111 MAS : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.111 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:cc:2f)... Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CC 2F GUID: 00000000 0000 0000 0000 0CC47AD8A124 CLIENT IP: 172.21.15.111 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   Configuring (net0 0c:c4:7a:8f:cc:2f).... Configuring (net0 0c:c4:7a:8f:cc:2f)..... PXE-E61: Media test failure, check cable   GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************  Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.     The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-102-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-102-generic (buildd@lcy02-amd64-080) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #112-Ubuntu SMP Tue Mar 5 16:50:32 UTC 2024 (Ubuntu 5.15.0-102.112-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f76000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.718 MHz processor [ 0.000418] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000599] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001895] last_pfn = 0x78ec4 max_arch_pfn = 0x400000000 [ 0.008263] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008277] Using GB pages for direct mapping [ 0.008416] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008422] ACPI: Early table checksum verification disabled [ 0.008425] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008429] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.008434] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008439] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008442] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.008444] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008447] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008450] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008453] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008456] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008458] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008461] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008464] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008467] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008470] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008473] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008475] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008478] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008481] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008484] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008487] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008489] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008492] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.008493] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.008495] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.008496] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.008497] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.008498] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.008498] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.008499] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.008500] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.008501] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.008502] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.008503] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.008504] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.008505] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.008506] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.008507] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.008508] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.008509] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.008510] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.008511] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.008606] No NUMA configuration found [ 0.008607] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008616] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008947] Zone ranges: [ 0.008948] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008950] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008952] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008953] Device empty [ 0.008954] Movable zone start for each node [ 0.008957] Early memory node ranges [ 0.008958] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008959] node 0: [mem 0x0000000000100000-0x0000000078ec3fff] [ 0.008961] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008965] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008969] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009004] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.078038] On node 0, zone Normal: 28988 pages in unavailable ranges [ 0.078153] ACPI: PM-Timer IO Port: 0x408 [ 0.078160] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.078162] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.078163] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.078164] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.078165] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.078165] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.078166] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.078167] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.078177] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.078181] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.078183] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.078185] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.078189] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.078191] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.078195] TSC deadline timer available [ 0.078196] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.078206] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.078208] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.078209] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.078210] PM: hibernation: Registered nosave memory: [mem 0x78ec4000-0x78f75fff] [ 0.078211] PM: hibernation: Registered nosave memory: [mem 0x78f76000-0x798affff] [ 0.078212] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.078213] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.078214] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.078215] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.078216] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.078216] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.078218] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.078220] Booting paravirtualized kernel on bare hardware [ 0.078222] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.078229] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.078435] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.078465] Built 1 zonelists, mobility grouping on. Total pages: 8228744 [ 0.078467] Policy zone: Normal [ 0.078468] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.078526] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic", will be passed to user space. [ 0.080674] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.081816] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.081904] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.166243] Memory: 32672712K/33438008K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765036K reserved, 0K cma-reserved) [ 0.166527] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.166542] Kernel/User page tables isolation: enabled [ 0.166572] ftrace: allocating 50694 entries in 199 pages [ 0.186397] ftrace: allocated 199 pages with 5 groups [ 0.186512] rcu: Hierarchical RCU implementation. [ 0.186513] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.186515] Rude variant of Tasks RCU enabled. [ 0.186515] Tracing variant of Tasks RCU enabled. [ 0.186516] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.186517] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.189929] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.190127] random: crng init done [ 0.195045] Console: colour VGA+ 80x25 [ 0.206319] printk: console [tty0] enabled [ 1.177607] printk: console [ttyS1] enabled [ 1.181866] ACPI: Core revision 20210730 [ 1.186034] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.195267] APIC: Switch to symmetric I/O mode setup [ 1.200312] DMAR: Host address width 46 [ 1.204221] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.209609] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.217701] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.224041] DMAR: ATSR flags: 0x0 [ 1.228520] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.234857] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.241280] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.247702] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.253169] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.253170] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.268348] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.273723] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.280028] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.303275] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272464c153, max_idle_ns: 440795289617 ns [ 1.313888] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.43 BogoMIPS (lpj=13998872) [ 1.317903] CPU0: Thermal monitoring enabled (TM1) [ 1.321939] process: using mwait in idle threads [ 1.325887] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.329886] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.333888] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.337886] Spectre V2 : Mitigation: Retpolines [ 1.341886] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.345886] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.349886] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.353886] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.357886] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.361886] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.365889] MDS: Mitigation: Clear CPU buffers [ 1.369886] TAA: Mitigation: Clear CPU buffers [ 1.373886] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.377891] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.381886] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.385886] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.389886] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.393886] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.415439] Freeing SMP alternatives memory: 44K [ 1.417887] pid_max: default: 32768 minimum: 301 [ 1.421907] LSM: Security Framework initializing [ 1.425894] landlock: Up and running. [ 1.429886] Yama: becoming mindful. [ 1.433903] AppArmor: AppArmor initialized [ 1.437946] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.441925] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.446241] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.449891] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.453994] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.457887] ... version: 3 [ 1.461886] ... bit width: 48 [ 1.465886] ... generic registers: 4 [ 1.469886] ... value mask: 0000ffffffffffff [ 1.473886] ... max period: 00007fffffffffff [ 1.477886] ... fixed-purpose events: 3 [ 1.481886] ... event mask: 000000070000000f [ 1.485946] signal: max sigframe size: 1776 [ 1.489900] rcu: Hierarchical SRCU implementation. [ 1.494599] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.497950] smp: Bringing up secondary CPUs ... [ 1.501966] x86: Booting SMP configuration: [ 1.505888] .... node #0, CPUs: #1 #2 #3 #4 [ 1.513966] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.521886] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.525886] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.529983] #5 #6 #7 [ 1.530437] smp: Brought up 1 node, 8 CPUs [ 1.537888] smpboot: Max logical packages: 1 [ 1.541886] smpboot: Total of 8 processors activated (55995.48 BogoMIPS) [ 1.550020] devtmpfs: initialized [ 1.553300] x86/mm: Memory block size: 128MB [ 1.555486] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.557963] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.561896] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.565932] pinctrl core: initialized pinctrl subsystem [ 1.569977] PM: RTC time: 21:09:32, date: 2024-04-18 [ 1.573991] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.578217] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.582184] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.586217] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.589895] audit: initializing netlink subsys (disabled) [ 1.593903] audit: type=2000 audit(1713474571.356:1): state=initialized audit_enabled=0 res=1 [ 1.594000] thermal_sys: Registered thermal governor 'fair_share' [ 1.597888] thermal_sys: Registered thermal governor 'bang_bang' [ 1.601887] thermal_sys: Registered thermal governor 'step_wise' [ 1.605886] thermal_sys: Registered thermal governor 'user_space' [ 1.609886] thermal_sys: Registered thermal governor 'power_allocator' [ 1.613891] EISA bus registered [ 1.621102] cpuidle: using governor ladder [ 1.621888] cpuidle: using governor menu [ 1.625902] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.629887] ACPI: bus type PCI registered [ 1.633887] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.637941] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.641887] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.645899] PCI: Using configuration type 1 for base access [ 1.650903] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.653902] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.657887] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.661960] ACPI: Added _OSI(Module Device) [ 1.665888] ACPI: Added _OSI(Processor Device) [ 1.669893] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.673886] ACPI: Added _OSI(Processor Aggregator Device) [ 1.677886] ACPI: Added _OSI(Linux-Dell-Video) [ 1.681886] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.685886] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.736833] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.741214] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.746037] ACPI: Dynamic OEM Table Load: [ 1.777566] ACPI: Interpreter enabled [ 1.777897] ACPI: PM: (supports S0 S4 S5) [ 1.781886] ACPI: Using IOAPIC for interrupt routing [ 1.785910] HEST: Enabling Firmware First mode for corrected errors. [ 1.789964] HEST: Table parsing has been initialized. [ 1.794034] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.797888] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.801886] PCI: Using E820 reservations for host bridge windows [ 1.806575] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.843132] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.845889] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.851869] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.854931] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.857886] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.861918] PCI host bridge to bus 0000:ff [ 1.865887] pci_bus 0000:ff: root bus resource [bus ff] [ 1.869896] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.873952] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.877938] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.881937] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.885938] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.889944] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.893937] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.897938] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.901941] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.905936] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.909938] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.913937] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.917937] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.921939] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.925939] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.929938] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.933940] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.937936] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.941937] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.945911] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.950042] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.953990] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.957951] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.961950] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.965953] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.969950] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.973950] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.977939] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.981940] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.985951] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.989950] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.993951] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.997952] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.001939] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.005939] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.009938] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.013941] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.017950] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.021950] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.025951] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.029954] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.033943] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.037939] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.041940] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.045942] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.049939] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.053939] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.057940] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.061944] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.065941] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.069938] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.073938] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.077911] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.081939] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.085938] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.094313] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.097888] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.102228] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.106359] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.109886] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.114178] PCI host bridge to bus 0000:00 [ 2.117887] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.121886] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.125886] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.129886] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.133886] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.137886] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.141886] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.145993] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.150097] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.153953] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.158059] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.161951] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.166053] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.169951] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.174047] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.177905] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.182080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.185905] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.190078] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.193905] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.198078] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.201905] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.206077] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.209905] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.214083] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.217905] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.222078] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.225905] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.230078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.233906] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.238031] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.242107] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.246034] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.250056] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.253900] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.258126] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.262179] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.265908] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.269897] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.273897] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.277897] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.281897] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.285897] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.289926] pci 0000:00:11.4: PME# supported from D3hot [ 2.294041] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.297912] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.301962] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.306035] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.309912] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.313963] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.318031] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.321912] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.325963] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.330044] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.333909] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.337991] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.342047] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.345976] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.350048] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.353979] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.358048] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.361978] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.366056] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.369909] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.373991] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.378043] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.382162] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.385905] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.389896] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.393896] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.397896] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.401896] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.405896] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.409920] pci 0000:00:1f.2: PME# supported from D3hot [ 2.414030] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.417911] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.421917] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.426100] acpiphp: Slot [1] registered [ 2.429903] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.434065] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.437906] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.441927] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.445889] pci 0000:02:00.0: enabling Extended Tags [ 2.449991] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.453888] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.458067] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.461908] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.465895] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.469908] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.473896] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.477927] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.481907] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.485886] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.489899] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.493886] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.498048] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.501907] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.505895] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.509908] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.513895] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.517926] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.521903] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.525886] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.529898] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.533886] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.538019] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.541887] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.545887] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.549887] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.553916] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.557952] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.561975] pci 0000:05:00.0: enabling Extended Tags [ 2.565959] pci 0000:05:00.0: supports D1 D2 [ 2.569886] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.574074] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.577888] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.581887] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.585934] pci_bus 0000:06: extended config space not accessible [ 2.589917] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.593920] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.597903] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.601903] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.605970] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.609928] pci 0000:06:00.0: supports D1 D2 [ 2.613886] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.617998] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.621892] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.625889] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.629983] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.633913] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.637914] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.641900] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.646021] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.649924] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.653887] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.657912] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.661886] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.666062] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.669913] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.673914] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.677900] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.682016] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.685923] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.689886] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.693912] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.697886] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.702042] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.705888] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.709887] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.713890] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.718808] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.721936] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.725934] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.729934] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.733936] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.737886] ACPI: PCI: Interrupt link LNKE disabled [ 2.741934] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.745886] ACPI: PCI: Interrupt link LNKF disabled [ 2.749934] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.753886] ACPI: PCI: Interrupt link LNKG disabled [ 2.757934] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.761886] ACPI: PCI: Interrupt link LNKH disabled [ 2.766075] iommu: Default domain type: Translated [ 2.769887] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.774011] SCSI subsystem initialized [ 2.777895] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.781885] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.781886] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.785886] vgaarb: loaded [ 2.788665] ACPI: bus type USB registered [ 2.789896] usbcore: registered new interface driver usbfs [ 2.793890] usbcore: registered new interface driver hub [ 2.797891] usbcore: registered new device driver usb [ 2.801901] pps_core: LinuxPPS API ver. 1 registered [ 2.805886] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.809889] PTP clock support registered [ 2.813900] EDAC MC: Ver: 3.0.0 [ 2.817205] NetLabel: Initializing [ 2.817887] NetLabel: domain hash size = 128 [ 2.821886] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.825896] NetLabel: unlabeled traffic allowed by default [ 2.829896] PCI: Using ACPI for IRQ routing [ 2.839164] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.841886] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.847925] clocksource: Switched to clocksource tsc-early [ 2.860049] VFS: Disk quotas dquot_6.6.0 [ 2.864055] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.871097] AppArmor: AppArmor Filesystem Enabled [ 2.875895] pnp: PnP ACPI init [ 2.879476] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.885469] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.891454] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.897444] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.903430] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.909419] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.915400] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.922084] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.928769] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.935450] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.942132] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.948816] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.955497] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.962384] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.968370] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.974356] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.980337] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.986326] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.993273] pnp: PnP ACPI: found 5 devices [ 3.002788] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.011795] NET: Registered PF_INET protocol family [ 3.016907] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.026199] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.035023] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.043017] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.051426] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.058956] TCP: Hash tables configured (established 262144 bind 65536) [ 3.065782] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.073564] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.080590] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.088048] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.093782] NET: Registered PF_XDP protocol family [ 3.098659] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.110234] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.118147] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.123192] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.128230] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.135094] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.142746] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.150747] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.158485] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.166574] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.174226] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.182227] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.189967] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.198055] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.205707] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.213708] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.221448] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.229534] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.237186] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.245190] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.252926] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.261016] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.266044] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.272206] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.279061] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.286895] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.291943] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.296969] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.303133] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.309999] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.315292] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.321454] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.328319] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.336148] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.344071] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.351906] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.359828] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.364862] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.371024] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.377878] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.385714] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.391959] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.398209] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.412863] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.419801] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.426743] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.433686] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.440021] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.445661] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.451991] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.459301] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.464937] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.471268] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.476910] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.483246] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.488887] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.495223] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.502856] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.531916] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21270 usecs [ 3.559911] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 20014 usecs [ 3.567412] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.573966] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.573975] Trying to unpack rootfs image as initramfs... [ 3.580469] software IO TLB: mapped [mem 0x0000000074ec4000-0x0000000078ec4000] (64MB) [ 3.594423] Initialise system trusted keyrings [ 3.598950] Key type blacklist registered [ 3.603075] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.610551] zbud: loaded [ 3.613355] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.619423] fuse: init (API version 7.34) [ 3.623645] integrity: Platform Keyring initialized [ 3.636255] Key type asymmetric registered [ 3.640425] Asymmetric key parser 'x509' registered [ 3.645394] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.652928] io scheduler mq-deadline registered [ 3.657954] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.664000] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.670022] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.675999] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.681977] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.687937] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.693905] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.700815] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.706717] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.715183] ACPI: button: Power Button [PWRB] [ 3.719640] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.727152] ACPI: button: Power Button [PWRF] [ 3.732894] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.740474] pstore: Registered erst as persistent store backend [ 3.746594] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.773527] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.802443] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.812051] Linux agpgart interface v0.103 [ 3.817793] loop: module loaded [ 3.821233] tun: Universal TUN/TAP device driver, 1.6 [ 3.826374] PPP generic driver version 2.4.2 [ 3.830758] VFIO - User Level meta-driver version: 0.3 [ 3.836051] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.842653] ehci-pci: EHCI PCI platform driver [ 3.847322] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.852618] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.860114] ehci-pci 0000:00:1a.0: debug port 2 [ 3.868642] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.887798] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.893661] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.902020] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.909332] usb usb1: Product: EHCI Host Controller [ 3.914282] usb usb1: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 3.920795] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.925625] hub 1-0:1.0: USB hub found [ 3.927800] Freeing initrd memory: 65088K [ 3.929460] hub 1-0:1.0: 2 ports detected [ 3.937864] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.943156] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.950648] ehci-pci 0000:00:1d.0: debug port 2 [ 3.959155] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.979815] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.985657] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.994014] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.001326] usb usb2: Product: EHCI Host Controller [ 4.006267] usb usb2: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 4.012774] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.017567] hub 2-0:1.0: USB hub found [ 4.021389] hub 2-0:1.0: 2 ports detected [ 4.025583] ehci-platform: EHCI generic platform driver [ 4.030892] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.037139] ohci-pci: OHCI PCI platform driver [ 4.041668] ohci-platform: OHCI generic platform driver [ 4.046961] uhci_hcd: USB Universal Host Controller Interface driver [ 4.053428] i8042: PNP: No PS/2 controller found. [ 4.058259] mousedev: PS/2 mouse device common for all mice [ 4.063973] rtc_cmos 00:00: RTC can wake from S4 [ 4.068877] rtc_cmos 00:00: registered as rtc0 [ 4.073420] rtc_cmos 00:00: setting system clock to 2024-04-18T21:09:36 UTC (1713474576) [ 4.081617] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.088400] i2c_dev: i2c /dev entries driver [ 4.092904] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.105187] device-mapper: uevent: version 1.0.3 [ 4.109937] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.118479] platform eisa.0: Probing EISA bus 0 [ 4.123073] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.129926] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.136433] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.142942] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.149450] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.155960] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.162471] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.168978] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.175489] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.181998] platform eisa.0: EISA: Detected 0 cards [ 4.186950] intel_pstate: Intel P-state driver initializing [ 4.193648] ledtrig-cpu: registered to indicate activity on CPUs [ 4.199872] drop_monitor: Initializing network drop monitor service [ 4.206326] NET: Registered PF_INET6 protocol family [ 4.215857] Segment Routing with IPv6 [ 4.219586] In-situ OAM (IOAM) with IPv6 [ 4.223589] NET: Registered PF_PACKET protocol family [ 4.228758] Key type dns_resolver registered [ 4.233646] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.239647] microcode: Microcode Update Driver: v2.2. [ 4.239728] resctrl: L3 allocation detected [ 4.249086] resctrl: L3 monitoring detected [ 4.253339] IPI shorthand broadcast: enabled [ 4.257691] sched_clock: Marking stable (3209911390, 1047764676)->(5246447479, -988771413) [ 4.266287] registered taskstats version 1 [ 4.270625] Loading compiled-in X.509 certificates [ 4.275807] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.276040] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.292843] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.303080] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.313165] blacklist: Loading compiled-in revocation X.509 certificates [ 4.319947] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.329867] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.340398] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.351277] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.361808] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.363824] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.372614] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.390014] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.400929] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.412685] zswap: loaded using pool lzo/zbud [ 4.417378] Key type .fscrypt registered [ 4.421367] Key type fscrypt-provisioning registered [ 4.426450] pstore: Using crash dump compression: deflate [ 4.435880] Key type encrypted registered [ 4.439964] AppArmor: AppArmor sha1 policy hashing enabled [ 4.445526] ima: No TPM chip found, activating TPM-bypass! [ 4.451086] Loading compiled-in module X.509 certificates [ 4.451165] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.457008] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.464834] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.482647] ima: Allocated hash algorithm: sha1 [ 4.494458] ima: No architecture policies found [ 4.494578] hub 1-1:1.0: USB hub found [ 4.499076] evm: Initialising EVM extended attributes: [ 4.508119] evm: security.selinux [ 4.511500] evm: security.SMACK64 [ 4.514892] evm: security.SMACK64EXEC [ 4.518625] evm: security.SMACK64TRANSMUTE [ 4.518674] hub 1-1:1.0: 6 ports detected [ 4.522782] evm: security.SMACK64MMAP [ 4.522783] evm: security.apparmor [ 4.522783] evm: security.ima [ 4.522784] evm: security.capability [ 4.522784] evm: HMAC attrs: 0x1 [ 4.523062] PM: Magic number: 4:186:197 [ 4.544161] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.548246] acpi device:1b4: hash matches [ 4.556452] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.567839] acpi device:52: hash matches [ 4.571857] acpi PNP0100:00: hash matches [ 4.576124] hub 2-1:1.0: USB hub found [ 4.576132] RAS: Correctable Errors collector initialized. [ 4.585539] hub 2-1:1.0: 8 ports detected [ 4.590573] Freeing unused decrypted memory: 2036K [ 4.595787] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.595930] Freeing unused kernel image (initmem) memory: 3352K [ 4.602074] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.618250] clocksource: Switched to clocksource tsc [ 4.623799] Write protecting the kernel read-only data: 30720k [ 4.630118] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.637039] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.681823] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.688331] x86/mm: Checking user space page tables [ 4.730262] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.736774] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.900925] dca service started, version 1.12.1 [ 4.908478] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.916665] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.959979] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.965456] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.968167] scsi host0: ahci [ 4.974184] scsi host1: ahci [ 4.974319] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.977247] scsi host2: ahci [ 4.982427] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.985494] scsi host3: ahci [ 4.985566] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.986845] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.986846] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 4.993971] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.995864] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.001973] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.007459] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.016771] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.026009] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.028414] igb 0000:07:00.0: added PHC on eth0 [ 5.028443] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.028445] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:24 [ 5.028524] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.028525] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.033494] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.033681] nvme nvme0: pci function 0000:02:00.0 [ 5.036483] nvme nvme0: 8/0/0 default/read/poll queues [ 5.038784] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.046323] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.053997] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.061245] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.061247] usb usb3: Product: xHCI Host Controller [ 5.065848] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.072788] usb usb3: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.083111] igb 0000:07:00.1: added PHC on eth1 [ 5.085201] usb usb3: SerialNumber: 0000:00:14.0 [ 5.086548] hub 3-0:1.0: USB hub found [ 5.092887] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.093048] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.093049] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.099236] hub 3-0:1.0: 15 ports detected [ 5.103970] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:25 [ 5.111515] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.116725] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.125011] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.133282] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.140590] usb usb4: Product: xHCI Host Controller [ 5.148201] scsi host4: ahci [ 5.153203] usb usb4: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.159849] scsi host5: ahci [ 5.164309] usb usb4: SerialNumber: 0000:00:14.0 [ 5.169131] scsi host6: ahci [ 5.172970] hub 4-0:1.0: USB hub found [ 5.179866] scsi host7: ahci [ 5.185961] hub 4-0:1.0: 6 ports detected [ 5.191857] scsi host8: ahci [ 5.270568] scsi host9: ahci [ 5.273568] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 5.281054] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 5.288538] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 5.296018] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 5.303498] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 5.310977] ata10: SATA max UDMA/133 abar m2048@0xfb432000 porxfb432380 irq 63 [ 5.372221] ata3: SATA link down (SStatus 0 SControl 300) [ 5.377710] ata2: SATA link down (SStatus 0 SControl 300) [ 5.383212] ata4: SATA link down (SStatus 0 SControl 300) [ 5.388712] ata1: SATA link down (SStatus 0 SControl 300) [ 5.443823] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.600090] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.608478] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.616240] hub 3-12:1.0: USB hub found [ 5.620242] hub 3-12:1.0: 4 ports detected [ 5.628836] ata9: SATA link down (SStatus 0 SControl 300) [ 5.634351] ata10: SATA link down (SStatus 0 SControl 300) [ 5.639941] ata7: SATA link down (SStatus 0 SControl 300) [ 5.645445] ata6: SATA link down (SStatus 0 SControl 300) [ 5.650945] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.657219] ata8: SATA link down (SStatus 0 SControl 300) [ 5.662896] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.669763] ata5.00: NCQ Send/Recv Log not supported [ 5.674821] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.683320] ata5.00: NCQ Send/Recv Log not supported [ 5.688380] ata5.00: configured for UDMA/133 [ 5.692962] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.701484] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.701614] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.714632] sd 4:0:0:0: [sda] Write Protect is off [ 5.719502] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.737763] sda: sda1 [ 5.740329] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.746366] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.772212] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.931794] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.064163] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.072703] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.088369] hid: raw HID events driver (C) Jiri Kosina [ 6.096304] usbcore: registered new interface driver usbhid [ 6.101949] usbhid: USB HID core driver [ 6.108134] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.180006] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.191997] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.203894] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.276636] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.287038] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.303640] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.309894] ixgbe 0000:03:00.0: 0c:c4:7a:8f:cc:2e [ 6.319067] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.492551] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.502951] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.511577] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.518705] ixgbe 0000:03:00.1: 0c:c4:7a:8f:cc:2f [ 6.527813] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.536483] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.568200] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 198150/61054976 files, 6567679/244190336 blocks done. [ 13.672025] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.474859] systemd[1]: Inserted module 'autofs4' [ 14.592422] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.639965] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.687270] systemd[1]: Hostname set to . [ 15.974046] systemd[1]: Queued start job for default target Graphical Interface. [ 15.982767] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.004225] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.028484] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.051998] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.071998] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.096264] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.123965] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.151927] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.179914] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.207937] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.235908] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.263907] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.292003] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.315948] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.335974] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.360048] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.384171] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.410343] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.436182] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.456172] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.480076] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.504344] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.524140] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.544173] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.564276] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.588192] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.608116] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.629617] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.649602] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.673408] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.697575] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.717704] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.736605] RPC: Registered named UNIX socket transport module. [ 16.742607] RPC: Registered udp transport module. [ 16.747388] RPC: Registered tcp transport module. [ 16.752164] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.759991] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.779941] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.791224] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.812898] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.836664] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.865064] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 16.888606] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 16.908836] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.928549] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 16.952551] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 16.972518] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 16.996855] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.021496] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.039907] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.049848] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.072680] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules[[ 17.081288] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). 0m... [ 17.101333] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.124735] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.149757] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.166907] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debu[ 17.226955] lp: driver loaded but no devices found g File System. [ OK ] Mounted Kernel Trace File System. [ 17.253084] Loading iSCSI transport class v2.0-870. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mountin[ 17.485749] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS g FUSE Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.567130] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Set console font and keymap. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Finished Load AppArmor profiles. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. Starting Network Configuration... [ OK ] Started RPC bind portmap service. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started ifup for enp3s0f1. [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Started User Login Management. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] A start job is running for Raise network interfaces (7s / 5min 3s) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting NFS status monitor for NFSv2/3 locking.... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... + myips=172.21.15.111 + attempts=1 + sleep 1 [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. [ OK ] Finished Availability of block devices. Starting NFS server and services... [ OK ] Started Network Time Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.111 '!=' '' ']' + set -e + '[' -n 172.21.15.111 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.111 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.111 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi111.front.sepia.ceph.com + '[' -n smithi111.front.sepia.ceph.com ']' + hostname smithi111.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi111 + echo smithi111 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.111 smithi111.front.sepia.ceph.com smithi111/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started (i)SCSI target daemon. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Started The Apache HTTP Server. [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi111.front.sepia.ceph.com ttyS1 smithi111 login: [disconnect] 2024-04-18T21:10:06.490 INFO:teuthology.misc:Re-opening connections... 2024-04-18T21:10:06.490 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:10:06.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T21:10:06.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T21:10:06.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~151s 2024-04-18T21:10:06.716 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-18T21:10:07.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-18T21:10:07.198 DEBUG:teuthology.misc:waited 0.7079386711120605 2024-04-18T21:10:08.199 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:10:08.199 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi111.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-18T21:10:08.199 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T21:10:08.283 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:10:08.305 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T21:10:08.305 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T21:10:08.349 INFO:tasks.ceph.osd.0:Started 2024-04-18T21:10:08.349 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:10:08.481 INFO:teuthology.orchestra.run.smithi111.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-18T21:10:08.483 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:10:08.484 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-18T21:10:09.433 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:10:09.700+0000 7f78cff947c0 -1 Falling back to public interface 2024-04-18T21:10:12.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-18T21:10:13.485 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:no valid command found; 10 closest matches: 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:0 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:1 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:2 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:abort 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:assert 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:bluestore allocator dump block 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:bluestore allocator fragmentation block 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:bluestore allocator fragmentation histogram block [] [] 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:bluestore allocator score block 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:config diff 2024-04-18T21:10:13.619 INFO:teuthology.orchestra.run.smithi111.stderr:admin_socket: invalid command 2024-04-18T21:10:13.621 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:10:13.621 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-18T21:10:14.392 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:10:14.660+0000 7f78cff947c0 -1 osd.0 76 log_to_monitors true 2024-04-18T21:10:14.876 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-18T21:10:15.140+0000 7f78c3d71640 -1 osd.0 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:10:18.622 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:10:18.755 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-18T21:10:18.755 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-04-18T21:10:18.756 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-04-18T21:10:18.756 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-18T21:10:18.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-18T21:10:18.918 INFO:teuthology.orchestra.run.smithi096.stdout:mon.a: {} 2024-04-18T21:10:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:10:18.927 INFO:teuthology.orchestra.run.smithi096.stdout:mon.b: {} 2024-04-18T21:10:18.927 INFO:teuthology.orchestra.run.smithi096.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:10:18.936 INFO:teuthology.orchestra.run.smithi096.stdout:mon.c: {} 2024-04-18T21:10:18.937 INFO:teuthology.orchestra.run.smithi096.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:10:18.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-18T21:10:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.1 to 1 (10000) 2024-04-18T21:10:19.891 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-18T21:10:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-18T21:10:20.901 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-18T21:10:21.886 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.2 to 1 (10000) 2024-04-18T21:10:21.909 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-18T21:10:22.895 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-18T21:10:22.923 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-18T21:10:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.0 to 1 (10000) 2024-04-18T21:10:23.933 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-18T21:10:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-18T21:10:24.943 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-18T21:10:24.943 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-18T21:10:24.943 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-18T21:10:24.943 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-18T21:10:24.943 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T21:10:24.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:10:25.230 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:25.230 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":88,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:10:24.913616+0000","last_up_change":"2024-04-18T21:10:15.841427+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":81,"up_thru":81,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6801","nonce":274608909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6803","nonce":274608909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6807","nonce":274608909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6805","nonce":274608909}]},"public_addr":"172.21.15.111:6801/274608909","cluster_addr":"172.21.15.111:6803/274608909","heartbeat_back_addr":"172.21.15.111:6807/274608909","heartbeat_front_addr":"172.21.15.111:6805/274608909","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3","osds":[1,2]},{"pgid":"4.7","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:10:25.248 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T21:10:25.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:10:25.543 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:25.543 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":88,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:10:24.913616+0000","last_up_change":"2024-04-18T21:10:15.841427+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":81,"up_thru":81,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6801","nonce":274608909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6803","nonce":274608909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6807","nonce":274608909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6805","nonce":274608909}]},"public_addr":"172.21.15.111:6801/274608909","cluster_addr":"172.21.15.111:6803/274608909","heartbeat_back_addr":"172.21.15.111:6807/274608909","heartbeat_front_addr":"172.21.15.111:6805/274608909","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3","osds":[1,2]},{"pgid":"4.7","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:10:25.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T21:10:25.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T21:10:25.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T21:10:25.717 INFO:teuthology.orchestra.run.smithi096.stdout:347892350980 2024-04-18T21:10:25.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:10:25.725 INFO:teuthology.orchestra.run.smithi096.stdout:34359738438 2024-04-18T21:10:25.726 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:10:25.727 INFO:teuthology.orchestra.run.smithi096.stdout:34359738438 2024-04-18T21:10:25.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:10:26.001 INFO:teuthology.orchestra.run.smithi096.stdout:347892350980 2024-04-18T21:10:26.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 347892350980 got 347892350980 for osd.0 2024-04-18T21:10:26.019 DEBUG:teuthology.parallel:result is None 2024-04-18T21:10:26.057 INFO:teuthology.orchestra.run.smithi096.stdout:34359738438 2024-04-18T21:10:26.061 INFO:teuthology.orchestra.run.smithi096.stdout:34359738438 2024-04-18T21:10:26.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738438 got 34359738438 for osd.1 2024-04-18T21:10:26.082 DEBUG:teuthology.parallel:result is None 2024-04-18T21:10:26.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738438 got 34359738438 for osd.2 2024-04-18T21:10:26.084 DEBUG:teuthology.parallel:result is None 2024-04-18T21:10:26.084 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-18T21:10:26.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:26.406 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:26.422 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-18T21:10:25.920332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265720,"kb_used_data":85192,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849800,"statfs":{"total":289910292480,"available":289638195200,"internally_reserved":0,"allocated":87236608,"data_stored":256524366,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035023"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924469+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:24.924469+0000","last_peered":"2024-04-18T21:10:24.924469+0000","last_clean":"2024-04-18T21:10:24.924469+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:24.924469+0000","last_undegraded":"2024-04-18T21:10:24.924469+0000","last_fullsized":"2024-04-18T21:10:24.924469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":608,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921942+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:24.921942+0000","last_peered":"2024-04-18T21:10:24.921942+0000","last_clean":"2024-04-18T21:10:24.921942+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:24.921942+0000","last_undegraded":"2024-04-18T21:10:24.921942+0000","last_fullsized":"2024-04-18T21:10:24.921942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":531,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.203812+0000","last_change":"2024-04-18T21:10:25.203812+0000","last_active":"2024-04-18T21:10:25.203812+0000","last_peered":"2024-04-18T21:07:22.957446+0000","last_clean":"2024-04-18T21:07:22.957446+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:10:25.203812+0000","last_undegraded":"2024-04-18T21:10:25.203812+0000","last_fullsized":"2024-04-18T21:10:25.203812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":530,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192955+0000","last_change":"2024-04-18T21:10:25.192955+0000","last_active":"2024-04-18T21:10:25.192955+0000","last_peered":"2024-04-18T21:07:22.948971+0000","last_clean":"2024-04-18T21:07:22.948971+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:10:25.192955+0000","last_undegraded":"2024-04-18T21:10:25.192955+0000","last_fullsized":"2024-04-18T21:10:25.192955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":610,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922801+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:24.922801+0000","last_peered":"2024-04-18T21:10:24.922801+0000","last_clean":"2024-04-18T21:10:24.922801+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:24.922801+0000","last_undegraded":"2024-04-18T21:10:24.922801+0000","last_fullsized":"2024-04-18T21:10:24.922801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":543,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196541+0000","last_change":"2024-04-18T21:10:25.196541+0000","last_active":"2024-04-18T21:10:25.196541+0000","last_peered":"2024-04-18T21:07:22.946960+0000","last_clean":"2024-04-18T21:07:22.946960+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:10:25.196541+0000","last_undegraded":"2024-04-18T21:10:25.196541+0000","last_fullsized":"2024-04-18T21:10:25.196541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":588,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.188244+0000","last_change":"2024-04-18T21:10:25.188244+0000","last_active":"2024-04-18T21:10:25.188244+0000","last_peered":"2024-04-18T21:07:22.949792+0000","last_clean":"2024-04-18T21:07:22.949792+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:10:25.188244+0000","last_undegraded":"2024-04-18T21:10:25.188244+0000","last_fullsized":"2024-04-18T21:10:25.188244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":522,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.191293+0000","last_change":"2024-04-18T21:10:25.191293+0000","last_active":"2024-04-18T21:10:25.191293+0000","last_peered":"2024-04-18T21:07:22.949804+0000","last_clean":"2024-04-18T21:07:22.949804+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:10:25.191293+0000","last_undegraded":"2024-04-18T21:10:25.191293+0000","last_fullsized":"2024-04-18T21:10:25.191293+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":659,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925633+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:24.925633+0000","last_peered":"2024-04-18T21:10:24.925633+0000","last_clean":"2024-04-18T21:10:24.925633+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:24.925633+0000","last_undegraded":"2024-04-18T21:10:24.925633+0000","last_fullsized":"2024-04-18T21:10:24.925633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":569,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923028+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:24.923028+0000","last_peered":"2024-04-18T21:10:24.923028+0000","last_clean":"2024-04-18T21:10:24.923028+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:24.923028+0000","last_undegraded":"2024-04-18T21:10:24.923028+0000","last_fullsized":"2024-04-18T21:10:24.923028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":515,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.202591+0000","last_change":"2024-04-18T21:10:25.202591+0000","last_active":"2024-04-18T21:10:25.202591+0000","last_peered":"2024-04-18T21:07:22.964633+0000","last_clean":"2024-04-18T21:07:22.964633+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:10:25.202591+0000","last_undegraded":"2024-04-18T21:10:25.202591+0000","last_fullsized":"2024-04-18T21:10:25.202591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":564,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921739+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:24.921739+0000","last_peered":"2024-04-18T21:10:24.921739+0000","last_clean":"2024-04-18T21:10:24.921739+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:24.921739+0000","last_undegraded":"2024-04-18T21:10:24.921739+0000","last_fullsized":"2024-04-18T21:10:24.921739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":596,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922512+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:24.922512+0000","last_peered":"2024-04-18T21:10:24.922512+0000","last_clean":"2024-04-18T21:10:24.922512+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:24.922512+0000","last_undegraded":"2024-04-18T21:10:24.922512+0000","last_fullsized":"2024-04-18T21:10:24.922512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":641,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749197+0000","last_change":"2024-04-18T21:10:25.191674+0000","last_active":"2024-04-18T21:10:25.191674+0000","last_peered":"2024-04-18T21:10:22.749197+0000","last_clean":"2024-04-18T21:10:22.749197+0000","last_became_active":"2024-04-18T21:10:17.140677+0000","last_became_peered":"2024-04-18T21:10:17.140677+0000","last_unstale":"2024-04-18T21:10:22.749197+0000","last_undegraded":"2024-04-18T21:10:22.749197+0000","last_fullsized":"2024-04-18T21:10:22.749197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":645,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749533+0000","last_change":"2024-04-18T21:10:25.188538+0000","last_active":"2024-04-18T21:10:25.188538+0000","last_peered":"2024-04-18T21:10:22.749533+0000","last_clean":"2024-04-18T21:10:22.749533+0000","last_became_active":"2024-04-18T21:10:17.131630+0000","last_became_peered":"2024-04-18T21:10:17.131630+0000","last_unstale":"2024-04-18T21:10:22.749533+0000","last_undegraded":"2024-04-18T21:10:22.749533+0000","last_fullsized":"2024-04-18T21:10:22.749533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":626,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200826+0000","last_change":"2024-04-18T21:10:25.200826+0000","last_active":"2024-04-18T21:10:25.200826+0000","last_peered":"2024-04-18T21:07:22.960697+0000","last_clean":"2024-04-18T21:07:22.960697+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:10:25.200826+0000","last_undegraded":"2024-04-18T21:10:25.200826+0000","last_fullsized":"2024-04-18T21:10:25.200826+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":589,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927224+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:24.927224+0000","last_peered":"2024-04-18T21:10:24.927224+0000","last_clean":"2024-04-18T21:10:24.927224+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:24.927224+0000","last_undegraded":"2024-04-18T21:10:24.927224+0000","last_fullsized":"2024-04-18T21:10:24.927224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":597,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923175+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:24.923175+0000","last_peered":"2024-04-18T21:10:24.923175+0000","last_clean":"2024-04-18T21:10:24.923175+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:24.923175+0000","last_undegraded":"2024-04-18T21:10:24.923175+0000","last_fullsized":"2024-04-18T21:10:24.923175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":628,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926866+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:24.926866+0000","last_peered":"2024-04-18T21:10:24.926866+0000","last_clean":"2024-04-18T21:10:24.926866+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:24.926866+0000","last_undegraded":"2024-04-18T21:10:24.926866+0000","last_fullsized":"2024-04-18T21:10:24.926866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":579,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.195904+0000","last_change":"2024-04-18T21:10:25.195904+0000","last_active":"2024-04-18T21:10:25.195904+0000","last_peered":"2024-04-18T21:07:22.916966+0000","last_clean":"2024-04-18T21:07:22.916966+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:10:25.195904+0000","last_undegraded":"2024-04-18T21:10:25.195904+0000","last_fullsized":"2024-04-18T21:10:25.195904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":526,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192946+0000","last_change":"2024-04-18T21:10:25.192946+0000","last_active":"2024-04-18T21:10:25.192946+0000","last_peered":"2024-04-18T21:07:22.958552+0000","last_clean":"2024-04-18T21:07:22.958552+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:10:25.192946+0000","last_undegraded":"2024-04-18T21:10:25.192946+0000","last_fullsized":"2024-04-18T21:10:25.192946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921021+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:24.921021+0000","last_peered":"2024-04-18T21:10:24.921021+0000","last_clean":"2024-04-18T21:10:24.921021+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:24.921021+0000","last_undegraded":"2024-04-18T21:10:24.921021+0000","last_fullsized":"2024-04-18T21:10:24.921021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":591,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925044+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:24.925044+0000","last_peered":"2024-04-18T21:10:24.925044+0000","last_clean":"2024-04-18T21:10:24.925044+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:24.925044+0000","last_undegraded":"2024-04-18T21:10:24.925044+0000","last_fullsized":"2024-04-18T21:10:24.925044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920783+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:24.920783+0000","last_peered":"2024-04-18T21:10:24.920783+0000","last_clean":"2024-04-18T21:10:24.920783+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:24.920783+0000","last_undegraded":"2024-04-18T21:10:24.920783+0000","last_fullsized":"2024-04-18T21:10:24.920783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":601,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924654+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:24.924654+0000","last_peered":"2024-04-18T21:10:24.924654+0000","last_clean":"2024-04-18T21:10:24.924654+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:24.924654+0000","last_undegraded":"2024-04-18T21:10:24.924654+0000","last_fullsized":"2024-04-18T21:10:24.924654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":740,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930675+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:24.930675+0000","last_peered":"2024-04-18T21:10:24.930675+0000","last_clean":"2024-04-18T21:10:24.930675+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:24.930675+0000","last_undegraded":"2024-04-18T21:10:24.930675+0000","last_fullsized":"2024-04-18T21:10:24.930675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":582,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750329+0000","last_change":"2024-04-18T21:10:25.200634+0000","last_active":"2024-04-18T21:10:25.200634+0000","last_peered":"2024-04-18T21:10:22.750329+0000","last_clean":"2024-04-18T21:10:22.750329+0000","last_became_active":"2024-04-18T21:10:17.157423+0000","last_became_peered":"2024-04-18T21:10:17.157423+0000","last_unstale":"2024-04-18T21:10:22.750329+0000","last_undegraded":"2024-04-18T21:10:22.750329+0000","last_fullsized":"2024-04-18T21:10:22.750329+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":647,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922768+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:24.922768+0000","last_peered":"2024-04-18T21:10:24.922768+0000","last_clean":"2024-04-18T21:10:24.922768+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:24.922768+0000","last_undegraded":"2024-04-18T21:10:24.922768+0000","last_fullsized":"2024-04-18T21:10:24.922768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930044+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:24.930044+0000","last_peered":"2024-04-18T21:10:24.930044+0000","last_clean":"2024-04-18T21:10:24.930044+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:24.930044+0000","last_undegraded":"2024-04-18T21:10:24.930044+0000","last_fullsized":"2024-04-18T21:10:24.930044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":691,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921793+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:24.921793+0000","last_peered":"2024-04-18T21:10:24.921793+0000","last_clean":"2024-04-18T21:10:24.921793+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:24.921793+0000","last_undegraded":"2024-04-18T21:10:24.921793+0000","last_fullsized":"2024-04-18T21:10:24.921793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":661,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926762+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:24.926762+0000","last_peered":"2024-04-18T21:10:24.926762+0000","last_clean":"2024-04-18T21:10:24.926762+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:24.926762+0000","last_undegraded":"2024-04-18T21:10:24.926762+0000","last_fullsized":"2024-04-18T21:10:24.926762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":599,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189432+0000","last_change":"2024-04-18T21:10:25.189432+0000","last_active":"2024-04-18T21:10:25.189432+0000","last_peered":"2024-04-18T21:07:22.952459+0000","last_clean":"2024-04-18T21:07:22.952459+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:10:25.189432+0000","last_undegraded":"2024-04-18T21:10:25.189432+0000","last_fullsized":"2024-04-18T21:10:25.189432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":578,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922439+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:24.922439+0000","last_peered":"2024-04-18T21:10:24.922439+0000","last_clean":"2024-04-18T21:10:24.922439+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:24.922439+0000","last_undegraded":"2024-04-18T21:10:24.922439+0000","last_fullsized":"2024-04-18T21:10:24.922439+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":620,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189324+0000","last_change":"2024-04-18T21:10:25.189324+0000","last_active":"2024-04-18T21:10:25.189324+0000","last_peered":"2024-04-18T21:06:59.247748+0000","last_clean":"2024-04-18T21:06:59.247748+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:10:25.189324+0000","last_undegraded":"2024-04-18T21:10:25.189324+0000","last_fullsized":"2024-04-18T21:10:25.189324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":583,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":216,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929036+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:24.929036+0000","last_peered":"2024-04-18T21:10:24.929036+0000","last_clean":"2024-04-18T21:10:24.929036+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:24.929036+0000","last_undegraded":"2024-04-18T21:10:24.929036+0000","last_fullsized":"2024-04-18T21:10:24.929036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":620,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932977+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:24.932977+0000","last_peered":"2024-04-18T21:10:24.932977+0000","last_clean":"2024-04-18T21:10:24.932977+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:24.932977+0000","last_undegraded":"2024-04-18T21:10:24.932977+0000","last_fullsized":"2024-04-18T21:10:24.932977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":244,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922379+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:24.922379+0000","last_peered":"2024-04-18T21:10:24.922379+0000","last_clean":"2024-04-18T21:10:24.922379+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:24.922379+0000","last_undegraded":"2024-04-18T21:10:24.922379+0000","last_fullsized":"2024-04-18T21:10:24.922379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925970+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:24.925970+0000","last_peered":"2024-04-18T21:10:24.925970+0000","last_clean":"2024-04-18T21:10:24.925970+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:24.925970+0000","last_undegraded":"2024-04-18T21:10:24.925970+0000","last_fullsized":"2024-04-18T21:10:24.925970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":161,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747867+0000","last_change":"2024-04-18T21:10:25.187369+0000","last_active":"2024-04-18T21:10:25.187369+0000","last_peered":"2024-04-18T21:10:22.747867+0000","last_clean":"2024-04-18T21:10:22.747867+0000","last_became_active":"2024-04-18T21:10:17.136098+0000","last_became_peered":"2024-04-18T21:10:17.136098+0000","last_unstale":"2024-04-18T21:10:22.747867+0000","last_undegraded":"2024-04-18T21:10:22.747867+0000","last_fullsized":"2024-04-18T21:10:22.747867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":170,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200983+0000","last_change":"2024-04-18T21:10:25.200983+0000","last_active":"2024-04-18T21:10:25.200983+0000","last_peered":"2024-04-18T21:07:11.855434+0000","last_clean":"2024-04-18T21:07:11.855434+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:10:25.200983+0000","last_undegraded":"2024-04-18T21:10:25.200983+0000","last_fullsized":"2024-04-18T21:10:25.200983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":604,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920982+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:24.920982+0000","last_peered":"2024-04-18T21:10:24.920982+0000","last_clean":"2024-04-18T21:10:24.920982+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:24.920982+0000","last_undegraded":"2024-04-18T21:10:24.920982+0000","last_fullsized":"2024-04-18T21:10:24.920982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":447,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923884+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:24.923884+0000","last_peered":"2024-04-18T21:10:24.923884+0000","last_clean":"2024-04-18T21:10:24.923884+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:24.923884+0000","last_undegraded":"2024-04-18T21:10:24.923884+0000","last_fullsized":"2024-04-18T21:10:24.923884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":644,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920935+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:24.920935+0000","last_peered":"2024-04-18T21:10:24.920935+0000","last_clean":"2024-04-18T21:10:24.920935+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:24.920935+0000","last_undegraded":"2024-04-18T21:10:24.920935+0000","last_fullsized":"2024-04-18T21:10:24.920935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":615,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750052+0000","last_change":"2024-04-18T21:10:25.194627+0000","last_active":"2024-04-18T21:10:25.194627+0000","last_peered":"2024-04-18T21:10:22.750052+0000","last_clean":"2024-04-18T21:10:22.750052+0000","last_became_active":"2024-04-18T21:10:17.138701+0000","last_became_peered":"2024-04-18T21:10:17.138701+0000","last_unstale":"2024-04-18T21:10:22.750052+0000","last_undegraded":"2024-04-18T21:10:22.750052+0000","last_fullsized":"2024-04-18T21:10:22.750052+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":691,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196497+0000","last_change":"2024-04-18T21:10:25.196497+0000","last_active":"2024-04-18T21:10:25.196497+0000","last_peered":"2024-04-18T21:07:22.953093+0000","last_clean":"2024-04-18T21:07:22.953093+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:10:25.196497+0000","last_undegraded":"2024-04-18T21:10:25.196497+0000","last_fullsized":"2024-04-18T21:10:25.196497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199958+0000","last_change":"2024-04-18T21:06:41.751008+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.199958+0000","last_undegraded":"2024-04-18T21:10:25.199958+0000","last_fullsized":"2024-04-18T21:10:25.199958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":698,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930213+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:24.930213+0000","last_peered":"2024-04-18T21:10:24.930213+0000","last_clean":"2024-04-18T21:10:24.930213+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:24.930213+0000","last_undegraded":"2024-04-18T21:10:24.930213+0000","last_fullsized":"2024-04-18T21:10:24.930213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":334,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932961+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:24.932961+0000","last_peered":"2024-04-18T21:10:24.932961+0000","last_clean":"2024-04-18T21:10:24.932961+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:24.932961+0000","last_undegraded":"2024-04-18T21:10:24.932961+0000","last_fullsized":"2024-04-18T21:10:24.932961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":617,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.204345+0000","last_change":"2024-04-18T21:10:25.204345+0000","last_active":"2024-04-18T21:10:25.204345+0000","last_peered":"2024-04-18T21:07:22.956950+0000","last_clean":"2024-04-18T21:07:22.956950+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:10:25.204345+0000","last_undegraded":"2024-04-18T21:10:25.204345+0000","last_fullsized":"2024-04-18T21:10:25.204345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":117,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189043+0000","last_change":"2024-04-18T21:10:25.189043+0000","last_active":"2024-04-18T21:10:25.189043+0000","last_peered":"2024-04-18T21:07:12.552712+0000","last_clean":"2024-04-18T21:07:12.552712+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:10:25.189043+0000","last_undegraded":"2024-04-18T21:10:25.189043+0000","last_fullsized":"2024-04-18T21:10:25.189043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749766+0000","last_change":"2024-04-18T21:10:25.200048+0000","last_active":"2024-04-18T21:10:25.200048+0000","last_peered":"2024-04-18T21:10:22.749766+0000","last_clean":"2024-04-18T21:10:22.749766+0000","last_became_active":"2024-04-18T21:10:17.140649+0000","last_became_peered":"2024-04-18T21:10:17.140649+0000","last_unstale":"2024-04-18T21:10:22.749766+0000","last_undegraded":"2024-04-18T21:10:22.749766+0000","last_fullsized":"2024-04-18T21:10:22.749766+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922666+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:24.922666+0000","last_peered":"2024-04-18T21:10:24.922666+0000","last_clean":"2024-04-18T21:10:24.922666+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:24.922666+0000","last_undegraded":"2024-04-18T21:10:24.922666+0000","last_fullsized":"2024-04-18T21:10:24.922666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":516,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199668+0000","last_change":"2024-04-18T21:10:25.199668+0000","last_active":"2024-04-18T21:10:25.199668+0000","last_peered":"2024-04-18T21:07:22.962835+0000","last_clean":"2024-04-18T21:07:22.962835+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:10:25.199668+0000","last_undegraded":"2024-04-18T21:10:25.199668+0000","last_fullsized":"2024-04-18T21:10:25.199668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":554,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921454+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:24.921454+0000","last_peered":"2024-04-18T21:10:24.921454+0000","last_clean":"2024-04-18T21:10:24.921454+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:24.921454+0000","last_undegraded":"2024-04-18T21:10:24.921454+0000","last_fullsized":"2024-04-18T21:10:24.921454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":672,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926255+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:24.926255+0000","last_peered":"2024-04-18T21:10:24.926255+0000","last_clean":"2024-04-18T21:10:24.926255+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:24.926255+0000","last_undegraded":"2024-04-18T21:10:24.926255+0000","last_fullsized":"2024-04-18T21:10:24.926255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":318,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747803+0000","last_change":"2024-04-18T21:10:25.193958+0000","last_active":"2024-04-18T21:10:25.193958+0000","last_peered":"2024-04-18T21:10:22.747803+0000","last_clean":"2024-04-18T21:10:22.747803+0000","last_became_active":"2024-04-18T21:10:17.135600+0000","last_became_peered":"2024-04-18T21:10:17.135600+0000","last_unstale":"2024-04-18T21:10:22.747803+0000","last_undegraded":"2024-04-18T21:10:22.747803+0000","last_fullsized":"2024-04-18T21:10:22.747803+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187633+0000","last_change":"2024-04-18T21:10:16.682987+0000","last_active":"2024-04-18T21:10:16.682987+0000","last_peered":"2024-04-18T21:10:14.839769+0000","last_clean":"2024-04-18T21:07:30.994987+0000","last_became_active":"2024-04-18T21:07:34.057035+0000","last_became_peered":"2024-04-18T21:07:34.057035+0000","last_unstale":"2024-04-18T21:10:25.187633+0000","last_undegraded":"2024-04-18T21:10:25.187633+0000","last_fullsized":"2024-04-18T21:10:25.187633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":502,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930566+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:24.930566+0000","last_peered":"2024-04-18T21:10:24.930566+0000","last_clean":"2024-04-18T21:10:24.930566+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:24.930566+0000","last_undegraded":"2024-04-18T21:10:24.930566+0000","last_fullsized":"2024-04-18T21:10:24.930566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750092+0000","last_change":"2024-04-18T21:10:25.197311+0000","last_active":"2024-04-18T21:10:25.197311+0000","last_peered":"2024-04-18T21:10:22.750092+0000","last_clean":"2024-04-18T21:10:22.750092+0000","last_became_active":"2024-04-18T21:10:17.141516+0000","last_became_peered":"2024-04-18T21:10:17.141516+0000","last_unstale":"2024-04-18T21:10:22.750092+0000","last_undegraded":"2024-04-18T21:10:22.750092+0000","last_fullsized":"2024-04-18T21:10:22.750092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.914142+0000","last_change":"2024-04-18T21:10:17.128341+0000","last_active":"2024-04-18T21:10:17.128341+0000","last_peered":"2024-04-18T21:10:14.838882+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.051041+0000","last_became_peered":"2024-04-18T21:07:34.051041+0000","last_unstale":"2024-04-18T21:10:23.914142+0000","last_undegraded":"2024-04-18T21:10:23.914142+0000","last_fullsized":"2024-04-18T21:10:23.914142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932208+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:24.932208+0000","last_peered":"2024-04-18T21:10:24.932208+0000","last_clean":"2024-04-18T21:10:24.932208+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:24.932208+0000","last_undegraded":"2024-04-18T21:10:24.932208+0000","last_fullsized":"2024-04-18T21:10:24.932208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":704,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923628+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:24.923628+0000","last_peered":"2024-04-18T21:10:24.923628+0000","last_clean":"2024-04-18T21:10:24.923628+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:24.923628+0000","last_undegraded":"2024-04-18T21:10:24.923628+0000","last_fullsized":"2024-04-18T21:10:24.923628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932950+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:24.932950+0000","last_peered":"2024-04-18T21:10:24.932950+0000","last_clean":"2024-04-18T21:10:24.932950+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:24.932950+0000","last_undegraded":"2024-04-18T21:10:24.932950+0000","last_fullsized":"2024-04-18T21:10:24.932950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":449,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921615+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:24.921615+0000","last_peered":"2024-04-18T21:10:24.921615+0000","last_clean":"2024-04-18T21:10:24.921615+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:24.921615+0000","last_undegraded":"2024-04-18T21:10:24.921615+0000","last_fullsized":"2024-04-18T21:10:24.921615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":534,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923013+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:24.923013+0000","last_peered":"2024-04-18T21:10:24.923013+0000","last_clean":"2024-04-18T21:10:24.923013+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:24.923013+0000","last_undegraded":"2024-04-18T21:10:24.923013+0000","last_fullsized":"2024-04-18T21:10:24.923013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187440+0000","last_change":"2024-04-18T21:10:16.682526+0000","last_active":"2024-04-18T21:10:16.682526+0000","last_peered":"2024-04-18T21:10:14.840654+0000","last_clean":"2024-04-18T21:07:30.995015+0000","last_became_active":"2024-04-18T21:07:34.045061+0000","last_became_peered":"2024-04-18T21:07:34.045061+0000","last_unstale":"2024-04-18T21:10:25.187440+0000","last_undegraded":"2024-04-18T21:10:25.187440+0000","last_fullsized":"2024-04-18T21:10:25.187440+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187794+0000","last_change":"2024-04-18T21:06:41.751500+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.187794+0000","last_undegraded":"2024-04-18T21:10:25.187794+0000","last_fullsized":"2024-04-18T21:10:25.187794+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933361+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:24.933361+0000","last_peered":"2024-04-18T21:10:24.933361+0000","last_clean":"2024-04-18T21:10:24.933361+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:24.933361+0000","last_undegraded":"2024-04-18T21:10:24.933361+0000","last_fullsized":"2024-04-18T21:10:24.933361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":285,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190938+0000","last_change":"2024-04-18T21:10:25.190938+0000","last_active":"2024-04-18T21:10:25.190938+0000","last_peered":"2024-04-18T21:07:20.021859+0000","last_clean":"2024-04-18T21:07:20.021859+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:10:25.190938+0000","last_undegraded":"2024-04-18T21:10:25.190938+0000","last_fullsized":"2024-04-18T21:10:25.190938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933948+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:24.933948+0000","last_peered":"2024-04-18T21:10:24.933948+0000","last_clean":"2024-04-18T21:10:24.933948+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:24.933948+0000","last_undegraded":"2024-04-18T21:10:24.933948+0000","last_fullsized":"2024-04-18T21:10:24.933948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":575,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921470+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:24.921470+0000","last_peered":"2024-04-18T21:10:24.921470+0000","last_clean":"2024-04-18T21:10:24.921470+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:24.921470+0000","last_undegraded":"2024-04-18T21:10:24.921470+0000","last_fullsized":"2024-04-18T21:10:24.921470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933724+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:24.933724+0000","last_peered":"2024-04-18T21:10:24.933724+0000","last_clean":"2024-04-18T21:10:24.933724+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:24.933724+0000","last_undegraded":"2024-04-18T21:10:24.933724+0000","last_fullsized":"2024-04-18T21:10:24.933724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928748+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:24.928748+0000","last_peered":"2024-04-18T21:10:24.928748+0000","last_clean":"2024-04-18T21:10:24.928748+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:24.928748+0000","last_undegraded":"2024-04-18T21:10:24.928748+0000","last_fullsized":"2024-04-18T21:10:24.928748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":587,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925008+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:24.925008+0000","last_peered":"2024-04-18T21:10:24.925008+0000","last_clean":"2024-04-18T21:10:24.925008+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:24.925008+0000","last_undegraded":"2024-04-18T21:10:24.925008+0000","last_fullsized":"2024-04-18T21:10:24.925008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927275+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:24.927275+0000","last_peered":"2024-04-18T21:10:24.927275+0000","last_clean":"2024-04-18T21:10:24.927275+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:24.927275+0000","last_undegraded":"2024-04-18T21:10:24.927275+0000","last_fullsized":"2024-04-18T21:10:24.927275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933808+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:24.933808+0000","last_peered":"2024-04-18T21:10:24.933808+0000","last_clean":"2024-04-18T21:10:24.933808+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:24.933808+0000","last_undegraded":"2024-04-18T21:10:24.933808+0000","last_fullsized":"2024-04-18T21:10:24.933808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":559,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928910+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:24.928910+0000","last_peered":"2024-04-18T21:10:24.928910+0000","last_clean":"2024-04-18T21:10:24.928910+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:24.928910+0000","last_undegraded":"2024-04-18T21:10:24.928910+0000","last_fullsized":"2024-04-18T21:10:24.928910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":239,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933343+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:24.933343+0000","last_peered":"2024-04-18T21:10:24.933343+0000","last_clean":"2024-04-18T21:10:24.933343+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:24.933343+0000","last_undegraded":"2024-04-18T21:10:24.933343+0000","last_fullsized":"2024-04-18T21:10:24.933343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.917433+0000","last_change":"2024-04-18T21:10:17.121796+0000","last_active":"2024-04-18T21:10:17.121796+0000","last_peered":"2024-04-18T21:10:14.840628+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.054276+0000","last_became_peered":"2024-04-18T21:07:34.054276+0000","last_unstale":"2024-04-18T21:10:23.917433+0000","last_undegraded":"2024-04-18T21:10:23.917433+0000","last_fullsized":"2024-04-18T21:10:23.917433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":614,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921123+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:24.921123+0000","last_peered":"2024-04-18T21:10:24.921123+0000","last_clean":"2024-04-18T21:10:24.921123+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:24.921123+0000","last_undegraded":"2024-04-18T21:10:24.921123+0000","last_fullsized":"2024-04-18T21:10:24.921123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":625,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749809+0000","last_change":"2024-04-18T21:10:25.191106+0000","last_active":"2024-04-18T21:10:25.191106+0000","last_peered":"2024-04-18T21:10:22.749809+0000","last_clean":"2024-04-18T21:10:22.749809+0000","last_became_active":"2024-04-18T21:10:17.134137+0000","last_became_peered":"2024-04-18T21:10:17.134137+0000","last_unstale":"2024-04-18T21:10:22.749809+0000","last_undegraded":"2024-04-18T21:10:22.749809+0000","last_fullsized":"2024-04-18T21:10:22.749809+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":386,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.748811+0000","last_change":"2024-04-18T21:10:25.190602+0000","last_active":"2024-04-18T21:10:25.190602+0000","last_peered":"2024-04-18T21:10:22.748811+0000","last_clean":"2024-04-18T21:10:22.748811+0000","last_became_active":"2024-04-18T21:10:17.133733+0000","last_became_peered":"2024-04-18T21:10:17.133733+0000","last_unstale":"2024-04-18T21:10:22.748811+0000","last_undegraded":"2024-04-18T21:10:22.748811+0000","last_fullsized":"2024-04-18T21:10:22.748811+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":567,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926718+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:24.926718+0000","last_peered":"2024-04-18T21:10:24.926718+0000","last_clean":"2024-04-18T21:10:24.926718+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:24.926718+0000","last_undegraded":"2024-04-18T21:10:24.926718+0000","last_fullsized":"2024-04-18T21:10:24.926718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":240,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927489+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:24.927489+0000","last_peered":"2024-04-18T21:10:24.927489+0000","last_clean":"2024-04-18T21:10:24.927489+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:24.927489+0000","last_undegraded":"2024-04-18T21:10:24.927489+0000","last_fullsized":"2024-04-18T21:10:24.927489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":258,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196450+0000","last_change":"2024-04-18T21:10:25.196450+0000","last_active":"2024-04-18T21:10:25.196450+0000","last_peered":"2024-04-18T21:07:18.651325+0000","last_clean":"2024-04-18T21:07:18.651325+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:10:25.196450+0000","last_undegraded":"2024-04-18T21:10:25.196450+0000","last_fullsized":"2024-04-18T21:10:25.196450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":666,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926999+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:24.926999+0000","last_peered":"2024-04-18T21:10:24.926999+0000","last_clean":"2024-04-18T21:10:24.926999+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:24.926999+0000","last_undegraded":"2024-04-18T21:10:24.926999+0000","last_fullsized":"2024-04-18T21:10:24.926999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":618,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927941+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:24.927941+0000","last_peered":"2024-04-18T21:10:24.927941+0000","last_clean":"2024-04-18T21:10:24.927941+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:24.927941+0000","last_undegraded":"2024-04-18T21:10:24.927941+0000","last_fullsized":"2024-04-18T21:10:24.927941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":526,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924972+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:24.924972+0000","last_peered":"2024-04-18T21:10:24.924972+0000","last_clean":"2024-04-18T21:10:24.924972+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:24.924972+0000","last_undegraded":"2024-04-18T21:10:24.924972+0000","last_fullsized":"2024-04-18T21:10:24.924972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":772,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929236+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:24.929236+0000","last_peered":"2024-04-18T21:10:24.929236+0000","last_clean":"2024-04-18T21:10:24.929236+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:24.929236+0000","last_undegraded":"2024-04-18T21:10:24.929236+0000","last_fullsized":"2024-04-18T21:10:24.929236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932149+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:24.932149+0000","last_peered":"2024-04-18T21:10:24.932149+0000","last_clean":"2024-04-18T21:10:24.932149+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:24.932149+0000","last_undegraded":"2024-04-18T21:10:24.932149+0000","last_fullsized":"2024-04-18T21:10:24.932149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":369,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929014+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:24.929014+0000","last_peered":"2024-04-18T21:10:24.929014+0000","last_clean":"2024-04-18T21:10:24.929014+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:24.929014+0000","last_undegraded":"2024-04-18T21:10:24.929014+0000","last_fullsized":"2024-04-18T21:10:24.929014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":599,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925836+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:24.925836+0000","last_peered":"2024-04-18T21:10:24.925836+0000","last_clean":"2024-04-18T21:10:24.925836+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:24.925836+0000","last_undegraded":"2024-04-18T21:10:24.925836+0000","last_fullsized":"2024-04-18T21:10:24.925836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":290,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922229+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:24.922229+0000","last_peered":"2024-04-18T21:10:24.922229+0000","last_clean":"2024-04-18T21:10:24.922229+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:24.922229+0000","last_undegraded":"2024-04-18T21:10:24.922229+0000","last_fullsized":"2024-04-18T21:10:24.922229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":561,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922143+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:24.922143+0000","last_peered":"2024-04-18T21:10:24.922143+0000","last_clean":"2024-04-18T21:10:24.922143+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:24.922143+0000","last_undegraded":"2024-04-18T21:10:24.922143+0000","last_fullsized":"2024-04-18T21:10:24.922143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922718+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:24.922718+0000","last_peered":"2024-04-18T21:10:24.922718+0000","last_clean":"2024-04-18T21:10:24.922718+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:24.922718+0000","last_undegraded":"2024-04-18T21:10:24.922718+0000","last_fullsized":"2024-04-18T21:10:24.922718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":520,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190983+0000","last_change":"2024-04-18T21:10:25.190983+0000","last_active":"2024-04-18T21:10:25.190983+0000","last_peered":"2024-04-18T21:07:22.960952+0000","last_clean":"2024-04-18T21:07:22.960952+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:10:25.190983+0000","last_undegraded":"2024-04-18T21:10:25.190983+0000","last_fullsized":"2024-04-18T21:10:25.190983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":244,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189285+0000","last_change":"2024-04-18T21:10:25.189285+0000","last_active":"2024-04-18T21:10:25.189285+0000","last_peered":"2024-04-18T21:07:09.916748+0000","last_clean":"2024-04-18T21:07:09.916748+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:10:25.189285+0000","last_undegraded":"2024-04-18T21:10:25.189285+0000","last_fullsized":"2024-04-18T21:10:25.189285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":554,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189389+0000","last_change":"2024-04-18T21:10:25.189389+0000","last_active":"2024-04-18T21:10:25.189389+0000","last_peered":"2024-04-18T21:07:22.917646+0000","last_clean":"2024-04-18T21:07:22.917646+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:10:25.189389+0000","last_undegraded":"2024-04-18T21:10:25.189389+0000","last_fullsized":"2024-04-18T21:10:25.189389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927204+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:24.927204+0000","last_peered":"2024-04-18T21:10:24.927204+0000","last_clean":"2024-04-18T21:10:24.927204+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:24.927204+0000","last_undegraded":"2024-04-18T21:10:24.927204+0000","last_fullsized":"2024-04-18T21:10:24.927204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923084+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:24.923084+0000","last_peered":"2024-04-18T21:10:24.923084+0000","last_clean":"2024-04-18T21:10:24.923084+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:24.923084+0000","last_undegraded":"2024-04-18T21:10:24.923084+0000","last_fullsized":"2024-04-18T21:10:24.923084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":328,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932641+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:24.932641+0000","last_peered":"2024-04-18T21:10:24.932641+0000","last_clean":"2024-04-18T21:10:24.932641+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:24.932641+0000","last_undegraded":"2024-04-18T21:10:24.932641+0000","last_fullsized":"2024-04-18T21:10:24.932641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":595,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196746+0000","last_change":"2024-04-18T21:10:25.196746+0000","last_active":"2024-04-18T21:10:25.196746+0000","last_peered":"2024-04-18T21:07:22.946951+0000","last_clean":"2024-04-18T21:07:22.946951+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:10:25.196746+0000","last_undegraded":"2024-04-18T21:10:25.196746+0000","last_fullsized":"2024-04-18T21:10:25.196746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":222,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926518+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:24.926518+0000","last_peered":"2024-04-18T21:10:24.926518+0000","last_clean":"2024-04-18T21:10:24.926518+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:24.926518+0000","last_undegraded":"2024-04-18T21:10:24.926518+0000","last_fullsized":"2024-04-18T21:10:24.926518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28124,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28798976,"data_stored":84673283,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103528,"kb_used_data":27996,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268312,"statfs":{"total":96636764160,"available":96530751488,"internally_reserved":0,"allocated":28667904,"data_stored":81352623,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350980,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29072,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29769728,"data_stored":90498460,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:26.427 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:26.750 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:26.752 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:26.765 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-18T21:10:25.920332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265720,"kb_used_data":85192,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849800,"statfs":{"total":289910292480,"available":289638195200,"internally_reserved":0,"allocated":87236608,"data_stored":256524366,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035023"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924469+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:24.924469+0000","last_peered":"2024-04-18T21:10:24.924469+0000","last_clean":"2024-04-18T21:10:24.924469+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:24.924469+0000","last_undegraded":"2024-04-18T21:10:24.924469+0000","last_fullsized":"2024-04-18T21:10:24.924469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":608,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921942+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:24.921942+0000","last_peered":"2024-04-18T21:10:24.921942+0000","last_clean":"2024-04-18T21:10:24.921942+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:24.921942+0000","last_undegraded":"2024-04-18T21:10:24.921942+0000","last_fullsized":"2024-04-18T21:10:24.921942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":531,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.203812+0000","last_change":"2024-04-18T21:10:25.203812+0000","last_active":"2024-04-18T21:10:25.203812+0000","last_peered":"2024-04-18T21:07:22.957446+0000","last_clean":"2024-04-18T21:07:22.957446+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:10:25.203812+0000","last_undegraded":"2024-04-18T21:10:25.203812+0000","last_fullsized":"2024-04-18T21:10:25.203812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":530,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192955+0000","last_change":"2024-04-18T21:10:25.192955+0000","last_active":"2024-04-18T21:10:25.192955+0000","last_peered":"2024-04-18T21:07:22.948971+0000","last_clean":"2024-04-18T21:07:22.948971+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:10:25.192955+0000","last_undegraded":"2024-04-18T21:10:25.192955+0000","last_fullsized":"2024-04-18T21:10:25.192955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":610,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922801+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:24.922801+0000","last_peered":"2024-04-18T21:10:24.922801+0000","last_clean":"2024-04-18T21:10:24.922801+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:24.922801+0000","last_undegraded":"2024-04-18T21:10:24.922801+0000","last_fullsized":"2024-04-18T21:10:24.922801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":543,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196541+0000","last_change":"2024-04-18T21:10:25.196541+0000","last_active":"2024-04-18T21:10:25.196541+0000","last_peered":"2024-04-18T21:07:22.946960+0000","last_clean":"2024-04-18T21:07:22.946960+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:10:25.196541+0000","last_undegraded":"2024-04-18T21:10:25.196541+0000","last_fullsized":"2024-04-18T21:10:25.196541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":588,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.188244+0000","last_change":"2024-04-18T21:10:25.188244+0000","last_active":"2024-04-18T21:10:25.188244+0000","last_peered":"2024-04-18T21:07:22.949792+0000","last_clean":"2024-04-18T21:07:22.949792+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:10:25.188244+0000","last_undegraded":"2024-04-18T21:10:25.188244+0000","last_fullsized":"2024-04-18T21:10:25.188244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":522,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.191293+0000","last_change":"2024-04-18T21:10:25.191293+0000","last_active":"2024-04-18T21:10:25.191293+0000","last_peered":"2024-04-18T21:07:22.949804+0000","last_clean":"2024-04-18T21:07:22.949804+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:10:25.191293+0000","last_undegraded":"2024-04-18T21:10:25.191293+0000","last_fullsized":"2024-04-18T21:10:25.191293+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":659,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925633+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:24.925633+0000","last_peered":"2024-04-18T21:10:24.925633+0000","last_clean":"2024-04-18T21:10:24.925633+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:24.925633+0000","last_undegraded":"2024-04-18T21:10:24.925633+0000","last_fullsized":"2024-04-18T21:10:24.925633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":569,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923028+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:24.923028+0000","last_peered":"2024-04-18T21:10:24.923028+0000","last_clean":"2024-04-18T21:10:24.923028+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:24.923028+0000","last_undegraded":"2024-04-18T21:10:24.923028+0000","last_fullsized":"2024-04-18T21:10:24.923028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":515,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.202591+0000","last_change":"2024-04-18T21:10:25.202591+0000","last_active":"2024-04-18T21:10:25.202591+0000","last_peered":"2024-04-18T21:07:22.964633+0000","last_clean":"2024-04-18T21:07:22.964633+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:10:25.202591+0000","last_undegraded":"2024-04-18T21:10:25.202591+0000","last_fullsized":"2024-04-18T21:10:25.202591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":564,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921739+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:24.921739+0000","last_peered":"2024-04-18T21:10:24.921739+0000","last_clean":"2024-04-18T21:10:24.921739+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:24.921739+0000","last_undegraded":"2024-04-18T21:10:24.921739+0000","last_fullsized":"2024-04-18T21:10:24.921739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":596,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922512+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:24.922512+0000","last_peered":"2024-04-18T21:10:24.922512+0000","last_clean":"2024-04-18T21:10:24.922512+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:24.922512+0000","last_undegraded":"2024-04-18T21:10:24.922512+0000","last_fullsized":"2024-04-18T21:10:24.922512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":641,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749197+0000","last_change":"2024-04-18T21:10:25.191674+0000","last_active":"2024-04-18T21:10:25.191674+0000","last_peered":"2024-04-18T21:10:22.749197+0000","last_clean":"2024-04-18T21:10:22.749197+0000","last_became_active":"2024-04-18T21:10:17.140677+0000","last_became_peered":"2024-04-18T21:10:17.140677+0000","last_unstale":"2024-04-18T21:10:22.749197+0000","last_undegraded":"2024-04-18T21:10:22.749197+0000","last_fullsized":"2024-04-18T21:10:22.749197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":645,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749533+0000","last_change":"2024-04-18T21:10:25.188538+0000","last_active":"2024-04-18T21:10:25.188538+0000","last_peered":"2024-04-18T21:10:22.749533+0000","last_clean":"2024-04-18T21:10:22.749533+0000","last_became_active":"2024-04-18T21:10:17.131630+0000","last_became_peered":"2024-04-18T21:10:17.131630+0000","last_unstale":"2024-04-18T21:10:22.749533+0000","last_undegraded":"2024-04-18T21:10:22.749533+0000","last_fullsized":"2024-04-18T21:10:22.749533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":626,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200826+0000","last_change":"2024-04-18T21:10:25.200826+0000","last_active":"2024-04-18T21:10:25.200826+0000","last_peered":"2024-04-18T21:07:22.960697+0000","last_clean":"2024-04-18T21:07:22.960697+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:10:25.200826+0000","last_undegraded":"2024-04-18T21:10:25.200826+0000","last_fullsized":"2024-04-18T21:10:25.200826+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":589,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927224+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:24.927224+0000","last_peered":"2024-04-18T21:10:24.927224+0000","last_clean":"2024-04-18T21:10:24.927224+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:24.927224+0000","last_undegraded":"2024-04-18T21:10:24.927224+0000","last_fullsized":"2024-04-18T21:10:24.927224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":597,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923175+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:24.923175+0000","last_peered":"2024-04-18T21:10:24.923175+0000","last_clean":"2024-04-18T21:10:24.923175+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:24.923175+0000","last_undegraded":"2024-04-18T21:10:24.923175+0000","last_fullsized":"2024-04-18T21:10:24.923175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":628,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926866+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:24.926866+0000","last_peered":"2024-04-18T21:10:24.926866+0000","last_clean":"2024-04-18T21:10:24.926866+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:24.926866+0000","last_undegraded":"2024-04-18T21:10:24.926866+0000","last_fullsized":"2024-04-18T21:10:24.926866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":579,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.195904+0000","last_change":"2024-04-18T21:10:25.195904+0000","last_active":"2024-04-18T21:10:25.195904+0000","last_peered":"2024-04-18T21:07:22.916966+0000","last_clean":"2024-04-18T21:07:22.916966+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:10:25.195904+0000","last_undegraded":"2024-04-18T21:10:25.195904+0000","last_fullsized":"2024-04-18T21:10:25.195904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":526,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192946+0000","last_change":"2024-04-18T21:10:25.192946+0000","last_active":"2024-04-18T21:10:25.192946+0000","last_peered":"2024-04-18T21:07:22.958552+0000","last_clean":"2024-04-18T21:07:22.958552+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:10:25.192946+0000","last_undegraded":"2024-04-18T21:10:25.192946+0000","last_fullsized":"2024-04-18T21:10:25.192946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921021+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:24.921021+0000","last_peered":"2024-04-18T21:10:24.921021+0000","last_clean":"2024-04-18T21:10:24.921021+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:24.921021+0000","last_undegraded":"2024-04-18T21:10:24.921021+0000","last_fullsized":"2024-04-18T21:10:24.921021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":591,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925044+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:24.925044+0000","last_peered":"2024-04-18T21:10:24.925044+0000","last_clean":"2024-04-18T21:10:24.925044+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:24.925044+0000","last_undegraded":"2024-04-18T21:10:24.925044+0000","last_fullsized":"2024-04-18T21:10:24.925044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920783+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:24.920783+0000","last_peered":"2024-04-18T21:10:24.920783+0000","last_clean":"2024-04-18T21:10:24.920783+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:24.920783+0000","last_undegraded":"2024-04-18T21:10:24.920783+0000","last_fullsized":"2024-04-18T21:10:24.920783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":601,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924654+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:24.924654+0000","last_peered":"2024-04-18T21:10:24.924654+0000","last_clean":"2024-04-18T21:10:24.924654+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:24.924654+0000","last_undegraded":"2024-04-18T21:10:24.924654+0000","last_fullsized":"2024-04-18T21:10:24.924654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":740,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930675+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:24.930675+0000","last_peered":"2024-04-18T21:10:24.930675+0000","last_clean":"2024-04-18T21:10:24.930675+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:24.930675+0000","last_undegraded":"2024-04-18T21:10:24.930675+0000","last_fullsized":"2024-04-18T21:10:24.930675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":582,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750329+0000","last_change":"2024-04-18T21:10:25.200634+0000","last_active":"2024-04-18T21:10:25.200634+0000","last_peered":"2024-04-18T21:10:22.750329+0000","last_clean":"2024-04-18T21:10:22.750329+0000","last_became_active":"2024-04-18T21:10:17.157423+0000","last_became_peered":"2024-04-18T21:10:17.157423+0000","last_unstale":"2024-04-18T21:10:22.750329+0000","last_undegraded":"2024-04-18T21:10:22.750329+0000","last_fullsized":"2024-04-18T21:10:22.750329+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":647,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922768+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:24.922768+0000","last_peered":"2024-04-18T21:10:24.922768+0000","last_clean":"2024-04-18T21:10:24.922768+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:24.922768+0000","last_undegraded":"2024-04-18T21:10:24.922768+0000","last_fullsized":"2024-04-18T21:10:24.922768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930044+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:24.930044+0000","last_peered":"2024-04-18T21:10:24.930044+0000","last_clean":"2024-04-18T21:10:24.930044+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:24.930044+0000","last_undegraded":"2024-04-18T21:10:24.930044+0000","last_fullsized":"2024-04-18T21:10:24.930044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":691,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921793+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:24.921793+0000","last_peered":"2024-04-18T21:10:24.921793+0000","last_clean":"2024-04-18T21:10:24.921793+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:24.921793+0000","last_undegraded":"2024-04-18T21:10:24.921793+0000","last_fullsized":"2024-04-18T21:10:24.921793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":661,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926762+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:24.926762+0000","last_peered":"2024-04-18T21:10:24.926762+0000","last_clean":"2024-04-18T21:10:24.926762+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:24.926762+0000","last_undegraded":"2024-04-18T21:10:24.926762+0000","last_fullsized":"2024-04-18T21:10:24.926762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":599,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189432+0000","last_change":"2024-04-18T21:10:25.189432+0000","last_active":"2024-04-18T21:10:25.189432+0000","last_peered":"2024-04-18T21:07:22.952459+0000","last_clean":"2024-04-18T21:07:22.952459+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:10:25.189432+0000","last_undegraded":"2024-04-18T21:10:25.189432+0000","last_fullsized":"2024-04-18T21:10:25.189432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":578,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922439+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:24.922439+0000","last_peered":"2024-04-18T21:10:24.922439+0000","last_clean":"2024-04-18T21:10:24.922439+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:24.922439+0000","last_undegraded":"2024-04-18T21:10:24.922439+0000","last_fullsized":"2024-04-18T21:10:24.922439+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":620,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189324+0000","last_change":"2024-04-18T21:10:25.189324+0000","last_active":"2024-04-18T21:10:25.189324+0000","last_peered":"2024-04-18T21:06:59.247748+0000","last_clean":"2024-04-18T21:06:59.247748+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:10:25.189324+0000","last_undegraded":"2024-04-18T21:10:25.189324+0000","last_fullsized":"2024-04-18T21:10:25.189324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":583,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":216,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929036+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:24.929036+0000","last_peered":"2024-04-18T21:10:24.929036+0000","last_clean":"2024-04-18T21:10:24.929036+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:24.929036+0000","last_undegraded":"2024-04-18T21:10:24.929036+0000","last_fullsized":"2024-04-18T21:10:24.929036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":620,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932977+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:24.932977+0000","last_peered":"2024-04-18T21:10:24.932977+0000","last_clean":"2024-04-18T21:10:24.932977+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:24.932977+0000","last_undegraded":"2024-04-18T21:10:24.932977+0000","last_fullsized":"2024-04-18T21:10:24.932977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":244,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922379+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:24.922379+0000","last_peered":"2024-04-18T21:10:24.922379+0000","last_clean":"2024-04-18T21:10:24.922379+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:24.922379+0000","last_undegraded":"2024-04-18T21:10:24.922379+0000","last_fullsized":"2024-04-18T21:10:24.922379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925970+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:24.925970+0000","last_peered":"2024-04-18T21:10:24.925970+0000","last_clean":"2024-04-18T21:10:24.925970+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:24.925970+0000","last_undegraded":"2024-04-18T21:10:24.925970+0000","last_fullsized":"2024-04-18T21:10:24.925970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":161,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747867+0000","last_change":"2024-04-18T21:10:25.187369+0000","last_active":"2024-04-18T21:10:25.187369+0000","last_peered":"2024-04-18T21:10:22.747867+0000","last_clean":"2024-04-18T21:10:22.747867+0000","last_became_active":"2024-04-18T21:10:17.136098+0000","last_became_peered":"2024-04-18T21:10:17.136098+0000","last_unstale":"2024-04-18T21:10:22.747867+0000","last_undegraded":"2024-04-18T21:10:22.747867+0000","last_fullsized":"2024-04-18T21:10:22.747867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":170,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200983+0000","last_change":"2024-04-18T21:10:25.200983+0000","last_active":"2024-04-18T21:10:25.200983+0000","last_peered":"2024-04-18T21:07:11.855434+0000","last_clean":"2024-04-18T21:07:11.855434+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:10:25.200983+0000","last_undegraded":"2024-04-18T21:10:25.200983+0000","last_fullsized":"2024-04-18T21:10:25.200983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":604,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920982+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:24.920982+0000","last_peered":"2024-04-18T21:10:24.920982+0000","last_clean":"2024-04-18T21:10:24.920982+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:24.920982+0000","last_undegraded":"2024-04-18T21:10:24.920982+0000","last_fullsized":"2024-04-18T21:10:24.920982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":447,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923884+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:24.923884+0000","last_peered":"2024-04-18T21:10:24.923884+0000","last_clean":"2024-04-18T21:10:24.923884+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:24.923884+0000","last_undegraded":"2024-04-18T21:10:24.923884+0000","last_fullsized":"2024-04-18T21:10:24.923884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":644,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920935+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:24.920935+0000","last_peered":"2024-04-18T21:10:24.920935+0000","last_clean":"2024-04-18T21:10:24.920935+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:24.920935+0000","last_undegraded":"2024-04-18T21:10:24.920935+0000","last_fullsized":"2024-04-18T21:10:24.920935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":615,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750052+0000","last_change":"2024-04-18T21:10:25.194627+0000","last_active":"2024-04-18T21:10:25.194627+0000","last_peered":"2024-04-18T21:10:22.750052+0000","last_clean":"2024-04-18T21:10:22.750052+0000","last_became_active":"2024-04-18T21:10:17.138701+0000","last_became_peered":"2024-04-18T21:10:17.138701+0000","last_unstale":"2024-04-18T21:10:22.750052+0000","last_undegraded":"2024-04-18T21:10:22.750052+0000","last_fullsized":"2024-04-18T21:10:22.750052+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":691,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196497+0000","last_change":"2024-04-18T21:10:25.196497+0000","last_active":"2024-04-18T21:10:25.196497+0000","last_peered":"2024-04-18T21:07:22.953093+0000","last_clean":"2024-04-18T21:07:22.953093+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:10:25.196497+0000","last_undegraded":"2024-04-18T21:10:25.196497+0000","last_fullsized":"2024-04-18T21:10:25.196497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199958+0000","last_change":"2024-04-18T21:06:41.751008+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.199958+0000","last_undegraded":"2024-04-18T21:10:25.199958+0000","last_fullsized":"2024-04-18T21:10:25.199958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":698,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930213+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:24.930213+0000","last_peered":"2024-04-18T21:10:24.930213+0000","last_clean":"2024-04-18T21:10:24.930213+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:24.930213+0000","last_undegraded":"2024-04-18T21:10:24.930213+0000","last_fullsized":"2024-04-18T21:10:24.930213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":334,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932961+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:24.932961+0000","last_peered":"2024-04-18T21:10:24.932961+0000","last_clean":"2024-04-18T21:10:24.932961+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:24.932961+0000","last_undegraded":"2024-04-18T21:10:24.932961+0000","last_fullsized":"2024-04-18T21:10:24.932961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":617,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.204345+0000","last_change":"2024-04-18T21:10:25.204345+0000","last_active":"2024-04-18T21:10:25.204345+0000","last_peered":"2024-04-18T21:07:22.956950+0000","last_clean":"2024-04-18T21:07:22.956950+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:10:25.204345+0000","last_undegraded":"2024-04-18T21:10:25.204345+0000","last_fullsized":"2024-04-18T21:10:25.204345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":117,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189043+0000","last_change":"2024-04-18T21:10:25.189043+0000","last_active":"2024-04-18T21:10:25.189043+0000","last_peered":"2024-04-18T21:07:12.552712+0000","last_clean":"2024-04-18T21:07:12.552712+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:10:25.189043+0000","last_undegraded":"2024-04-18T21:10:25.189043+0000","last_fullsized":"2024-04-18T21:10:25.189043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749766+0000","last_change":"2024-04-18T21:10:25.200048+0000","last_active":"2024-04-18T21:10:25.200048+0000","last_peered":"2024-04-18T21:10:22.749766+0000","last_clean":"2024-04-18T21:10:22.749766+0000","last_became_active":"2024-04-18T21:10:17.140649+0000","last_became_peered":"2024-04-18T21:10:17.140649+0000","last_unstale":"2024-04-18T21:10:22.749766+0000","last_undegraded":"2024-04-18T21:10:22.749766+0000","last_fullsized":"2024-04-18T21:10:22.749766+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922666+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:24.922666+0000","last_peered":"2024-04-18T21:10:24.922666+0000","last_clean":"2024-04-18T21:10:24.922666+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:24.922666+0000","last_undegraded":"2024-04-18T21:10:24.922666+0000","last_fullsized":"2024-04-18T21:10:24.922666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":516,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199668+0000","last_change":"2024-04-18T21:10:25.199668+0000","last_active":"2024-04-18T21:10:25.199668+0000","last_peered":"2024-04-18T21:07:22.962835+0000","last_clean":"2024-04-18T21:07:22.962835+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:10:25.199668+0000","last_undegraded":"2024-04-18T21:10:25.199668+0000","last_fullsized":"2024-04-18T21:10:25.199668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":554,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921454+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:24.921454+0000","last_peered":"2024-04-18T21:10:24.921454+0000","last_clean":"2024-04-18T21:10:24.921454+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:24.921454+0000","last_undegraded":"2024-04-18T21:10:24.921454+0000","last_fullsized":"2024-04-18T21:10:24.921454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":672,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926255+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:24.926255+0000","last_peered":"2024-04-18T21:10:24.926255+0000","last_clean":"2024-04-18T21:10:24.926255+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:24.926255+0000","last_undegraded":"2024-04-18T21:10:24.926255+0000","last_fullsized":"2024-04-18T21:10:24.926255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":318,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747803+0000","last_change":"2024-04-18T21:10:25.193958+0000","last_active":"2024-04-18T21:10:25.193958+0000","last_peered":"2024-04-18T21:10:22.747803+0000","last_clean":"2024-04-18T21:10:22.747803+0000","last_became_active":"2024-04-18T21:10:17.135600+0000","last_became_peered":"2024-04-18T21:10:17.135600+0000","last_unstale":"2024-04-18T21:10:22.747803+0000","last_undegraded":"2024-04-18T21:10:22.747803+0000","last_fullsized":"2024-04-18T21:10:22.747803+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187633+0000","last_change":"2024-04-18T21:10:16.682987+0000","last_active":"2024-04-18T21:10:16.682987+0000","last_peered":"2024-04-18T21:10:14.839769+0000","last_clean":"2024-04-18T21:07:30.994987+0000","last_became_active":"2024-04-18T21:07:34.057035+0000","last_became_peered":"2024-04-18T21:07:34.057035+0000","last_unstale":"2024-04-18T21:10:25.187633+0000","last_undegraded":"2024-04-18T21:10:25.187633+0000","last_fullsized":"2024-04-18T21:10:25.187633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":502,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930566+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:24.930566+0000","last_peered":"2024-04-18T21:10:24.930566+0000","last_clean":"2024-04-18T21:10:24.930566+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:24.930566+0000","last_undegraded":"2024-04-18T21:10:24.930566+0000","last_fullsized":"2024-04-18T21:10:24.930566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750092+0000","last_change":"2024-04-18T21:10:25.197311+0000","last_active":"2024-04-18T21:10:25.197311+0000","last_peered":"2024-04-18T21:10:22.750092+0000","last_clean":"2024-04-18T21:10:22.750092+0000","last_became_active":"2024-04-18T21:10:17.141516+0000","last_became_peered":"2024-04-18T21:10:17.141516+0000","last_unstale":"2024-04-18T21:10:22.750092+0000","last_undegraded":"2024-04-18T21:10:22.750092+0000","last_fullsized":"2024-04-18T21:10:22.750092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.914142+0000","last_change":"2024-04-18T21:10:17.128341+0000","last_active":"2024-04-18T21:10:17.128341+0000","last_peered":"2024-04-18T21:10:14.838882+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.051041+0000","last_became_peered":"2024-04-18T21:07:34.051041+0000","last_unstale":"2024-04-18T21:10:23.914142+0000","last_undegraded":"2024-04-18T21:10:23.914142+0000","last_fullsized":"2024-04-18T21:10:23.914142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932208+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:24.932208+0000","last_peered":"2024-04-18T21:10:24.932208+0000","last_clean":"2024-04-18T21:10:24.932208+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:24.932208+0000","last_undegraded":"2024-04-18T21:10:24.932208+0000","last_fullsized":"2024-04-18T21:10:24.932208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":704,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923628+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:24.923628+0000","last_peered":"2024-04-18T21:10:24.923628+0000","last_clean":"2024-04-18T21:10:24.923628+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:24.923628+0000","last_undegraded":"2024-04-18T21:10:24.923628+0000","last_fullsized":"2024-04-18T21:10:24.923628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932950+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:24.932950+0000","last_peered":"2024-04-18T21:10:24.932950+0000","last_clean":"2024-04-18T21:10:24.932950+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:24.932950+0000","last_undegraded":"2024-04-18T21:10:24.932950+0000","last_fullsized":"2024-04-18T21:10:24.932950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":449,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921615+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:24.921615+0000","last_peered":"2024-04-18T21:10:24.921615+0000","last_clean":"2024-04-18T21:10:24.921615+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:24.921615+0000","last_undegraded":"2024-04-18T21:10:24.921615+0000","last_fullsized":"2024-04-18T21:10:24.921615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":534,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923013+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:24.923013+0000","last_peered":"2024-04-18T21:10:24.923013+0000","last_clean":"2024-04-18T21:10:24.923013+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:24.923013+0000","last_undegraded":"2024-04-18T21:10:24.923013+0000","last_fullsized":"2024-04-18T21:10:24.923013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187440+0000","last_change":"2024-04-18T21:10:16.682526+0000","last_active":"2024-04-18T21:10:16.682526+0000","last_peered":"2024-04-18T21:10:14.840654+0000","last_clean":"2024-04-18T21:07:30.995015+0000","last_became_active":"2024-04-18T21:07:34.045061+0000","last_became_peered":"2024-04-18T21:07:34.045061+0000","last_unstale":"2024-04-18T21:10:25.187440+0000","last_undegraded":"2024-04-18T21:10:25.187440+0000","last_fullsized":"2024-04-18T21:10:25.187440+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187794+0000","last_change":"2024-04-18T21:06:41.751500+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.187794+0000","last_undegraded":"2024-04-18T21:10:25.187794+0000","last_fullsized":"2024-04-18T21:10:25.187794+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933361+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:24.933361+0000","last_peered":"2024-04-18T21:10:24.933361+0000","last_clean":"2024-04-18T21:10:24.933361+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:24.933361+0000","last_undegraded":"2024-04-18T21:10:24.933361+0000","last_fullsized":"2024-04-18T21:10:24.933361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":285,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190938+0000","last_change":"2024-04-18T21:10:25.190938+0000","last_active":"2024-04-18T21:10:25.190938+0000","last_peered":"2024-04-18T21:07:20.021859+0000","last_clean":"2024-04-18T21:07:20.021859+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:10:25.190938+0000","last_undegraded":"2024-04-18T21:10:25.190938+0000","last_fullsized":"2024-04-18T21:10:25.190938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933948+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:24.933948+0000","last_peered":"2024-04-18T21:10:24.933948+0000","last_clean":"2024-04-18T21:10:24.933948+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:24.933948+0000","last_undegraded":"2024-04-18T21:10:24.933948+0000","last_fullsized":"2024-04-18T21:10:24.933948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":575,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921470+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:24.921470+0000","last_peered":"2024-04-18T21:10:24.921470+0000","last_clean":"2024-04-18T21:10:24.921470+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:24.921470+0000","last_undegraded":"2024-04-18T21:10:24.921470+0000","last_fullsized":"2024-04-18T21:10:24.921470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933724+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:24.933724+0000","last_peered":"2024-04-18T21:10:24.933724+0000","last_clean":"2024-04-18T21:10:24.933724+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:24.933724+0000","last_undegraded":"2024-04-18T21:10:24.933724+0000","last_fullsized":"2024-04-18T21:10:24.933724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928748+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:24.928748+0000","last_peered":"2024-04-18T21:10:24.928748+0000","last_clean":"2024-04-18T21:10:24.928748+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:24.928748+0000","last_undegraded":"2024-04-18T21:10:24.928748+0000","last_fullsized":"2024-04-18T21:10:24.928748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":587,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925008+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:24.925008+0000","last_peered":"2024-04-18T21:10:24.925008+0000","last_clean":"2024-04-18T21:10:24.925008+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:24.925008+0000","last_undegraded":"2024-04-18T21:10:24.925008+0000","last_fullsized":"2024-04-18T21:10:24.925008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927275+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:24.927275+0000","last_peered":"2024-04-18T21:10:24.927275+0000","last_clean":"2024-04-18T21:10:24.927275+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:24.927275+0000","last_undegraded":"2024-04-18T21:10:24.927275+0000","last_fullsized":"2024-04-18T21:10:24.927275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933808+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:24.933808+0000","last_peered":"2024-04-18T21:10:24.933808+0000","last_clean":"2024-04-18T21:10:24.933808+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:24.933808+0000","last_undegraded":"2024-04-18T21:10:24.933808+0000","last_fullsized":"2024-04-18T21:10:24.933808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":559,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928910+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:24.928910+0000","last_peered":"2024-04-18T21:10:24.928910+0000","last_clean":"2024-04-18T21:10:24.928910+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:24.928910+0000","last_undegraded":"2024-04-18T21:10:24.928910+0000","last_fullsized":"2024-04-18T21:10:24.928910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":239,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933343+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:24.933343+0000","last_peered":"2024-04-18T21:10:24.933343+0000","last_clean":"2024-04-18T21:10:24.933343+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:24.933343+0000","last_undegraded":"2024-04-18T21:10:24.933343+0000","last_fullsized":"2024-04-18T21:10:24.933343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.917433+0000","last_change":"2024-04-18T21:10:17.121796+0000","last_active":"2024-04-18T21:10:17.121796+0000","last_peered":"2024-04-18T21:10:14.840628+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.054276+0000","last_became_peered":"2024-04-18T21:07:34.054276+0000","last_unstale":"2024-04-18T21:10:23.917433+0000","last_undegraded":"2024-04-18T21:10:23.917433+0000","last_fullsized":"2024-04-18T21:10:23.917433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":614,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921123+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:24.921123+0000","last_peered":"2024-04-18T21:10:24.921123+0000","last_clean":"2024-04-18T21:10:24.921123+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:24.921123+0000","last_undegraded":"2024-04-18T21:10:24.921123+0000","last_fullsized":"2024-04-18T21:10:24.921123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":625,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749809+0000","last_change":"2024-04-18T21:10:25.191106+0000","last_active":"2024-04-18T21:10:25.191106+0000","last_peered":"2024-04-18T21:10:22.749809+0000","last_clean":"2024-04-18T21:10:22.749809+0000","last_became_active":"2024-04-18T21:10:17.134137+0000","last_became_peered":"2024-04-18T21:10:17.134137+0000","last_unstale":"2024-04-18T21:10:22.749809+0000","last_undegraded":"2024-04-18T21:10:22.749809+0000","last_fullsized":"2024-04-18T21:10:22.749809+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":386,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.748811+0000","last_change":"2024-04-18T21:10:25.190602+0000","last_active":"2024-04-18T21:10:25.190602+0000","last_peered":"2024-04-18T21:10:22.748811+0000","last_clean":"2024-04-18T21:10:22.748811+0000","last_became_active":"2024-04-18T21:10:17.133733+0000","last_became_peered":"2024-04-18T21:10:17.133733+0000","last_unstale":"2024-04-18T21:10:22.748811+0000","last_undegraded":"2024-04-18T21:10:22.748811+0000","last_fullsized":"2024-04-18T21:10:22.748811+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":567,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926718+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:24.926718+0000","last_peered":"2024-04-18T21:10:24.926718+0000","last_clean":"2024-04-18T21:10:24.926718+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:24.926718+0000","last_undegraded":"2024-04-18T21:10:24.926718+0000","last_fullsized":"2024-04-18T21:10:24.926718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":240,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927489+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:24.927489+0000","last_peered":"2024-04-18T21:10:24.927489+0000","last_clean":"2024-04-18T21:10:24.927489+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:24.927489+0000","last_undegraded":"2024-04-18T21:10:24.927489+0000","last_fullsized":"2024-04-18T21:10:24.927489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":258,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196450+0000","last_change":"2024-04-18T21:10:25.196450+0000","last_active":"2024-04-18T21:10:25.196450+0000","last_peered":"2024-04-18T21:07:18.651325+0000","last_clean":"2024-04-18T21:07:18.651325+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:10:25.196450+0000","last_undegraded":"2024-04-18T21:10:25.196450+0000","last_fullsized":"2024-04-18T21:10:25.196450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":666,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926999+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:24.926999+0000","last_peered":"2024-04-18T21:10:24.926999+0000","last_clean":"2024-04-18T21:10:24.926999+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:24.926999+0000","last_undegraded":"2024-04-18T21:10:24.926999+0000","last_fullsized":"2024-04-18T21:10:24.926999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":618,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927941+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:24.927941+0000","last_peered":"2024-04-18T21:10:24.927941+0000","last_clean":"2024-04-18T21:10:24.927941+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:24.927941+0000","last_undegraded":"2024-04-18T21:10:24.927941+0000","last_fullsized":"2024-04-18T21:10:24.927941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":526,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924972+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:24.924972+0000","last_peered":"2024-04-18T21:10:24.924972+0000","last_clean":"2024-04-18T21:10:24.924972+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:24.924972+0000","last_undegraded":"2024-04-18T21:10:24.924972+0000","last_fullsized":"2024-04-18T21:10:24.924972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":772,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929236+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:24.929236+0000","last_peered":"2024-04-18T21:10:24.929236+0000","last_clean":"2024-04-18T21:10:24.929236+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:24.929236+0000","last_undegraded":"2024-04-18T21:10:24.929236+0000","last_fullsized":"2024-04-18T21:10:24.929236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932149+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:24.932149+0000","last_peered":"2024-04-18T21:10:24.932149+0000","last_clean":"2024-04-18T21:10:24.932149+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:24.932149+0000","last_undegraded":"2024-04-18T21:10:24.932149+0000","last_fullsized":"2024-04-18T21:10:24.932149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":369,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929014+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:24.929014+0000","last_peered":"2024-04-18T21:10:24.929014+0000","last_clean":"2024-04-18T21:10:24.929014+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:24.929014+0000","last_undegraded":"2024-04-18T21:10:24.929014+0000","last_fullsized":"2024-04-18T21:10:24.929014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":599,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925836+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:24.925836+0000","last_peered":"2024-04-18T21:10:24.925836+0000","last_clean":"2024-04-18T21:10:24.925836+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:24.925836+0000","last_undegraded":"2024-04-18T21:10:24.925836+0000","last_fullsized":"2024-04-18T21:10:24.925836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":290,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922229+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:24.922229+0000","last_peered":"2024-04-18T21:10:24.922229+0000","last_clean":"2024-04-18T21:10:24.922229+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:24.922229+0000","last_undegraded":"2024-04-18T21:10:24.922229+0000","last_fullsized":"2024-04-18T21:10:24.922229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":561,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922143+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:24.922143+0000","last_peered":"2024-04-18T21:10:24.922143+0000","last_clean":"2024-04-18T21:10:24.922143+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:24.922143+0000","last_undegraded":"2024-04-18T21:10:24.922143+0000","last_fullsized":"2024-04-18T21:10:24.922143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922718+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:24.922718+0000","last_peered":"2024-04-18T21:10:24.922718+0000","last_clean":"2024-04-18T21:10:24.922718+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:24.922718+0000","last_undegraded":"2024-04-18T21:10:24.922718+0000","last_fullsized":"2024-04-18T21:10:24.922718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":520,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190983+0000","last_change":"2024-04-18T21:10:25.190983+0000","last_active":"2024-04-18T21:10:25.190983+0000","last_peered":"2024-04-18T21:07:22.960952+0000","last_clean":"2024-04-18T21:07:22.960952+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:10:25.190983+0000","last_undegraded":"2024-04-18T21:10:25.190983+0000","last_fullsized":"2024-04-18T21:10:25.190983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":244,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189285+0000","last_change":"2024-04-18T21:10:25.189285+0000","last_active":"2024-04-18T21:10:25.189285+0000","last_peered":"2024-04-18T21:07:09.916748+0000","last_clean":"2024-04-18T21:07:09.916748+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:10:25.189285+0000","last_undegraded":"2024-04-18T21:10:25.189285+0000","last_fullsized":"2024-04-18T21:10:25.189285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":554,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189389+0000","last_change":"2024-04-18T21:10:25.189389+0000","last_active":"2024-04-18T21:10:25.189389+0000","last_peered":"2024-04-18T21:07:22.917646+0000","last_clean":"2024-04-18T21:07:22.917646+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:10:25.189389+0000","last_undegraded":"2024-04-18T21:10:25.189389+0000","last_fullsized":"2024-04-18T21:10:25.189389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927204+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:24.927204+0000","last_peered":"2024-04-18T21:10:24.927204+0000","last_clean":"2024-04-18T21:10:24.927204+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:24.927204+0000","last_undegraded":"2024-04-18T21:10:24.927204+0000","last_fullsized":"2024-04-18T21:10:24.927204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923084+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:24.923084+0000","last_peered":"2024-04-18T21:10:24.923084+0000","last_clean":"2024-04-18T21:10:24.923084+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:24.923084+0000","last_undegraded":"2024-04-18T21:10:24.923084+0000","last_fullsized":"2024-04-18T21:10:24.923084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":328,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932641+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:24.932641+0000","last_peered":"2024-04-18T21:10:24.932641+0000","last_clean":"2024-04-18T21:10:24.932641+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:24.932641+0000","last_undegraded":"2024-04-18T21:10:24.932641+0000","last_fullsized":"2024-04-18T21:10:24.932641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":595,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196746+0000","last_change":"2024-04-18T21:10:25.196746+0000","last_active":"2024-04-18T21:10:25.196746+0000","last_peered":"2024-04-18T21:07:22.946951+0000","last_clean":"2024-04-18T21:07:22.946951+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:10:25.196746+0000","last_undegraded":"2024-04-18T21:10:25.196746+0000","last_fullsized":"2024-04-18T21:10:25.196746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":222,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926518+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:24.926518+0000","last_peered":"2024-04-18T21:10:24.926518+0000","last_clean":"2024-04-18T21:10:24.926518+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:24.926518+0000","last_undegraded":"2024-04-18T21:10:24.926518+0000","last_fullsized":"2024-04-18T21:10:24.926518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28124,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28798976,"data_stored":84673283,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103528,"kb_used_data":27996,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268312,"statfs":{"total":96636764160,"available":96530751488,"internally_reserved":0,"allocated":28667904,"data_stored":81352623,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350980,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29072,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29769728,"data_stored":90498460,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:26.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-18T21:10:27.132 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:27.132 INFO:teuthology.orchestra.run.smithi096.stdout:{"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 2 pgs inactive, 24 pgs peering","count":26},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":340,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":89,"num_osds":3,"num_up_osds":3,"osd_up_since":1713474615,"num_in_osds":3,"osd_in_since":1713474287,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"peering","count":38}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127727781,"bytes_used":272097280,"bytes_avail":289638195200,"bytes_total":289910292480,"inactive_pgs_ratio":0.36190477013587952},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-18T21:06:15.623145+0000","services":{}},"progress_events":{}} 2024-04-18T21:10:27.149 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-18T21:10:27.149 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:27.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:27.421 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:27.436 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-18T21:10:25.920332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265720,"kb_used_data":85192,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849800,"statfs":{"total":289910292480,"available":289638195200,"internally_reserved":0,"allocated":87236608,"data_stored":256524366,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035023"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924469+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:24.924469+0000","last_peered":"2024-04-18T21:10:24.924469+0000","last_clean":"2024-04-18T21:10:24.924469+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:24.924469+0000","last_undegraded":"2024-04-18T21:10:24.924469+0000","last_fullsized":"2024-04-18T21:10:24.924469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":608,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921942+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:24.921942+0000","last_peered":"2024-04-18T21:10:24.921942+0000","last_clean":"2024-04-18T21:10:24.921942+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:24.921942+0000","last_undegraded":"2024-04-18T21:10:24.921942+0000","last_fullsized":"2024-04-18T21:10:24.921942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":531,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.203812+0000","last_change":"2024-04-18T21:10:25.203812+0000","last_active":"2024-04-18T21:10:25.203812+0000","last_peered":"2024-04-18T21:07:22.957446+0000","last_clean":"2024-04-18T21:07:22.957446+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:10:25.203812+0000","last_undegraded":"2024-04-18T21:10:25.203812+0000","last_fullsized":"2024-04-18T21:10:25.203812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":530,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192955+0000","last_change":"2024-04-18T21:10:25.192955+0000","last_active":"2024-04-18T21:10:25.192955+0000","last_peered":"2024-04-18T21:07:22.948971+0000","last_clean":"2024-04-18T21:07:22.948971+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:10:25.192955+0000","last_undegraded":"2024-04-18T21:10:25.192955+0000","last_fullsized":"2024-04-18T21:10:25.192955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":610,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922801+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:24.922801+0000","last_peered":"2024-04-18T21:10:24.922801+0000","last_clean":"2024-04-18T21:10:24.922801+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:24.922801+0000","last_undegraded":"2024-04-18T21:10:24.922801+0000","last_fullsized":"2024-04-18T21:10:24.922801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":543,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196541+0000","last_change":"2024-04-18T21:10:25.196541+0000","last_active":"2024-04-18T21:10:25.196541+0000","last_peered":"2024-04-18T21:07:22.946960+0000","last_clean":"2024-04-18T21:07:22.946960+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:10:25.196541+0000","last_undegraded":"2024-04-18T21:10:25.196541+0000","last_fullsized":"2024-04-18T21:10:25.196541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":588,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.188244+0000","last_change":"2024-04-18T21:10:25.188244+0000","last_active":"2024-04-18T21:10:25.188244+0000","last_peered":"2024-04-18T21:07:22.949792+0000","last_clean":"2024-04-18T21:07:22.949792+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:10:25.188244+0000","last_undegraded":"2024-04-18T21:10:25.188244+0000","last_fullsized":"2024-04-18T21:10:25.188244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":522,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.191293+0000","last_change":"2024-04-18T21:10:25.191293+0000","last_active":"2024-04-18T21:10:25.191293+0000","last_peered":"2024-04-18T21:07:22.949804+0000","last_clean":"2024-04-18T21:07:22.949804+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:10:25.191293+0000","last_undegraded":"2024-04-18T21:10:25.191293+0000","last_fullsized":"2024-04-18T21:10:25.191293+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":659,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925633+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:24.925633+0000","last_peered":"2024-04-18T21:10:24.925633+0000","last_clean":"2024-04-18T21:10:24.925633+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:24.925633+0000","last_undegraded":"2024-04-18T21:10:24.925633+0000","last_fullsized":"2024-04-18T21:10:24.925633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":569,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923028+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:24.923028+0000","last_peered":"2024-04-18T21:10:24.923028+0000","last_clean":"2024-04-18T21:10:24.923028+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:24.923028+0000","last_undegraded":"2024-04-18T21:10:24.923028+0000","last_fullsized":"2024-04-18T21:10:24.923028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":515,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.202591+0000","last_change":"2024-04-18T21:10:25.202591+0000","last_active":"2024-04-18T21:10:25.202591+0000","last_peered":"2024-04-18T21:07:22.964633+0000","last_clean":"2024-04-18T21:07:22.964633+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:10:25.202591+0000","last_undegraded":"2024-04-18T21:10:25.202591+0000","last_fullsized":"2024-04-18T21:10:25.202591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":564,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921739+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:24.921739+0000","last_peered":"2024-04-18T21:10:24.921739+0000","last_clean":"2024-04-18T21:10:24.921739+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:24.921739+0000","last_undegraded":"2024-04-18T21:10:24.921739+0000","last_fullsized":"2024-04-18T21:10:24.921739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":596,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922512+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:24.922512+0000","last_peered":"2024-04-18T21:10:24.922512+0000","last_clean":"2024-04-18T21:10:24.922512+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:24.922512+0000","last_undegraded":"2024-04-18T21:10:24.922512+0000","last_fullsized":"2024-04-18T21:10:24.922512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":641,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749197+0000","last_change":"2024-04-18T21:10:25.191674+0000","last_active":"2024-04-18T21:10:25.191674+0000","last_peered":"2024-04-18T21:10:22.749197+0000","last_clean":"2024-04-18T21:10:22.749197+0000","last_became_active":"2024-04-18T21:10:17.140677+0000","last_became_peered":"2024-04-18T21:10:17.140677+0000","last_unstale":"2024-04-18T21:10:22.749197+0000","last_undegraded":"2024-04-18T21:10:22.749197+0000","last_fullsized":"2024-04-18T21:10:22.749197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":645,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749533+0000","last_change":"2024-04-18T21:10:25.188538+0000","last_active":"2024-04-18T21:10:25.188538+0000","last_peered":"2024-04-18T21:10:22.749533+0000","last_clean":"2024-04-18T21:10:22.749533+0000","last_became_active":"2024-04-18T21:10:17.131630+0000","last_became_peered":"2024-04-18T21:10:17.131630+0000","last_unstale":"2024-04-18T21:10:22.749533+0000","last_undegraded":"2024-04-18T21:10:22.749533+0000","last_fullsized":"2024-04-18T21:10:22.749533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":626,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200826+0000","last_change":"2024-04-18T21:10:25.200826+0000","last_active":"2024-04-18T21:10:25.200826+0000","last_peered":"2024-04-18T21:07:22.960697+0000","last_clean":"2024-04-18T21:07:22.960697+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:10:25.200826+0000","last_undegraded":"2024-04-18T21:10:25.200826+0000","last_fullsized":"2024-04-18T21:10:25.200826+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":589,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927224+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:24.927224+0000","last_peered":"2024-04-18T21:10:24.927224+0000","last_clean":"2024-04-18T21:10:24.927224+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:24.927224+0000","last_undegraded":"2024-04-18T21:10:24.927224+0000","last_fullsized":"2024-04-18T21:10:24.927224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":597,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923175+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:24.923175+0000","last_peered":"2024-04-18T21:10:24.923175+0000","last_clean":"2024-04-18T21:10:24.923175+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:24.923175+0000","last_undegraded":"2024-04-18T21:10:24.923175+0000","last_fullsized":"2024-04-18T21:10:24.923175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":628,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926866+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:24.926866+0000","last_peered":"2024-04-18T21:10:24.926866+0000","last_clean":"2024-04-18T21:10:24.926866+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:24.926866+0000","last_undegraded":"2024-04-18T21:10:24.926866+0000","last_fullsized":"2024-04-18T21:10:24.926866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":579,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.195904+0000","last_change":"2024-04-18T21:10:25.195904+0000","last_active":"2024-04-18T21:10:25.195904+0000","last_peered":"2024-04-18T21:07:22.916966+0000","last_clean":"2024-04-18T21:07:22.916966+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:10:25.195904+0000","last_undegraded":"2024-04-18T21:10:25.195904+0000","last_fullsized":"2024-04-18T21:10:25.195904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":526,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192946+0000","last_change":"2024-04-18T21:10:25.192946+0000","last_active":"2024-04-18T21:10:25.192946+0000","last_peered":"2024-04-18T21:07:22.958552+0000","last_clean":"2024-04-18T21:07:22.958552+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:10:25.192946+0000","last_undegraded":"2024-04-18T21:10:25.192946+0000","last_fullsized":"2024-04-18T21:10:25.192946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921021+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:24.921021+0000","last_peered":"2024-04-18T21:10:24.921021+0000","last_clean":"2024-04-18T21:10:24.921021+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:24.921021+0000","last_undegraded":"2024-04-18T21:10:24.921021+0000","last_fullsized":"2024-04-18T21:10:24.921021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":591,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925044+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:24.925044+0000","last_peered":"2024-04-18T21:10:24.925044+0000","last_clean":"2024-04-18T21:10:24.925044+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:24.925044+0000","last_undegraded":"2024-04-18T21:10:24.925044+0000","last_fullsized":"2024-04-18T21:10:24.925044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920783+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:24.920783+0000","last_peered":"2024-04-18T21:10:24.920783+0000","last_clean":"2024-04-18T21:10:24.920783+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:24.920783+0000","last_undegraded":"2024-04-18T21:10:24.920783+0000","last_fullsized":"2024-04-18T21:10:24.920783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":601,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924654+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:24.924654+0000","last_peered":"2024-04-18T21:10:24.924654+0000","last_clean":"2024-04-18T21:10:24.924654+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:24.924654+0000","last_undegraded":"2024-04-18T21:10:24.924654+0000","last_fullsized":"2024-04-18T21:10:24.924654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":740,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930675+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:24.930675+0000","last_peered":"2024-04-18T21:10:24.930675+0000","last_clean":"2024-04-18T21:10:24.930675+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:24.930675+0000","last_undegraded":"2024-04-18T21:10:24.930675+0000","last_fullsized":"2024-04-18T21:10:24.930675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":582,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750329+0000","last_change":"2024-04-18T21:10:25.200634+0000","last_active":"2024-04-18T21:10:25.200634+0000","last_peered":"2024-04-18T21:10:22.750329+0000","last_clean":"2024-04-18T21:10:22.750329+0000","last_became_active":"2024-04-18T21:10:17.157423+0000","last_became_peered":"2024-04-18T21:10:17.157423+0000","last_unstale":"2024-04-18T21:10:22.750329+0000","last_undegraded":"2024-04-18T21:10:22.750329+0000","last_fullsized":"2024-04-18T21:10:22.750329+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":647,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922768+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:24.922768+0000","last_peered":"2024-04-18T21:10:24.922768+0000","last_clean":"2024-04-18T21:10:24.922768+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:24.922768+0000","last_undegraded":"2024-04-18T21:10:24.922768+0000","last_fullsized":"2024-04-18T21:10:24.922768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930044+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:24.930044+0000","last_peered":"2024-04-18T21:10:24.930044+0000","last_clean":"2024-04-18T21:10:24.930044+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:24.930044+0000","last_undegraded":"2024-04-18T21:10:24.930044+0000","last_fullsized":"2024-04-18T21:10:24.930044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":691,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921793+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:24.921793+0000","last_peered":"2024-04-18T21:10:24.921793+0000","last_clean":"2024-04-18T21:10:24.921793+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:24.921793+0000","last_undegraded":"2024-04-18T21:10:24.921793+0000","last_fullsized":"2024-04-18T21:10:24.921793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":661,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926762+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:24.926762+0000","last_peered":"2024-04-18T21:10:24.926762+0000","last_clean":"2024-04-18T21:10:24.926762+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:24.926762+0000","last_undegraded":"2024-04-18T21:10:24.926762+0000","last_fullsized":"2024-04-18T21:10:24.926762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":599,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189432+0000","last_change":"2024-04-18T21:10:25.189432+0000","last_active":"2024-04-18T21:10:25.189432+0000","last_peered":"2024-04-18T21:07:22.952459+0000","last_clean":"2024-04-18T21:07:22.952459+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:10:25.189432+0000","last_undegraded":"2024-04-18T21:10:25.189432+0000","last_fullsized":"2024-04-18T21:10:25.189432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":578,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922439+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:24.922439+0000","last_peered":"2024-04-18T21:10:24.922439+0000","last_clean":"2024-04-18T21:10:24.922439+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:24.922439+0000","last_undegraded":"2024-04-18T21:10:24.922439+0000","last_fullsized":"2024-04-18T21:10:24.922439+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":620,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189324+0000","last_change":"2024-04-18T21:10:25.189324+0000","last_active":"2024-04-18T21:10:25.189324+0000","last_peered":"2024-04-18T21:06:59.247748+0000","last_clean":"2024-04-18T21:06:59.247748+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:10:25.189324+0000","last_undegraded":"2024-04-18T21:10:25.189324+0000","last_fullsized":"2024-04-18T21:10:25.189324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":583,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":216,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929036+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:24.929036+0000","last_peered":"2024-04-18T21:10:24.929036+0000","last_clean":"2024-04-18T21:10:24.929036+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:24.929036+0000","last_undegraded":"2024-04-18T21:10:24.929036+0000","last_fullsized":"2024-04-18T21:10:24.929036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":620,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932977+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:24.932977+0000","last_peered":"2024-04-18T21:10:24.932977+0000","last_clean":"2024-04-18T21:10:24.932977+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:24.932977+0000","last_undegraded":"2024-04-18T21:10:24.932977+0000","last_fullsized":"2024-04-18T21:10:24.932977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":244,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922379+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:24.922379+0000","last_peered":"2024-04-18T21:10:24.922379+0000","last_clean":"2024-04-18T21:10:24.922379+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:24.922379+0000","last_undegraded":"2024-04-18T21:10:24.922379+0000","last_fullsized":"2024-04-18T21:10:24.922379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925970+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:24.925970+0000","last_peered":"2024-04-18T21:10:24.925970+0000","last_clean":"2024-04-18T21:10:24.925970+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:24.925970+0000","last_undegraded":"2024-04-18T21:10:24.925970+0000","last_fullsized":"2024-04-18T21:10:24.925970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":161,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747867+0000","last_change":"2024-04-18T21:10:25.187369+0000","last_active":"2024-04-18T21:10:25.187369+0000","last_peered":"2024-04-18T21:10:22.747867+0000","last_clean":"2024-04-18T21:10:22.747867+0000","last_became_active":"2024-04-18T21:10:17.136098+0000","last_became_peered":"2024-04-18T21:10:17.136098+0000","last_unstale":"2024-04-18T21:10:22.747867+0000","last_undegraded":"2024-04-18T21:10:22.747867+0000","last_fullsized":"2024-04-18T21:10:22.747867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":170,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200983+0000","last_change":"2024-04-18T21:10:25.200983+0000","last_active":"2024-04-18T21:10:25.200983+0000","last_peered":"2024-04-18T21:07:11.855434+0000","last_clean":"2024-04-18T21:07:11.855434+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:10:25.200983+0000","last_undegraded":"2024-04-18T21:10:25.200983+0000","last_fullsized":"2024-04-18T21:10:25.200983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":604,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920982+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:24.920982+0000","last_peered":"2024-04-18T21:10:24.920982+0000","last_clean":"2024-04-18T21:10:24.920982+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:24.920982+0000","last_undegraded":"2024-04-18T21:10:24.920982+0000","last_fullsized":"2024-04-18T21:10:24.920982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":447,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923884+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:24.923884+0000","last_peered":"2024-04-18T21:10:24.923884+0000","last_clean":"2024-04-18T21:10:24.923884+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:24.923884+0000","last_undegraded":"2024-04-18T21:10:24.923884+0000","last_fullsized":"2024-04-18T21:10:24.923884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":644,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920935+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:24.920935+0000","last_peered":"2024-04-18T21:10:24.920935+0000","last_clean":"2024-04-18T21:10:24.920935+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:24.920935+0000","last_undegraded":"2024-04-18T21:10:24.920935+0000","last_fullsized":"2024-04-18T21:10:24.920935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":615,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750052+0000","last_change":"2024-04-18T21:10:25.194627+0000","last_active":"2024-04-18T21:10:25.194627+0000","last_peered":"2024-04-18T21:10:22.750052+0000","last_clean":"2024-04-18T21:10:22.750052+0000","last_became_active":"2024-04-18T21:10:17.138701+0000","last_became_peered":"2024-04-18T21:10:17.138701+0000","last_unstale":"2024-04-18T21:10:22.750052+0000","last_undegraded":"2024-04-18T21:10:22.750052+0000","last_fullsized":"2024-04-18T21:10:22.750052+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":691,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196497+0000","last_change":"2024-04-18T21:10:25.196497+0000","last_active":"2024-04-18T21:10:25.196497+0000","last_peered":"2024-04-18T21:07:22.953093+0000","last_clean":"2024-04-18T21:07:22.953093+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:10:25.196497+0000","last_undegraded":"2024-04-18T21:10:25.196497+0000","last_fullsized":"2024-04-18T21:10:25.196497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199958+0000","last_change":"2024-04-18T21:06:41.751008+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.199958+0000","last_undegraded":"2024-04-18T21:10:25.199958+0000","last_fullsized":"2024-04-18T21:10:25.199958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":698,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930213+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:24.930213+0000","last_peered":"2024-04-18T21:10:24.930213+0000","last_clean":"2024-04-18T21:10:24.930213+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:24.930213+0000","last_undegraded":"2024-04-18T21:10:24.930213+0000","last_fullsized":"2024-04-18T21:10:24.930213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":334,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932961+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:24.932961+0000","last_peered":"2024-04-18T21:10:24.932961+0000","last_clean":"2024-04-18T21:10:24.932961+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:24.932961+0000","last_undegraded":"2024-04-18T21:10:24.932961+0000","last_fullsized":"2024-04-18T21:10:24.932961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":617,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.204345+0000","last_change":"2024-04-18T21:10:25.204345+0000","last_active":"2024-04-18T21:10:25.204345+0000","last_peered":"2024-04-18T21:07:22.956950+0000","last_clean":"2024-04-18T21:07:22.956950+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:10:25.204345+0000","last_undegraded":"2024-04-18T21:10:25.204345+0000","last_fullsized":"2024-04-18T21:10:25.204345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":117,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189043+0000","last_change":"2024-04-18T21:10:25.189043+0000","last_active":"2024-04-18T21:10:25.189043+0000","last_peered":"2024-04-18T21:07:12.552712+0000","last_clean":"2024-04-18T21:07:12.552712+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:10:25.189043+0000","last_undegraded":"2024-04-18T21:10:25.189043+0000","last_fullsized":"2024-04-18T21:10:25.189043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749766+0000","last_change":"2024-04-18T21:10:25.200048+0000","last_active":"2024-04-18T21:10:25.200048+0000","last_peered":"2024-04-18T21:10:22.749766+0000","last_clean":"2024-04-18T21:10:22.749766+0000","last_became_active":"2024-04-18T21:10:17.140649+0000","last_became_peered":"2024-04-18T21:10:17.140649+0000","last_unstale":"2024-04-18T21:10:22.749766+0000","last_undegraded":"2024-04-18T21:10:22.749766+0000","last_fullsized":"2024-04-18T21:10:22.749766+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922666+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:24.922666+0000","last_peered":"2024-04-18T21:10:24.922666+0000","last_clean":"2024-04-18T21:10:24.922666+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:24.922666+0000","last_undegraded":"2024-04-18T21:10:24.922666+0000","last_fullsized":"2024-04-18T21:10:24.922666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":516,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199668+0000","last_change":"2024-04-18T21:10:25.199668+0000","last_active":"2024-04-18T21:10:25.199668+0000","last_peered":"2024-04-18T21:07:22.962835+0000","last_clean":"2024-04-18T21:07:22.962835+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:10:25.199668+0000","last_undegraded":"2024-04-18T21:10:25.199668+0000","last_fullsized":"2024-04-18T21:10:25.199668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":554,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921454+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:24.921454+0000","last_peered":"2024-04-18T21:10:24.921454+0000","last_clean":"2024-04-18T21:10:24.921454+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:24.921454+0000","last_undegraded":"2024-04-18T21:10:24.921454+0000","last_fullsized":"2024-04-18T21:10:24.921454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":672,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926255+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:24.926255+0000","last_peered":"2024-04-18T21:10:24.926255+0000","last_clean":"2024-04-18T21:10:24.926255+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:24.926255+0000","last_undegraded":"2024-04-18T21:10:24.926255+0000","last_fullsized":"2024-04-18T21:10:24.926255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":318,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747803+0000","last_change":"2024-04-18T21:10:25.193958+0000","last_active":"2024-04-18T21:10:25.193958+0000","last_peered":"2024-04-18T21:10:22.747803+0000","last_clean":"2024-04-18T21:10:22.747803+0000","last_became_active":"2024-04-18T21:10:17.135600+0000","last_became_peered":"2024-04-18T21:10:17.135600+0000","last_unstale":"2024-04-18T21:10:22.747803+0000","last_undegraded":"2024-04-18T21:10:22.747803+0000","last_fullsized":"2024-04-18T21:10:22.747803+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187633+0000","last_change":"2024-04-18T21:10:16.682987+0000","last_active":"2024-04-18T21:10:16.682987+0000","last_peered":"2024-04-18T21:10:14.839769+0000","last_clean":"2024-04-18T21:07:30.994987+0000","last_became_active":"2024-04-18T21:07:34.057035+0000","last_became_peered":"2024-04-18T21:07:34.057035+0000","last_unstale":"2024-04-18T21:10:25.187633+0000","last_undegraded":"2024-04-18T21:10:25.187633+0000","last_fullsized":"2024-04-18T21:10:25.187633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":502,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930566+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:24.930566+0000","last_peered":"2024-04-18T21:10:24.930566+0000","last_clean":"2024-04-18T21:10:24.930566+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:24.930566+0000","last_undegraded":"2024-04-18T21:10:24.930566+0000","last_fullsized":"2024-04-18T21:10:24.930566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750092+0000","last_change":"2024-04-18T21:10:25.197311+0000","last_active":"2024-04-18T21:10:25.197311+0000","last_peered":"2024-04-18T21:10:22.750092+0000","last_clean":"2024-04-18T21:10:22.750092+0000","last_became_active":"2024-04-18T21:10:17.141516+0000","last_became_peered":"2024-04-18T21:10:17.141516+0000","last_unstale":"2024-04-18T21:10:22.750092+0000","last_undegraded":"2024-04-18T21:10:22.750092+0000","last_fullsized":"2024-04-18T21:10:22.750092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.914142+0000","last_change":"2024-04-18T21:10:17.128341+0000","last_active":"2024-04-18T21:10:17.128341+0000","last_peered":"2024-04-18T21:10:14.838882+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.051041+0000","last_became_peered":"2024-04-18T21:07:34.051041+0000","last_unstale":"2024-04-18T21:10:23.914142+0000","last_undegraded":"2024-04-18T21:10:23.914142+0000","last_fullsized":"2024-04-18T21:10:23.914142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932208+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:24.932208+0000","last_peered":"2024-04-18T21:10:24.932208+0000","last_clean":"2024-04-18T21:10:24.932208+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:24.932208+0000","last_undegraded":"2024-04-18T21:10:24.932208+0000","last_fullsized":"2024-04-18T21:10:24.932208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":704,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923628+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:24.923628+0000","last_peered":"2024-04-18T21:10:24.923628+0000","last_clean":"2024-04-18T21:10:24.923628+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:24.923628+0000","last_undegraded":"2024-04-18T21:10:24.923628+0000","last_fullsized":"2024-04-18T21:10:24.923628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932950+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:24.932950+0000","last_peered":"2024-04-18T21:10:24.932950+0000","last_clean":"2024-04-18T21:10:24.932950+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:24.932950+0000","last_undegraded":"2024-04-18T21:10:24.932950+0000","last_fullsized":"2024-04-18T21:10:24.932950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":449,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921615+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:24.921615+0000","last_peered":"2024-04-18T21:10:24.921615+0000","last_clean":"2024-04-18T21:10:24.921615+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:24.921615+0000","last_undegraded":"2024-04-18T21:10:24.921615+0000","last_fullsized":"2024-04-18T21:10:24.921615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":534,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923013+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:24.923013+0000","last_peered":"2024-04-18T21:10:24.923013+0000","last_clean":"2024-04-18T21:10:24.923013+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:24.923013+0000","last_undegraded":"2024-04-18T21:10:24.923013+0000","last_fullsized":"2024-04-18T21:10:24.923013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187440+0000","last_change":"2024-04-18T21:10:16.682526+0000","last_active":"2024-04-18T21:10:16.682526+0000","last_peered":"2024-04-18T21:10:14.840654+0000","last_clean":"2024-04-18T21:07:30.995015+0000","last_became_active":"2024-04-18T21:07:34.045061+0000","last_became_peered":"2024-04-18T21:07:34.045061+0000","last_unstale":"2024-04-18T21:10:25.187440+0000","last_undegraded":"2024-04-18T21:10:25.187440+0000","last_fullsized":"2024-04-18T21:10:25.187440+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187794+0000","last_change":"2024-04-18T21:06:41.751500+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.187794+0000","last_undegraded":"2024-04-18T21:10:25.187794+0000","last_fullsized":"2024-04-18T21:10:25.187794+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933361+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:24.933361+0000","last_peered":"2024-04-18T21:10:24.933361+0000","last_clean":"2024-04-18T21:10:24.933361+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:24.933361+0000","last_undegraded":"2024-04-18T21:10:24.933361+0000","last_fullsized":"2024-04-18T21:10:24.933361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":285,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190938+0000","last_change":"2024-04-18T21:10:25.190938+0000","last_active":"2024-04-18T21:10:25.190938+0000","last_peered":"2024-04-18T21:07:20.021859+0000","last_clean":"2024-04-18T21:07:20.021859+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:10:25.190938+0000","last_undegraded":"2024-04-18T21:10:25.190938+0000","last_fullsized":"2024-04-18T21:10:25.190938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933948+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:24.933948+0000","last_peered":"2024-04-18T21:10:24.933948+0000","last_clean":"2024-04-18T21:10:24.933948+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:24.933948+0000","last_undegraded":"2024-04-18T21:10:24.933948+0000","last_fullsized":"2024-04-18T21:10:24.933948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":575,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921470+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:24.921470+0000","last_peered":"2024-04-18T21:10:24.921470+0000","last_clean":"2024-04-18T21:10:24.921470+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:24.921470+0000","last_undegraded":"2024-04-18T21:10:24.921470+0000","last_fullsized":"2024-04-18T21:10:24.921470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933724+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:24.933724+0000","last_peered":"2024-04-18T21:10:24.933724+0000","last_clean":"2024-04-18T21:10:24.933724+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:24.933724+0000","last_undegraded":"2024-04-18T21:10:24.933724+0000","last_fullsized":"2024-04-18T21:10:24.933724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928748+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:24.928748+0000","last_peered":"2024-04-18T21:10:24.928748+0000","last_clean":"2024-04-18T21:10:24.928748+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:24.928748+0000","last_undegraded":"2024-04-18T21:10:24.928748+0000","last_fullsized":"2024-04-18T21:10:24.928748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":587,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925008+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:24.925008+0000","last_peered":"2024-04-18T21:10:24.925008+0000","last_clean":"2024-04-18T21:10:24.925008+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:24.925008+0000","last_undegraded":"2024-04-18T21:10:24.925008+0000","last_fullsized":"2024-04-18T21:10:24.925008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927275+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:24.927275+0000","last_peered":"2024-04-18T21:10:24.927275+0000","last_clean":"2024-04-18T21:10:24.927275+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:24.927275+0000","last_undegraded":"2024-04-18T21:10:24.927275+0000","last_fullsized":"2024-04-18T21:10:24.927275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933808+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:24.933808+0000","last_peered":"2024-04-18T21:10:24.933808+0000","last_clean":"2024-04-18T21:10:24.933808+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:24.933808+0000","last_undegraded":"2024-04-18T21:10:24.933808+0000","last_fullsized":"2024-04-18T21:10:24.933808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":559,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928910+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:24.928910+0000","last_peered":"2024-04-18T21:10:24.928910+0000","last_clean":"2024-04-18T21:10:24.928910+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:24.928910+0000","last_undegraded":"2024-04-18T21:10:24.928910+0000","last_fullsized":"2024-04-18T21:10:24.928910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":239,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933343+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:24.933343+0000","last_peered":"2024-04-18T21:10:24.933343+0000","last_clean":"2024-04-18T21:10:24.933343+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:24.933343+0000","last_undegraded":"2024-04-18T21:10:24.933343+0000","last_fullsized":"2024-04-18T21:10:24.933343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.917433+0000","last_change":"2024-04-18T21:10:17.121796+0000","last_active":"2024-04-18T21:10:17.121796+0000","last_peered":"2024-04-18T21:10:14.840628+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.054276+0000","last_became_peered":"2024-04-18T21:07:34.054276+0000","last_unstale":"2024-04-18T21:10:23.917433+0000","last_undegraded":"2024-04-18T21:10:23.917433+0000","last_fullsized":"2024-04-18T21:10:23.917433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":614,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921123+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:24.921123+0000","last_peered":"2024-04-18T21:10:24.921123+0000","last_clean":"2024-04-18T21:10:24.921123+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:24.921123+0000","last_undegraded":"2024-04-18T21:10:24.921123+0000","last_fullsized":"2024-04-18T21:10:24.921123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":625,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749809+0000","last_change":"2024-04-18T21:10:25.191106+0000","last_active":"2024-04-18T21:10:25.191106+0000","last_peered":"2024-04-18T21:10:22.749809+0000","last_clean":"2024-04-18T21:10:22.749809+0000","last_became_active":"2024-04-18T21:10:17.134137+0000","last_became_peered":"2024-04-18T21:10:17.134137+0000","last_unstale":"2024-04-18T21:10:22.749809+0000","last_undegraded":"2024-04-18T21:10:22.749809+0000","last_fullsized":"2024-04-18T21:10:22.749809+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":386,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.748811+0000","last_change":"2024-04-18T21:10:25.190602+0000","last_active":"2024-04-18T21:10:25.190602+0000","last_peered":"2024-04-18T21:10:22.748811+0000","last_clean":"2024-04-18T21:10:22.748811+0000","last_became_active":"2024-04-18T21:10:17.133733+0000","last_became_peered":"2024-04-18T21:10:17.133733+0000","last_unstale":"2024-04-18T21:10:22.748811+0000","last_undegraded":"2024-04-18T21:10:22.748811+0000","last_fullsized":"2024-04-18T21:10:22.748811+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":567,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926718+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:24.926718+0000","last_peered":"2024-04-18T21:10:24.926718+0000","last_clean":"2024-04-18T21:10:24.926718+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:24.926718+0000","last_undegraded":"2024-04-18T21:10:24.926718+0000","last_fullsized":"2024-04-18T21:10:24.926718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":240,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927489+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:24.927489+0000","last_peered":"2024-04-18T21:10:24.927489+0000","last_clean":"2024-04-18T21:10:24.927489+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:24.927489+0000","last_undegraded":"2024-04-18T21:10:24.927489+0000","last_fullsized":"2024-04-18T21:10:24.927489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":258,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196450+0000","last_change":"2024-04-18T21:10:25.196450+0000","last_active":"2024-04-18T21:10:25.196450+0000","last_peered":"2024-04-18T21:07:18.651325+0000","last_clean":"2024-04-18T21:07:18.651325+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:10:25.196450+0000","last_undegraded":"2024-04-18T21:10:25.196450+0000","last_fullsized":"2024-04-18T21:10:25.196450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":666,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926999+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:24.926999+0000","last_peered":"2024-04-18T21:10:24.926999+0000","last_clean":"2024-04-18T21:10:24.926999+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:24.926999+0000","last_undegraded":"2024-04-18T21:10:24.926999+0000","last_fullsized":"2024-04-18T21:10:24.926999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":618,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927941+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:24.927941+0000","last_peered":"2024-04-18T21:10:24.927941+0000","last_clean":"2024-04-18T21:10:24.927941+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:24.927941+0000","last_undegraded":"2024-04-18T21:10:24.927941+0000","last_fullsized":"2024-04-18T21:10:24.927941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":526,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924972+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:24.924972+0000","last_peered":"2024-04-18T21:10:24.924972+0000","last_clean":"2024-04-18T21:10:24.924972+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:24.924972+0000","last_undegraded":"2024-04-18T21:10:24.924972+0000","last_fullsized":"2024-04-18T21:10:24.924972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":772,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929236+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:24.929236+0000","last_peered":"2024-04-18T21:10:24.929236+0000","last_clean":"2024-04-18T21:10:24.929236+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:24.929236+0000","last_undegraded":"2024-04-18T21:10:24.929236+0000","last_fullsized":"2024-04-18T21:10:24.929236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932149+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:24.932149+0000","last_peered":"2024-04-18T21:10:24.932149+0000","last_clean":"2024-04-18T21:10:24.932149+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:24.932149+0000","last_undegraded":"2024-04-18T21:10:24.932149+0000","last_fullsized":"2024-04-18T21:10:24.932149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":369,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929014+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:24.929014+0000","last_peered":"2024-04-18T21:10:24.929014+0000","last_clean":"2024-04-18T21:10:24.929014+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:24.929014+0000","last_undegraded":"2024-04-18T21:10:24.929014+0000","last_fullsized":"2024-04-18T21:10:24.929014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":599,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925836+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:24.925836+0000","last_peered":"2024-04-18T21:10:24.925836+0000","last_clean":"2024-04-18T21:10:24.925836+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:24.925836+0000","last_undegraded":"2024-04-18T21:10:24.925836+0000","last_fullsized":"2024-04-18T21:10:24.925836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":290,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922229+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:24.922229+0000","last_peered":"2024-04-18T21:10:24.922229+0000","last_clean":"2024-04-18T21:10:24.922229+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:24.922229+0000","last_undegraded":"2024-04-18T21:10:24.922229+0000","last_fullsized":"2024-04-18T21:10:24.922229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":561,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922143+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:24.922143+0000","last_peered":"2024-04-18T21:10:24.922143+0000","last_clean":"2024-04-18T21:10:24.922143+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:24.922143+0000","last_undegraded":"2024-04-18T21:10:24.922143+0000","last_fullsized":"2024-04-18T21:10:24.922143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922718+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:24.922718+0000","last_peered":"2024-04-18T21:10:24.922718+0000","last_clean":"2024-04-18T21:10:24.922718+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:24.922718+0000","last_undegraded":"2024-04-18T21:10:24.922718+0000","last_fullsized":"2024-04-18T21:10:24.922718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":520,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190983+0000","last_change":"2024-04-18T21:10:25.190983+0000","last_active":"2024-04-18T21:10:25.190983+0000","last_peered":"2024-04-18T21:07:22.960952+0000","last_clean":"2024-04-18T21:07:22.960952+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:10:25.190983+0000","last_undegraded":"2024-04-18T21:10:25.190983+0000","last_fullsized":"2024-04-18T21:10:25.190983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":244,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189285+0000","last_change":"2024-04-18T21:10:25.189285+0000","last_active":"2024-04-18T21:10:25.189285+0000","last_peered":"2024-04-18T21:07:09.916748+0000","last_clean":"2024-04-18T21:07:09.916748+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:10:25.189285+0000","last_undegraded":"2024-04-18T21:10:25.189285+0000","last_fullsized":"2024-04-18T21:10:25.189285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":554,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189389+0000","last_change":"2024-04-18T21:10:25.189389+0000","last_active":"2024-04-18T21:10:25.189389+0000","last_peered":"2024-04-18T21:07:22.917646+0000","last_clean":"2024-04-18T21:07:22.917646+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:10:25.189389+0000","last_undegraded":"2024-04-18T21:10:25.189389+0000","last_fullsized":"2024-04-18T21:10:25.189389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927204+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:24.927204+0000","last_peered":"2024-04-18T21:10:24.927204+0000","last_clean":"2024-04-18T21:10:24.927204+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:24.927204+0000","last_undegraded":"2024-04-18T21:10:24.927204+0000","last_fullsized":"2024-04-18T21:10:24.927204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923084+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:24.923084+0000","last_peered":"2024-04-18T21:10:24.923084+0000","last_clean":"2024-04-18T21:10:24.923084+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:24.923084+0000","last_undegraded":"2024-04-18T21:10:24.923084+0000","last_fullsized":"2024-04-18T21:10:24.923084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":328,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932641+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:24.932641+0000","last_peered":"2024-04-18T21:10:24.932641+0000","last_clean":"2024-04-18T21:10:24.932641+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:24.932641+0000","last_undegraded":"2024-04-18T21:10:24.932641+0000","last_fullsized":"2024-04-18T21:10:24.932641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":595,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196746+0000","last_change":"2024-04-18T21:10:25.196746+0000","last_active":"2024-04-18T21:10:25.196746+0000","last_peered":"2024-04-18T21:07:22.946951+0000","last_clean":"2024-04-18T21:07:22.946951+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:10:25.196746+0000","last_undegraded":"2024-04-18T21:10:25.196746+0000","last_fullsized":"2024-04-18T21:10:25.196746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":222,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926518+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:24.926518+0000","last_peered":"2024-04-18T21:10:24.926518+0000","last_clean":"2024-04-18T21:10:24.926518+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:24.926518+0000","last_undegraded":"2024-04-18T21:10:24.926518+0000","last_fullsized":"2024-04-18T21:10:24.926518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28124,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28798976,"data_stored":84673283,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103528,"kb_used_data":27996,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268312,"statfs":{"total":96636764160,"available":96530751488,"internally_reserved":0,"allocated":28667904,"data_stored":81352623,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350980,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29072,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29769728,"data_stored":90498460,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:30.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:30.767 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:30.785 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-18T21:10:29.735382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265720,"kb_used_data":85192,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849800,"statfs":{"total":289910292480,"available":289638195200,"internally_reserved":0,"allocated":87236608,"data_stored":256524366,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001862"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924469+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:24.924469+0000","last_peered":"2024-04-18T21:10:24.924469+0000","last_clean":"2024-04-18T21:10:24.924469+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:24.924469+0000","last_undegraded":"2024-04-18T21:10:24.924469+0000","last_fullsized":"2024-04-18T21:10:24.924469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":608,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921942+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:24.921942+0000","last_peered":"2024-04-18T21:10:24.921942+0000","last_clean":"2024-04-18T21:10:24.921942+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:24.921942+0000","last_undegraded":"2024-04-18T21:10:24.921942+0000","last_fullsized":"2024-04-18T21:10:24.921942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":531,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.203812+0000","last_change":"2024-04-18T21:10:25.203812+0000","last_active":"2024-04-18T21:10:25.203812+0000","last_peered":"2024-04-18T21:07:22.957446+0000","last_clean":"2024-04-18T21:07:22.957446+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:10:25.203812+0000","last_undegraded":"2024-04-18T21:10:25.203812+0000","last_fullsized":"2024-04-18T21:10:25.203812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":530,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192955+0000","last_change":"2024-04-18T21:10:25.192955+0000","last_active":"2024-04-18T21:10:25.192955+0000","last_peered":"2024-04-18T21:07:22.948971+0000","last_clean":"2024-04-18T21:07:22.948971+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:10:25.192955+0000","last_undegraded":"2024-04-18T21:10:25.192955+0000","last_fullsized":"2024-04-18T21:10:25.192955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":610,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922801+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:24.922801+0000","last_peered":"2024-04-18T21:10:24.922801+0000","last_clean":"2024-04-18T21:10:24.922801+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:24.922801+0000","last_undegraded":"2024-04-18T21:10:24.922801+0000","last_fullsized":"2024-04-18T21:10:24.922801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":543,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196541+0000","last_change":"2024-04-18T21:10:25.196541+0000","last_active":"2024-04-18T21:10:25.196541+0000","last_peered":"2024-04-18T21:07:22.946960+0000","last_clean":"2024-04-18T21:07:22.946960+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:10:25.196541+0000","last_undegraded":"2024-04-18T21:10:25.196541+0000","last_fullsized":"2024-04-18T21:10:25.196541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":588,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.188244+0000","last_change":"2024-04-18T21:10:25.188244+0000","last_active":"2024-04-18T21:10:25.188244+0000","last_peered":"2024-04-18T21:07:22.949792+0000","last_clean":"2024-04-18T21:07:22.949792+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:10:25.188244+0000","last_undegraded":"2024-04-18T21:10:25.188244+0000","last_fullsized":"2024-04-18T21:10:25.188244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":522,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.191293+0000","last_change":"2024-04-18T21:10:25.191293+0000","last_active":"2024-04-18T21:10:25.191293+0000","last_peered":"2024-04-18T21:07:22.949804+0000","last_clean":"2024-04-18T21:07:22.949804+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:10:25.191293+0000","last_undegraded":"2024-04-18T21:10:25.191293+0000","last_fullsized":"2024-04-18T21:10:25.191293+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":659,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925633+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:24.925633+0000","last_peered":"2024-04-18T21:10:24.925633+0000","last_clean":"2024-04-18T21:10:24.925633+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:24.925633+0000","last_undegraded":"2024-04-18T21:10:24.925633+0000","last_fullsized":"2024-04-18T21:10:24.925633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":569,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923028+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:24.923028+0000","last_peered":"2024-04-18T21:10:24.923028+0000","last_clean":"2024-04-18T21:10:24.923028+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:24.923028+0000","last_undegraded":"2024-04-18T21:10:24.923028+0000","last_fullsized":"2024-04-18T21:10:24.923028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":515,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.202591+0000","last_change":"2024-04-18T21:10:25.202591+0000","last_active":"2024-04-18T21:10:25.202591+0000","last_peered":"2024-04-18T21:07:22.964633+0000","last_clean":"2024-04-18T21:07:22.964633+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:10:25.202591+0000","last_undegraded":"2024-04-18T21:10:25.202591+0000","last_fullsized":"2024-04-18T21:10:25.202591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":564,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921739+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:24.921739+0000","last_peered":"2024-04-18T21:10:24.921739+0000","last_clean":"2024-04-18T21:10:24.921739+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:24.921739+0000","last_undegraded":"2024-04-18T21:10:24.921739+0000","last_fullsized":"2024-04-18T21:10:24.921739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":596,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922512+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:24.922512+0000","last_peered":"2024-04-18T21:10:24.922512+0000","last_clean":"2024-04-18T21:10:24.922512+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:24.922512+0000","last_undegraded":"2024-04-18T21:10:24.922512+0000","last_fullsized":"2024-04-18T21:10:24.922512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":641,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749197+0000","last_change":"2024-04-18T21:10:25.191674+0000","last_active":"2024-04-18T21:10:25.191674+0000","last_peered":"2024-04-18T21:10:22.749197+0000","last_clean":"2024-04-18T21:10:22.749197+0000","last_became_active":"2024-04-18T21:10:17.140677+0000","last_became_peered":"2024-04-18T21:10:17.140677+0000","last_unstale":"2024-04-18T21:10:22.749197+0000","last_undegraded":"2024-04-18T21:10:22.749197+0000","last_fullsized":"2024-04-18T21:10:22.749197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":645,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749533+0000","last_change":"2024-04-18T21:10:25.188538+0000","last_active":"2024-04-18T21:10:25.188538+0000","last_peered":"2024-04-18T21:10:22.749533+0000","last_clean":"2024-04-18T21:10:22.749533+0000","last_became_active":"2024-04-18T21:10:17.131630+0000","last_became_peered":"2024-04-18T21:10:17.131630+0000","last_unstale":"2024-04-18T21:10:22.749533+0000","last_undegraded":"2024-04-18T21:10:22.749533+0000","last_fullsized":"2024-04-18T21:10:22.749533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":626,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200826+0000","last_change":"2024-04-18T21:10:25.200826+0000","last_active":"2024-04-18T21:10:25.200826+0000","last_peered":"2024-04-18T21:07:22.960697+0000","last_clean":"2024-04-18T21:07:22.960697+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:10:25.200826+0000","last_undegraded":"2024-04-18T21:10:25.200826+0000","last_fullsized":"2024-04-18T21:10:25.200826+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":589,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927224+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:24.927224+0000","last_peered":"2024-04-18T21:10:24.927224+0000","last_clean":"2024-04-18T21:10:24.927224+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:24.927224+0000","last_undegraded":"2024-04-18T21:10:24.927224+0000","last_fullsized":"2024-04-18T21:10:24.927224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":597,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923175+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:24.923175+0000","last_peered":"2024-04-18T21:10:24.923175+0000","last_clean":"2024-04-18T21:10:24.923175+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:24.923175+0000","last_undegraded":"2024-04-18T21:10:24.923175+0000","last_fullsized":"2024-04-18T21:10:24.923175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":628,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926866+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:24.926866+0000","last_peered":"2024-04-18T21:10:24.926866+0000","last_clean":"2024-04-18T21:10:24.926866+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:24.926866+0000","last_undegraded":"2024-04-18T21:10:24.926866+0000","last_fullsized":"2024-04-18T21:10:24.926866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":579,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.195904+0000","last_change":"2024-04-18T21:10:25.195904+0000","last_active":"2024-04-18T21:10:25.195904+0000","last_peered":"2024-04-18T21:07:22.916966+0000","last_clean":"2024-04-18T21:07:22.916966+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:10:25.195904+0000","last_undegraded":"2024-04-18T21:10:25.195904+0000","last_fullsized":"2024-04-18T21:10:25.195904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":526,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192946+0000","last_change":"2024-04-18T21:10:25.192946+0000","last_active":"2024-04-18T21:10:25.192946+0000","last_peered":"2024-04-18T21:07:22.958552+0000","last_clean":"2024-04-18T21:07:22.958552+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:10:25.192946+0000","last_undegraded":"2024-04-18T21:10:25.192946+0000","last_fullsized":"2024-04-18T21:10:25.192946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921021+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:24.921021+0000","last_peered":"2024-04-18T21:10:24.921021+0000","last_clean":"2024-04-18T21:10:24.921021+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:24.921021+0000","last_undegraded":"2024-04-18T21:10:24.921021+0000","last_fullsized":"2024-04-18T21:10:24.921021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":591,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925044+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:24.925044+0000","last_peered":"2024-04-18T21:10:24.925044+0000","last_clean":"2024-04-18T21:10:24.925044+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:24.925044+0000","last_undegraded":"2024-04-18T21:10:24.925044+0000","last_fullsized":"2024-04-18T21:10:24.925044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920783+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:24.920783+0000","last_peered":"2024-04-18T21:10:24.920783+0000","last_clean":"2024-04-18T21:10:24.920783+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:24.920783+0000","last_undegraded":"2024-04-18T21:10:24.920783+0000","last_fullsized":"2024-04-18T21:10:24.920783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":601,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924654+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:24.924654+0000","last_peered":"2024-04-18T21:10:24.924654+0000","last_clean":"2024-04-18T21:10:24.924654+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:24.924654+0000","last_undegraded":"2024-04-18T21:10:24.924654+0000","last_fullsized":"2024-04-18T21:10:24.924654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":740,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930675+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:24.930675+0000","last_peered":"2024-04-18T21:10:24.930675+0000","last_clean":"2024-04-18T21:10:24.930675+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:24.930675+0000","last_undegraded":"2024-04-18T21:10:24.930675+0000","last_fullsized":"2024-04-18T21:10:24.930675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":582,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750329+0000","last_change":"2024-04-18T21:10:25.200634+0000","last_active":"2024-04-18T21:10:25.200634+0000","last_peered":"2024-04-18T21:10:22.750329+0000","last_clean":"2024-04-18T21:10:22.750329+0000","last_became_active":"2024-04-18T21:10:17.157423+0000","last_became_peered":"2024-04-18T21:10:17.157423+0000","last_unstale":"2024-04-18T21:10:22.750329+0000","last_undegraded":"2024-04-18T21:10:22.750329+0000","last_fullsized":"2024-04-18T21:10:22.750329+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":647,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922768+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:24.922768+0000","last_peered":"2024-04-18T21:10:24.922768+0000","last_clean":"2024-04-18T21:10:24.922768+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:24.922768+0000","last_undegraded":"2024-04-18T21:10:24.922768+0000","last_fullsized":"2024-04-18T21:10:24.922768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930044+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:24.930044+0000","last_peered":"2024-04-18T21:10:24.930044+0000","last_clean":"2024-04-18T21:10:24.930044+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:24.930044+0000","last_undegraded":"2024-04-18T21:10:24.930044+0000","last_fullsized":"2024-04-18T21:10:24.930044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":691,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921793+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:24.921793+0000","last_peered":"2024-04-18T21:10:24.921793+0000","last_clean":"2024-04-18T21:10:24.921793+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:24.921793+0000","last_undegraded":"2024-04-18T21:10:24.921793+0000","last_fullsized":"2024-04-18T21:10:24.921793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":661,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926762+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:24.926762+0000","last_peered":"2024-04-18T21:10:24.926762+0000","last_clean":"2024-04-18T21:10:24.926762+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:24.926762+0000","last_undegraded":"2024-04-18T21:10:24.926762+0000","last_fullsized":"2024-04-18T21:10:24.926762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":599,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189432+0000","last_change":"2024-04-18T21:10:25.189432+0000","last_active":"2024-04-18T21:10:25.189432+0000","last_peered":"2024-04-18T21:07:22.952459+0000","last_clean":"2024-04-18T21:07:22.952459+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:10:25.189432+0000","last_undegraded":"2024-04-18T21:10:25.189432+0000","last_fullsized":"2024-04-18T21:10:25.189432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":578,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922439+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:24.922439+0000","last_peered":"2024-04-18T21:10:24.922439+0000","last_clean":"2024-04-18T21:10:24.922439+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:24.922439+0000","last_undegraded":"2024-04-18T21:10:24.922439+0000","last_fullsized":"2024-04-18T21:10:24.922439+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":620,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189324+0000","last_change":"2024-04-18T21:10:25.189324+0000","last_active":"2024-04-18T21:10:25.189324+0000","last_peered":"2024-04-18T21:06:59.247748+0000","last_clean":"2024-04-18T21:06:59.247748+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:10:25.189324+0000","last_undegraded":"2024-04-18T21:10:25.189324+0000","last_fullsized":"2024-04-18T21:10:25.189324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":583,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":216,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929036+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:24.929036+0000","last_peered":"2024-04-18T21:10:24.929036+0000","last_clean":"2024-04-18T21:10:24.929036+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:24.929036+0000","last_undegraded":"2024-04-18T21:10:24.929036+0000","last_fullsized":"2024-04-18T21:10:24.929036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":620,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932977+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:24.932977+0000","last_peered":"2024-04-18T21:10:24.932977+0000","last_clean":"2024-04-18T21:10:24.932977+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:24.932977+0000","last_undegraded":"2024-04-18T21:10:24.932977+0000","last_fullsized":"2024-04-18T21:10:24.932977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":244,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922379+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:24.922379+0000","last_peered":"2024-04-18T21:10:24.922379+0000","last_clean":"2024-04-18T21:10:24.922379+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:24.922379+0000","last_undegraded":"2024-04-18T21:10:24.922379+0000","last_fullsized":"2024-04-18T21:10:24.922379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925970+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:24.925970+0000","last_peered":"2024-04-18T21:10:24.925970+0000","last_clean":"2024-04-18T21:10:24.925970+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:24.925970+0000","last_undegraded":"2024-04-18T21:10:24.925970+0000","last_fullsized":"2024-04-18T21:10:24.925970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":161,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747867+0000","last_change":"2024-04-18T21:10:25.187369+0000","last_active":"2024-04-18T21:10:25.187369+0000","last_peered":"2024-04-18T21:10:22.747867+0000","last_clean":"2024-04-18T21:10:22.747867+0000","last_became_active":"2024-04-18T21:10:17.136098+0000","last_became_peered":"2024-04-18T21:10:17.136098+0000","last_unstale":"2024-04-18T21:10:22.747867+0000","last_undegraded":"2024-04-18T21:10:22.747867+0000","last_fullsized":"2024-04-18T21:10:22.747867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":170,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200983+0000","last_change":"2024-04-18T21:10:25.200983+0000","last_active":"2024-04-18T21:10:25.200983+0000","last_peered":"2024-04-18T21:07:11.855434+0000","last_clean":"2024-04-18T21:07:11.855434+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:10:25.200983+0000","last_undegraded":"2024-04-18T21:10:25.200983+0000","last_fullsized":"2024-04-18T21:10:25.200983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":604,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920982+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:24.920982+0000","last_peered":"2024-04-18T21:10:24.920982+0000","last_clean":"2024-04-18T21:10:24.920982+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:24.920982+0000","last_undegraded":"2024-04-18T21:10:24.920982+0000","last_fullsized":"2024-04-18T21:10:24.920982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":447,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923884+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:24.923884+0000","last_peered":"2024-04-18T21:10:24.923884+0000","last_clean":"2024-04-18T21:10:24.923884+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:24.923884+0000","last_undegraded":"2024-04-18T21:10:24.923884+0000","last_fullsized":"2024-04-18T21:10:24.923884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":644,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920935+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:24.920935+0000","last_peered":"2024-04-18T21:10:24.920935+0000","last_clean":"2024-04-18T21:10:24.920935+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:24.920935+0000","last_undegraded":"2024-04-18T21:10:24.920935+0000","last_fullsized":"2024-04-18T21:10:24.920935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":615,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750052+0000","last_change":"2024-04-18T21:10:25.194627+0000","last_active":"2024-04-18T21:10:25.194627+0000","last_peered":"2024-04-18T21:10:22.750052+0000","last_clean":"2024-04-18T21:10:22.750052+0000","last_became_active":"2024-04-18T21:10:17.138701+0000","last_became_peered":"2024-04-18T21:10:17.138701+0000","last_unstale":"2024-04-18T21:10:22.750052+0000","last_undegraded":"2024-04-18T21:10:22.750052+0000","last_fullsized":"2024-04-18T21:10:22.750052+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":691,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196497+0000","last_change":"2024-04-18T21:10:25.196497+0000","last_active":"2024-04-18T21:10:25.196497+0000","last_peered":"2024-04-18T21:07:22.953093+0000","last_clean":"2024-04-18T21:07:22.953093+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:10:25.196497+0000","last_undegraded":"2024-04-18T21:10:25.196497+0000","last_fullsized":"2024-04-18T21:10:25.196497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199958+0000","last_change":"2024-04-18T21:06:41.751008+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.199958+0000","last_undegraded":"2024-04-18T21:10:25.199958+0000","last_fullsized":"2024-04-18T21:10:25.199958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":698,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930213+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:24.930213+0000","last_peered":"2024-04-18T21:10:24.930213+0000","last_clean":"2024-04-18T21:10:24.930213+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:24.930213+0000","last_undegraded":"2024-04-18T21:10:24.930213+0000","last_fullsized":"2024-04-18T21:10:24.930213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":334,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932961+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:24.932961+0000","last_peered":"2024-04-18T21:10:24.932961+0000","last_clean":"2024-04-18T21:10:24.932961+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:24.932961+0000","last_undegraded":"2024-04-18T21:10:24.932961+0000","last_fullsized":"2024-04-18T21:10:24.932961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":617,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.204345+0000","last_change":"2024-04-18T21:10:25.204345+0000","last_active":"2024-04-18T21:10:25.204345+0000","last_peered":"2024-04-18T21:07:22.956950+0000","last_clean":"2024-04-18T21:07:22.956950+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:10:25.204345+0000","last_undegraded":"2024-04-18T21:10:25.204345+0000","last_fullsized":"2024-04-18T21:10:25.204345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":117,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189043+0000","last_change":"2024-04-18T21:10:25.189043+0000","last_active":"2024-04-18T21:10:25.189043+0000","last_peered":"2024-04-18T21:07:12.552712+0000","last_clean":"2024-04-18T21:07:12.552712+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:10:25.189043+0000","last_undegraded":"2024-04-18T21:10:25.189043+0000","last_fullsized":"2024-04-18T21:10:25.189043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749766+0000","last_change":"2024-04-18T21:10:25.200048+0000","last_active":"2024-04-18T21:10:25.200048+0000","last_peered":"2024-04-18T21:10:22.749766+0000","last_clean":"2024-04-18T21:10:22.749766+0000","last_became_active":"2024-04-18T21:10:17.140649+0000","last_became_peered":"2024-04-18T21:10:17.140649+0000","last_unstale":"2024-04-18T21:10:22.749766+0000","last_undegraded":"2024-04-18T21:10:22.749766+0000","last_fullsized":"2024-04-18T21:10:22.749766+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922666+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:24.922666+0000","last_peered":"2024-04-18T21:10:24.922666+0000","last_clean":"2024-04-18T21:10:24.922666+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:24.922666+0000","last_undegraded":"2024-04-18T21:10:24.922666+0000","last_fullsized":"2024-04-18T21:10:24.922666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":516,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199668+0000","last_change":"2024-04-18T21:10:25.199668+0000","last_active":"2024-04-18T21:10:25.199668+0000","last_peered":"2024-04-18T21:07:22.962835+0000","last_clean":"2024-04-18T21:07:22.962835+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:10:25.199668+0000","last_undegraded":"2024-04-18T21:10:25.199668+0000","last_fullsized":"2024-04-18T21:10:25.199668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":554,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921454+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:24.921454+0000","last_peered":"2024-04-18T21:10:24.921454+0000","last_clean":"2024-04-18T21:10:24.921454+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:24.921454+0000","last_undegraded":"2024-04-18T21:10:24.921454+0000","last_fullsized":"2024-04-18T21:10:24.921454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":672,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926255+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:24.926255+0000","last_peered":"2024-04-18T21:10:24.926255+0000","last_clean":"2024-04-18T21:10:24.926255+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:24.926255+0000","last_undegraded":"2024-04-18T21:10:24.926255+0000","last_fullsized":"2024-04-18T21:10:24.926255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":318,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747803+0000","last_change":"2024-04-18T21:10:25.193958+0000","last_active":"2024-04-18T21:10:25.193958+0000","last_peered":"2024-04-18T21:10:22.747803+0000","last_clean":"2024-04-18T21:10:22.747803+0000","last_became_active":"2024-04-18T21:10:17.135600+0000","last_became_peered":"2024-04-18T21:10:17.135600+0000","last_unstale":"2024-04-18T21:10:22.747803+0000","last_undegraded":"2024-04-18T21:10:22.747803+0000","last_fullsized":"2024-04-18T21:10:22.747803+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187633+0000","last_change":"2024-04-18T21:10:16.682987+0000","last_active":"2024-04-18T21:10:16.682987+0000","last_peered":"2024-04-18T21:10:14.839769+0000","last_clean":"2024-04-18T21:07:30.994987+0000","last_became_active":"2024-04-18T21:07:34.057035+0000","last_became_peered":"2024-04-18T21:07:34.057035+0000","last_unstale":"2024-04-18T21:10:25.187633+0000","last_undegraded":"2024-04-18T21:10:25.187633+0000","last_fullsized":"2024-04-18T21:10:25.187633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":502,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930566+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:24.930566+0000","last_peered":"2024-04-18T21:10:24.930566+0000","last_clean":"2024-04-18T21:10:24.930566+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:24.930566+0000","last_undegraded":"2024-04-18T21:10:24.930566+0000","last_fullsized":"2024-04-18T21:10:24.930566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750092+0000","last_change":"2024-04-18T21:10:25.197311+0000","last_active":"2024-04-18T21:10:25.197311+0000","last_peered":"2024-04-18T21:10:22.750092+0000","last_clean":"2024-04-18T21:10:22.750092+0000","last_became_active":"2024-04-18T21:10:17.141516+0000","last_became_peered":"2024-04-18T21:10:17.141516+0000","last_unstale":"2024-04-18T21:10:22.750092+0000","last_undegraded":"2024-04-18T21:10:22.750092+0000","last_fullsized":"2024-04-18T21:10:22.750092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.914142+0000","last_change":"2024-04-18T21:10:17.128341+0000","last_active":"2024-04-18T21:10:17.128341+0000","last_peered":"2024-04-18T21:10:14.838882+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.051041+0000","last_became_peered":"2024-04-18T21:07:34.051041+0000","last_unstale":"2024-04-18T21:10:23.914142+0000","last_undegraded":"2024-04-18T21:10:23.914142+0000","last_fullsized":"2024-04-18T21:10:23.914142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932208+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:24.932208+0000","last_peered":"2024-04-18T21:10:24.932208+0000","last_clean":"2024-04-18T21:10:24.932208+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:24.932208+0000","last_undegraded":"2024-04-18T21:10:24.932208+0000","last_fullsized":"2024-04-18T21:10:24.932208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":704,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923628+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:24.923628+0000","last_peered":"2024-04-18T21:10:24.923628+0000","last_clean":"2024-04-18T21:10:24.923628+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:24.923628+0000","last_undegraded":"2024-04-18T21:10:24.923628+0000","last_fullsized":"2024-04-18T21:10:24.923628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932950+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:24.932950+0000","last_peered":"2024-04-18T21:10:24.932950+0000","last_clean":"2024-04-18T21:10:24.932950+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:24.932950+0000","last_undegraded":"2024-04-18T21:10:24.932950+0000","last_fullsized":"2024-04-18T21:10:24.932950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":449,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921615+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:24.921615+0000","last_peered":"2024-04-18T21:10:24.921615+0000","last_clean":"2024-04-18T21:10:24.921615+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:24.921615+0000","last_undegraded":"2024-04-18T21:10:24.921615+0000","last_fullsized":"2024-04-18T21:10:24.921615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":534,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923013+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:24.923013+0000","last_peered":"2024-04-18T21:10:24.923013+0000","last_clean":"2024-04-18T21:10:24.923013+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:24.923013+0000","last_undegraded":"2024-04-18T21:10:24.923013+0000","last_fullsized":"2024-04-18T21:10:24.923013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187440+0000","last_change":"2024-04-18T21:10:16.682526+0000","last_active":"2024-04-18T21:10:16.682526+0000","last_peered":"2024-04-18T21:10:14.840654+0000","last_clean":"2024-04-18T21:07:30.995015+0000","last_became_active":"2024-04-18T21:07:34.045061+0000","last_became_peered":"2024-04-18T21:07:34.045061+0000","last_unstale":"2024-04-18T21:10:25.187440+0000","last_undegraded":"2024-04-18T21:10:25.187440+0000","last_fullsized":"2024-04-18T21:10:25.187440+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187794+0000","last_change":"2024-04-18T21:06:41.751500+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.187794+0000","last_undegraded":"2024-04-18T21:10:25.187794+0000","last_fullsized":"2024-04-18T21:10:25.187794+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933361+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:24.933361+0000","last_peered":"2024-04-18T21:10:24.933361+0000","last_clean":"2024-04-18T21:10:24.933361+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:24.933361+0000","last_undegraded":"2024-04-18T21:10:24.933361+0000","last_fullsized":"2024-04-18T21:10:24.933361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":285,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190938+0000","last_change":"2024-04-18T21:10:25.190938+0000","last_active":"2024-04-18T21:10:25.190938+0000","last_peered":"2024-04-18T21:07:20.021859+0000","last_clean":"2024-04-18T21:07:20.021859+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:10:25.190938+0000","last_undegraded":"2024-04-18T21:10:25.190938+0000","last_fullsized":"2024-04-18T21:10:25.190938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933948+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:24.933948+0000","last_peered":"2024-04-18T21:10:24.933948+0000","last_clean":"2024-04-18T21:10:24.933948+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:24.933948+0000","last_undegraded":"2024-04-18T21:10:24.933948+0000","last_fullsized":"2024-04-18T21:10:24.933948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":575,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921470+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:24.921470+0000","last_peered":"2024-04-18T21:10:24.921470+0000","last_clean":"2024-04-18T21:10:24.921470+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:24.921470+0000","last_undegraded":"2024-04-18T21:10:24.921470+0000","last_fullsized":"2024-04-18T21:10:24.921470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933724+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:24.933724+0000","last_peered":"2024-04-18T21:10:24.933724+0000","last_clean":"2024-04-18T21:10:24.933724+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:24.933724+0000","last_undegraded":"2024-04-18T21:10:24.933724+0000","last_fullsized":"2024-04-18T21:10:24.933724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928748+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:24.928748+0000","last_peered":"2024-04-18T21:10:24.928748+0000","last_clean":"2024-04-18T21:10:24.928748+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:24.928748+0000","last_undegraded":"2024-04-18T21:10:24.928748+0000","last_fullsized":"2024-04-18T21:10:24.928748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":587,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925008+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:24.925008+0000","last_peered":"2024-04-18T21:10:24.925008+0000","last_clean":"2024-04-18T21:10:24.925008+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:24.925008+0000","last_undegraded":"2024-04-18T21:10:24.925008+0000","last_fullsized":"2024-04-18T21:10:24.925008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927275+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:24.927275+0000","last_peered":"2024-04-18T21:10:24.927275+0000","last_clean":"2024-04-18T21:10:24.927275+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:24.927275+0000","last_undegraded":"2024-04-18T21:10:24.927275+0000","last_fullsized":"2024-04-18T21:10:24.927275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933808+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:24.933808+0000","last_peered":"2024-04-18T21:10:24.933808+0000","last_clean":"2024-04-18T21:10:24.933808+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:24.933808+0000","last_undegraded":"2024-04-18T21:10:24.933808+0000","last_fullsized":"2024-04-18T21:10:24.933808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":559,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928910+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:24.928910+0000","last_peered":"2024-04-18T21:10:24.928910+0000","last_clean":"2024-04-18T21:10:24.928910+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:24.928910+0000","last_undegraded":"2024-04-18T21:10:24.928910+0000","last_fullsized":"2024-04-18T21:10:24.928910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":239,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933343+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:24.933343+0000","last_peered":"2024-04-18T21:10:24.933343+0000","last_clean":"2024-04-18T21:10:24.933343+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:24.933343+0000","last_undegraded":"2024-04-18T21:10:24.933343+0000","last_fullsized":"2024-04-18T21:10:24.933343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.917433+0000","last_change":"2024-04-18T21:10:17.121796+0000","last_active":"2024-04-18T21:10:17.121796+0000","last_peered":"2024-04-18T21:10:14.840628+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.054276+0000","last_became_peered":"2024-04-18T21:07:34.054276+0000","last_unstale":"2024-04-18T21:10:23.917433+0000","last_undegraded":"2024-04-18T21:10:23.917433+0000","last_fullsized":"2024-04-18T21:10:23.917433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":614,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921123+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:24.921123+0000","last_peered":"2024-04-18T21:10:24.921123+0000","last_clean":"2024-04-18T21:10:24.921123+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:24.921123+0000","last_undegraded":"2024-04-18T21:10:24.921123+0000","last_fullsized":"2024-04-18T21:10:24.921123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":625,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749809+0000","last_change":"2024-04-18T21:10:25.191106+0000","last_active":"2024-04-18T21:10:25.191106+0000","last_peered":"2024-04-18T21:10:22.749809+0000","last_clean":"2024-04-18T21:10:22.749809+0000","last_became_active":"2024-04-18T21:10:17.134137+0000","last_became_peered":"2024-04-18T21:10:17.134137+0000","last_unstale":"2024-04-18T21:10:22.749809+0000","last_undegraded":"2024-04-18T21:10:22.749809+0000","last_fullsized":"2024-04-18T21:10:22.749809+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":386,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.748811+0000","last_change":"2024-04-18T21:10:25.190602+0000","last_active":"2024-04-18T21:10:25.190602+0000","last_peered":"2024-04-18T21:10:22.748811+0000","last_clean":"2024-04-18T21:10:22.748811+0000","last_became_active":"2024-04-18T21:10:17.133733+0000","last_became_peered":"2024-04-18T21:10:17.133733+0000","last_unstale":"2024-04-18T21:10:22.748811+0000","last_undegraded":"2024-04-18T21:10:22.748811+0000","last_fullsized":"2024-04-18T21:10:22.748811+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":567,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926718+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:24.926718+0000","last_peered":"2024-04-18T21:10:24.926718+0000","last_clean":"2024-04-18T21:10:24.926718+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:24.926718+0000","last_undegraded":"2024-04-18T21:10:24.926718+0000","last_fullsized":"2024-04-18T21:10:24.926718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":240,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927489+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:24.927489+0000","last_peered":"2024-04-18T21:10:24.927489+0000","last_clean":"2024-04-18T21:10:24.927489+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:24.927489+0000","last_undegraded":"2024-04-18T21:10:24.927489+0000","last_fullsized":"2024-04-18T21:10:24.927489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":258,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196450+0000","last_change":"2024-04-18T21:10:25.196450+0000","last_active":"2024-04-18T21:10:25.196450+0000","last_peered":"2024-04-18T21:07:18.651325+0000","last_clean":"2024-04-18T21:07:18.651325+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:10:25.196450+0000","last_undegraded":"2024-04-18T21:10:25.196450+0000","last_fullsized":"2024-04-18T21:10:25.196450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":666,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926999+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:24.926999+0000","last_peered":"2024-04-18T21:10:24.926999+0000","last_clean":"2024-04-18T21:10:24.926999+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:24.926999+0000","last_undegraded":"2024-04-18T21:10:24.926999+0000","last_fullsized":"2024-04-18T21:10:24.926999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":618,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927941+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:24.927941+0000","last_peered":"2024-04-18T21:10:24.927941+0000","last_clean":"2024-04-18T21:10:24.927941+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:24.927941+0000","last_undegraded":"2024-04-18T21:10:24.927941+0000","last_fullsized":"2024-04-18T21:10:24.927941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":526,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924972+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:24.924972+0000","last_peered":"2024-04-18T21:10:24.924972+0000","last_clean":"2024-04-18T21:10:24.924972+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:24.924972+0000","last_undegraded":"2024-04-18T21:10:24.924972+0000","last_fullsized":"2024-04-18T21:10:24.924972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":772,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929236+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:24.929236+0000","last_peered":"2024-04-18T21:10:24.929236+0000","last_clean":"2024-04-18T21:10:24.929236+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:24.929236+0000","last_undegraded":"2024-04-18T21:10:24.929236+0000","last_fullsized":"2024-04-18T21:10:24.929236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932149+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:24.932149+0000","last_peered":"2024-04-18T21:10:24.932149+0000","last_clean":"2024-04-18T21:10:24.932149+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:24.932149+0000","last_undegraded":"2024-04-18T21:10:24.932149+0000","last_fullsized":"2024-04-18T21:10:24.932149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":369,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929014+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:24.929014+0000","last_peered":"2024-04-18T21:10:24.929014+0000","last_clean":"2024-04-18T21:10:24.929014+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:24.929014+0000","last_undegraded":"2024-04-18T21:10:24.929014+0000","last_fullsized":"2024-04-18T21:10:24.929014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":599,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925836+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:24.925836+0000","last_peered":"2024-04-18T21:10:24.925836+0000","last_clean":"2024-04-18T21:10:24.925836+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:24.925836+0000","last_undegraded":"2024-04-18T21:10:24.925836+0000","last_fullsized":"2024-04-18T21:10:24.925836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":290,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922229+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:24.922229+0000","last_peered":"2024-04-18T21:10:24.922229+0000","last_clean":"2024-04-18T21:10:24.922229+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:24.922229+0000","last_undegraded":"2024-04-18T21:10:24.922229+0000","last_fullsized":"2024-04-18T21:10:24.922229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":561,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922143+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:24.922143+0000","last_peered":"2024-04-18T21:10:24.922143+0000","last_clean":"2024-04-18T21:10:24.922143+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:24.922143+0000","last_undegraded":"2024-04-18T21:10:24.922143+0000","last_fullsized":"2024-04-18T21:10:24.922143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922718+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:24.922718+0000","last_peered":"2024-04-18T21:10:24.922718+0000","last_clean":"2024-04-18T21:10:24.922718+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:24.922718+0000","last_undegraded":"2024-04-18T21:10:24.922718+0000","last_fullsized":"2024-04-18T21:10:24.922718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":520,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190983+0000","last_change":"2024-04-18T21:10:25.190983+0000","last_active":"2024-04-18T21:10:25.190983+0000","last_peered":"2024-04-18T21:07:22.960952+0000","last_clean":"2024-04-18T21:07:22.960952+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:10:25.190983+0000","last_undegraded":"2024-04-18T21:10:25.190983+0000","last_fullsized":"2024-04-18T21:10:25.190983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":244,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189285+0000","last_change":"2024-04-18T21:10:25.189285+0000","last_active":"2024-04-18T21:10:25.189285+0000","last_peered":"2024-04-18T21:07:09.916748+0000","last_clean":"2024-04-18T21:07:09.916748+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:10:25.189285+0000","last_undegraded":"2024-04-18T21:10:25.189285+0000","last_fullsized":"2024-04-18T21:10:25.189285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":554,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189389+0000","last_change":"2024-04-18T21:10:25.189389+0000","last_active":"2024-04-18T21:10:25.189389+0000","last_peered":"2024-04-18T21:07:22.917646+0000","last_clean":"2024-04-18T21:07:22.917646+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:10:25.189389+0000","last_undegraded":"2024-04-18T21:10:25.189389+0000","last_fullsized":"2024-04-18T21:10:25.189389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927204+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:24.927204+0000","last_peered":"2024-04-18T21:10:24.927204+0000","last_clean":"2024-04-18T21:10:24.927204+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:24.927204+0000","last_undegraded":"2024-04-18T21:10:24.927204+0000","last_fullsized":"2024-04-18T21:10:24.927204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923084+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:24.923084+0000","last_peered":"2024-04-18T21:10:24.923084+0000","last_clean":"2024-04-18T21:10:24.923084+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:24.923084+0000","last_undegraded":"2024-04-18T21:10:24.923084+0000","last_fullsized":"2024-04-18T21:10:24.923084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":328,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932641+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:24.932641+0000","last_peered":"2024-04-18T21:10:24.932641+0000","last_clean":"2024-04-18T21:10:24.932641+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:24.932641+0000","last_undegraded":"2024-04-18T21:10:24.932641+0000","last_fullsized":"2024-04-18T21:10:24.932641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":595,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196746+0000","last_change":"2024-04-18T21:10:25.196746+0000","last_active":"2024-04-18T21:10:25.196746+0000","last_peered":"2024-04-18T21:07:22.946951+0000","last_clean":"2024-04-18T21:07:22.946951+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:10:25.196746+0000","last_undegraded":"2024-04-18T21:10:25.196746+0000","last_fullsized":"2024-04-18T21:10:25.196746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":222,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926518+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:24.926518+0000","last_peered":"2024-04-18T21:10:24.926518+0000","last_clean":"2024-04-18T21:10:24.926518+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:24.926518+0000","last_undegraded":"2024-04-18T21:10:24.926518+0000","last_fullsized":"2024-04-18T21:10:24.926518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28124,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28798976,"data_stored":84673283,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103528,"kb_used_data":27996,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268312,"statfs":{"total":96636764160,"available":96530751488,"internally_reserved":0,"allocated":28667904,"data_stored":81352623,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350980,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29072,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29769728,"data_stored":90498460,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:30.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-18T21:10:31.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:31.179 INFO:teuthology.orchestra.run.smithi096.stdout:{"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 2 pgs inactive, 24 pgs peering","count":26},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":344,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":89,"num_osds":3,"num_up_osds":3,"osd_up_since":1713474615,"num_in_osds":3,"osd_in_since":1713474287,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"peering","count":38}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127727781,"bytes_used":272097280,"bytes_avail":289638195200,"bytes_total":289910292480,"inactive_pgs_ratio":0.36190477013587952},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-18T21:06:15.623145+0000","services":{}},"progress_events":{}} 2024-04-18T21:10:31.198 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-18T21:10:31.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:31.498 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:31.514 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-18T21:10:29.735382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265720,"kb_used_data":85192,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849800,"statfs":{"total":289910292480,"available":289638195200,"internally_reserved":0,"allocated":87236608,"data_stored":256524366,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001862"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924469+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:24.924469+0000","last_peered":"2024-04-18T21:10:24.924469+0000","last_clean":"2024-04-18T21:10:24.924469+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:24.924469+0000","last_undegraded":"2024-04-18T21:10:24.924469+0000","last_fullsized":"2024-04-18T21:10:24.924469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":608,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921942+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:24.921942+0000","last_peered":"2024-04-18T21:10:24.921942+0000","last_clean":"2024-04-18T21:10:24.921942+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:24.921942+0000","last_undegraded":"2024-04-18T21:10:24.921942+0000","last_fullsized":"2024-04-18T21:10:24.921942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":531,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.203812+0000","last_change":"2024-04-18T21:10:25.203812+0000","last_active":"2024-04-18T21:10:25.203812+0000","last_peered":"2024-04-18T21:07:22.957446+0000","last_clean":"2024-04-18T21:07:22.957446+0000","last_became_active":"2024-04-18T21:06:42.769225+0000","last_became_peered":"2024-04-18T21:06:42.769225+0000","last_unstale":"2024-04-18T21:10:25.203812+0000","last_undegraded":"2024-04-18T21:10:25.203812+0000","last_fullsized":"2024-04-18T21:10:25.203812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":530,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192955+0000","last_change":"2024-04-18T21:10:25.192955+0000","last_active":"2024-04-18T21:10:25.192955+0000","last_peered":"2024-04-18T21:07:22.948971+0000","last_clean":"2024-04-18T21:07:22.948971+0000","last_became_active":"2024-04-18T21:06:42.769856+0000","last_became_peered":"2024-04-18T21:06:42.769856+0000","last_unstale":"2024-04-18T21:10:25.192955+0000","last_undegraded":"2024-04-18T21:10:25.192955+0000","last_fullsized":"2024-04-18T21:10:25.192955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":610,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922801+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:24.922801+0000","last_peered":"2024-04-18T21:10:24.922801+0000","last_clean":"2024-04-18T21:10:24.922801+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:24.922801+0000","last_undegraded":"2024-04-18T21:10:24.922801+0000","last_fullsized":"2024-04-18T21:10:24.922801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":543,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196541+0000","last_change":"2024-04-18T21:10:25.196541+0000","last_active":"2024-04-18T21:10:25.196541+0000","last_peered":"2024-04-18T21:07:22.946960+0000","last_clean":"2024-04-18T21:07:22.946960+0000","last_became_active":"2024-04-18T21:06:42.761728+0000","last_became_peered":"2024-04-18T21:06:42.761728+0000","last_unstale":"2024-04-18T21:10:25.196541+0000","last_undegraded":"2024-04-18T21:10:25.196541+0000","last_fullsized":"2024-04-18T21:10:25.196541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":588,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.188244+0000","last_change":"2024-04-18T21:10:25.188244+0000","last_active":"2024-04-18T21:10:25.188244+0000","last_peered":"2024-04-18T21:07:22.949792+0000","last_clean":"2024-04-18T21:07:22.949792+0000","last_became_active":"2024-04-18T21:06:42.761329+0000","last_became_peered":"2024-04-18T21:06:42.761329+0000","last_unstale":"2024-04-18T21:10:25.188244+0000","last_undegraded":"2024-04-18T21:10:25.188244+0000","last_fullsized":"2024-04-18T21:10:25.188244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":522,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.191293+0000","last_change":"2024-04-18T21:10:25.191293+0000","last_active":"2024-04-18T21:10:25.191293+0000","last_peered":"2024-04-18T21:07:22.949804+0000","last_clean":"2024-04-18T21:07:22.949804+0000","last_became_active":"2024-04-18T21:06:42.761435+0000","last_became_peered":"2024-04-18T21:06:42.761435+0000","last_unstale":"2024-04-18T21:10:25.191293+0000","last_undegraded":"2024-04-18T21:10:25.191293+0000","last_fullsized":"2024-04-18T21:10:25.191293+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":659,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925633+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:24.925633+0000","last_peered":"2024-04-18T21:10:24.925633+0000","last_clean":"2024-04-18T21:10:24.925633+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:24.925633+0000","last_undegraded":"2024-04-18T21:10:24.925633+0000","last_fullsized":"2024-04-18T21:10:24.925633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":569,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923028+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:24.923028+0000","last_peered":"2024-04-18T21:10:24.923028+0000","last_clean":"2024-04-18T21:10:24.923028+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:24.923028+0000","last_undegraded":"2024-04-18T21:10:24.923028+0000","last_fullsized":"2024-04-18T21:10:24.923028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":515,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.202591+0000","last_change":"2024-04-18T21:10:25.202591+0000","last_active":"2024-04-18T21:10:25.202591+0000","last_peered":"2024-04-18T21:07:22.964633+0000","last_clean":"2024-04-18T21:07:22.964633+0000","last_became_active":"2024-04-18T21:06:42.766321+0000","last_became_peered":"2024-04-18T21:06:42.766321+0000","last_unstale":"2024-04-18T21:10:25.202591+0000","last_undegraded":"2024-04-18T21:10:25.202591+0000","last_fullsized":"2024-04-18T21:10:25.202591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":564,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921739+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:24.921739+0000","last_peered":"2024-04-18T21:10:24.921739+0000","last_clean":"2024-04-18T21:10:24.921739+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:24.921739+0000","last_undegraded":"2024-04-18T21:10:24.921739+0000","last_fullsized":"2024-04-18T21:10:24.921739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":596,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922512+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:24.922512+0000","last_peered":"2024-04-18T21:10:24.922512+0000","last_clean":"2024-04-18T21:10:24.922512+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:24.922512+0000","last_undegraded":"2024-04-18T21:10:24.922512+0000","last_fullsized":"2024-04-18T21:10:24.922512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":641,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749197+0000","last_change":"2024-04-18T21:10:25.191674+0000","last_active":"2024-04-18T21:10:25.191674+0000","last_peered":"2024-04-18T21:10:22.749197+0000","last_clean":"2024-04-18T21:10:22.749197+0000","last_became_active":"2024-04-18T21:10:17.140677+0000","last_became_peered":"2024-04-18T21:10:17.140677+0000","last_unstale":"2024-04-18T21:10:22.749197+0000","last_undegraded":"2024-04-18T21:10:22.749197+0000","last_fullsized":"2024-04-18T21:10:22.749197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":645,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749533+0000","last_change":"2024-04-18T21:10:25.188538+0000","last_active":"2024-04-18T21:10:25.188538+0000","last_peered":"2024-04-18T21:10:22.749533+0000","last_clean":"2024-04-18T21:10:22.749533+0000","last_became_active":"2024-04-18T21:10:17.131630+0000","last_became_peered":"2024-04-18T21:10:17.131630+0000","last_unstale":"2024-04-18T21:10:22.749533+0000","last_undegraded":"2024-04-18T21:10:22.749533+0000","last_fullsized":"2024-04-18T21:10:22.749533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":626,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200826+0000","last_change":"2024-04-18T21:10:25.200826+0000","last_active":"2024-04-18T21:10:25.200826+0000","last_peered":"2024-04-18T21:07:22.960697+0000","last_clean":"2024-04-18T21:07:22.960697+0000","last_became_active":"2024-04-18T21:06:42.758833+0000","last_became_peered":"2024-04-18T21:06:42.758833+0000","last_unstale":"2024-04-18T21:10:25.200826+0000","last_undegraded":"2024-04-18T21:10:25.200826+0000","last_fullsized":"2024-04-18T21:10:25.200826+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":589,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927224+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:24.927224+0000","last_peered":"2024-04-18T21:10:24.927224+0000","last_clean":"2024-04-18T21:10:24.927224+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:24.927224+0000","last_undegraded":"2024-04-18T21:10:24.927224+0000","last_fullsized":"2024-04-18T21:10:24.927224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":597,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923175+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:24.923175+0000","last_peered":"2024-04-18T21:10:24.923175+0000","last_clean":"2024-04-18T21:10:24.923175+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:24.923175+0000","last_undegraded":"2024-04-18T21:10:24.923175+0000","last_fullsized":"2024-04-18T21:10:24.923175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":628,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926866+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:24.926866+0000","last_peered":"2024-04-18T21:10:24.926866+0000","last_clean":"2024-04-18T21:10:24.926866+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:24.926866+0000","last_undegraded":"2024-04-18T21:10:24.926866+0000","last_fullsized":"2024-04-18T21:10:24.926866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":579,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.195904+0000","last_change":"2024-04-18T21:10:25.195904+0000","last_active":"2024-04-18T21:10:25.195904+0000","last_peered":"2024-04-18T21:07:22.916966+0000","last_clean":"2024-04-18T21:07:22.916966+0000","last_became_active":"2024-04-18T21:06:42.772580+0000","last_became_peered":"2024-04-18T21:06:42.772580+0000","last_unstale":"2024-04-18T21:10:25.195904+0000","last_undegraded":"2024-04-18T21:10:25.195904+0000","last_fullsized":"2024-04-18T21:10:25.195904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":526,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.192946+0000","last_change":"2024-04-18T21:10:25.192946+0000","last_active":"2024-04-18T21:10:25.192946+0000","last_peered":"2024-04-18T21:07:22.958552+0000","last_clean":"2024-04-18T21:07:22.958552+0000","last_became_active":"2024-04-18T21:06:42.774668+0000","last_became_peered":"2024-04-18T21:06:42.774668+0000","last_unstale":"2024-04-18T21:10:25.192946+0000","last_undegraded":"2024-04-18T21:10:25.192946+0000","last_fullsized":"2024-04-18T21:10:25.192946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921021+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:24.921021+0000","last_peered":"2024-04-18T21:10:24.921021+0000","last_clean":"2024-04-18T21:10:24.921021+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:24.921021+0000","last_undegraded":"2024-04-18T21:10:24.921021+0000","last_fullsized":"2024-04-18T21:10:24.921021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":591,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925044+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:24.925044+0000","last_peered":"2024-04-18T21:10:24.925044+0000","last_clean":"2024-04-18T21:10:24.925044+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:24.925044+0000","last_undegraded":"2024-04-18T21:10:24.925044+0000","last_fullsized":"2024-04-18T21:10:24.925044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920783+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:24.920783+0000","last_peered":"2024-04-18T21:10:24.920783+0000","last_clean":"2024-04-18T21:10:24.920783+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:24.920783+0000","last_undegraded":"2024-04-18T21:10:24.920783+0000","last_fullsized":"2024-04-18T21:10:24.920783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":601,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924654+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:24.924654+0000","last_peered":"2024-04-18T21:10:24.924654+0000","last_clean":"2024-04-18T21:10:24.924654+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:24.924654+0000","last_undegraded":"2024-04-18T21:10:24.924654+0000","last_fullsized":"2024-04-18T21:10:24.924654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":740,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930675+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:24.930675+0000","last_peered":"2024-04-18T21:10:24.930675+0000","last_clean":"2024-04-18T21:10:24.930675+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:24.930675+0000","last_undegraded":"2024-04-18T21:10:24.930675+0000","last_fullsized":"2024-04-18T21:10:24.930675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":582,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750329+0000","last_change":"2024-04-18T21:10:25.200634+0000","last_active":"2024-04-18T21:10:25.200634+0000","last_peered":"2024-04-18T21:10:22.750329+0000","last_clean":"2024-04-18T21:10:22.750329+0000","last_became_active":"2024-04-18T21:10:17.157423+0000","last_became_peered":"2024-04-18T21:10:17.157423+0000","last_unstale":"2024-04-18T21:10:22.750329+0000","last_undegraded":"2024-04-18T21:10:22.750329+0000","last_fullsized":"2024-04-18T21:10:22.750329+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":647,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922768+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:24.922768+0000","last_peered":"2024-04-18T21:10:24.922768+0000","last_clean":"2024-04-18T21:10:24.922768+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:24.922768+0000","last_undegraded":"2024-04-18T21:10:24.922768+0000","last_fullsized":"2024-04-18T21:10:24.922768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930044+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:24.930044+0000","last_peered":"2024-04-18T21:10:24.930044+0000","last_clean":"2024-04-18T21:10:24.930044+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:24.930044+0000","last_undegraded":"2024-04-18T21:10:24.930044+0000","last_fullsized":"2024-04-18T21:10:24.930044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":691,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921793+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:24.921793+0000","last_peered":"2024-04-18T21:10:24.921793+0000","last_clean":"2024-04-18T21:10:24.921793+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:24.921793+0000","last_undegraded":"2024-04-18T21:10:24.921793+0000","last_fullsized":"2024-04-18T21:10:24.921793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":661,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926762+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:24.926762+0000","last_peered":"2024-04-18T21:10:24.926762+0000","last_clean":"2024-04-18T21:10:24.926762+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:24.926762+0000","last_undegraded":"2024-04-18T21:10:24.926762+0000","last_fullsized":"2024-04-18T21:10:24.926762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":599,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189432+0000","last_change":"2024-04-18T21:10:25.189432+0000","last_active":"2024-04-18T21:10:25.189432+0000","last_peered":"2024-04-18T21:07:22.952459+0000","last_clean":"2024-04-18T21:07:22.952459+0000","last_became_active":"2024-04-18T21:06:42.762985+0000","last_became_peered":"2024-04-18T21:06:42.762985+0000","last_unstale":"2024-04-18T21:10:25.189432+0000","last_undegraded":"2024-04-18T21:10:25.189432+0000","last_fullsized":"2024-04-18T21:10:25.189432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":578,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922439+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:24.922439+0000","last_peered":"2024-04-18T21:10:24.922439+0000","last_clean":"2024-04-18T21:10:24.922439+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:24.922439+0000","last_undegraded":"2024-04-18T21:10:24.922439+0000","last_fullsized":"2024-04-18T21:10:24.922439+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":620,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189324+0000","last_change":"2024-04-18T21:10:25.189324+0000","last_active":"2024-04-18T21:10:25.189324+0000","last_peered":"2024-04-18T21:06:59.247748+0000","last_clean":"2024-04-18T21:06:59.247748+0000","last_became_active":"2024-04-18T21:06:42.765328+0000","last_became_peered":"2024-04-18T21:06:42.765328+0000","last_unstale":"2024-04-18T21:10:25.189324+0000","last_undegraded":"2024-04-18T21:10:25.189324+0000","last_fullsized":"2024-04-18T21:10:25.189324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":583,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":216,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929036+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:24.929036+0000","last_peered":"2024-04-18T21:10:24.929036+0000","last_clean":"2024-04-18T21:10:24.929036+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:24.929036+0000","last_undegraded":"2024-04-18T21:10:24.929036+0000","last_fullsized":"2024-04-18T21:10:24.929036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":620,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932977+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:24.932977+0000","last_peered":"2024-04-18T21:10:24.932977+0000","last_clean":"2024-04-18T21:10:24.932977+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:24.932977+0000","last_undegraded":"2024-04-18T21:10:24.932977+0000","last_fullsized":"2024-04-18T21:10:24.932977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":244,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922379+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:24.922379+0000","last_peered":"2024-04-18T21:10:24.922379+0000","last_clean":"2024-04-18T21:10:24.922379+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:24.922379+0000","last_undegraded":"2024-04-18T21:10:24.922379+0000","last_fullsized":"2024-04-18T21:10:24.922379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925970+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:24.925970+0000","last_peered":"2024-04-18T21:10:24.925970+0000","last_clean":"2024-04-18T21:10:24.925970+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:24.925970+0000","last_undegraded":"2024-04-18T21:10:24.925970+0000","last_fullsized":"2024-04-18T21:10:24.925970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":161,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747867+0000","last_change":"2024-04-18T21:10:25.187369+0000","last_active":"2024-04-18T21:10:25.187369+0000","last_peered":"2024-04-18T21:10:22.747867+0000","last_clean":"2024-04-18T21:10:22.747867+0000","last_became_active":"2024-04-18T21:10:17.136098+0000","last_became_peered":"2024-04-18T21:10:17.136098+0000","last_unstale":"2024-04-18T21:10:22.747867+0000","last_undegraded":"2024-04-18T21:10:22.747867+0000","last_fullsized":"2024-04-18T21:10:22.747867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":170,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.200983+0000","last_change":"2024-04-18T21:10:25.200983+0000","last_active":"2024-04-18T21:10:25.200983+0000","last_peered":"2024-04-18T21:07:11.855434+0000","last_clean":"2024-04-18T21:07:11.855434+0000","last_became_active":"2024-04-18T21:06:42.768324+0000","last_became_peered":"2024-04-18T21:06:42.768324+0000","last_unstale":"2024-04-18T21:10:25.200983+0000","last_undegraded":"2024-04-18T21:10:25.200983+0000","last_fullsized":"2024-04-18T21:10:25.200983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":604,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920982+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:24.920982+0000","last_peered":"2024-04-18T21:10:24.920982+0000","last_clean":"2024-04-18T21:10:24.920982+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:24.920982+0000","last_undegraded":"2024-04-18T21:10:24.920982+0000","last_fullsized":"2024-04-18T21:10:24.920982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":447,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923884+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:24.923884+0000","last_peered":"2024-04-18T21:10:24.923884+0000","last_clean":"2024-04-18T21:10:24.923884+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:24.923884+0000","last_undegraded":"2024-04-18T21:10:24.923884+0000","last_fullsized":"2024-04-18T21:10:24.923884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":644,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.920935+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:24.920935+0000","last_peered":"2024-04-18T21:10:24.920935+0000","last_clean":"2024-04-18T21:10:24.920935+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:24.920935+0000","last_undegraded":"2024-04-18T21:10:24.920935+0000","last_fullsized":"2024-04-18T21:10:24.920935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":615,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750052+0000","last_change":"2024-04-18T21:10:25.194627+0000","last_active":"2024-04-18T21:10:25.194627+0000","last_peered":"2024-04-18T21:10:22.750052+0000","last_clean":"2024-04-18T21:10:22.750052+0000","last_became_active":"2024-04-18T21:10:17.138701+0000","last_became_peered":"2024-04-18T21:10:17.138701+0000","last_unstale":"2024-04-18T21:10:22.750052+0000","last_undegraded":"2024-04-18T21:10:22.750052+0000","last_fullsized":"2024-04-18T21:10:22.750052+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":691,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196497+0000","last_change":"2024-04-18T21:10:25.196497+0000","last_active":"2024-04-18T21:10:25.196497+0000","last_peered":"2024-04-18T21:07:22.953093+0000","last_clean":"2024-04-18T21:07:22.953093+0000","last_became_active":"2024-04-18T21:06:42.766785+0000","last_became_peered":"2024-04-18T21:06:42.766785+0000","last_unstale":"2024-04-18T21:10:25.196497+0000","last_undegraded":"2024-04-18T21:10:25.196497+0000","last_fullsized":"2024-04-18T21:10:25.196497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199958+0000","last_change":"2024-04-18T21:06:41.751008+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.199958+0000","last_undegraded":"2024-04-18T21:10:25.199958+0000","last_fullsized":"2024-04-18T21:10:25.199958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":698,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930213+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:24.930213+0000","last_peered":"2024-04-18T21:10:24.930213+0000","last_clean":"2024-04-18T21:10:24.930213+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:24.930213+0000","last_undegraded":"2024-04-18T21:10:24.930213+0000","last_fullsized":"2024-04-18T21:10:24.930213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":334,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932961+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:24.932961+0000","last_peered":"2024-04-18T21:10:24.932961+0000","last_clean":"2024-04-18T21:10:24.932961+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:24.932961+0000","last_undegraded":"2024-04-18T21:10:24.932961+0000","last_fullsized":"2024-04-18T21:10:24.932961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":617,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.204345+0000","last_change":"2024-04-18T21:10:25.204345+0000","last_active":"2024-04-18T21:10:25.204345+0000","last_peered":"2024-04-18T21:07:22.956950+0000","last_clean":"2024-04-18T21:07:22.956950+0000","last_became_active":"2024-04-18T21:06:42.770721+0000","last_became_peered":"2024-04-18T21:06:42.770721+0000","last_unstale":"2024-04-18T21:10:25.204345+0000","last_undegraded":"2024-04-18T21:10:25.204345+0000","last_fullsized":"2024-04-18T21:10:25.204345+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":117,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189043+0000","last_change":"2024-04-18T21:10:25.189043+0000","last_active":"2024-04-18T21:10:25.189043+0000","last_peered":"2024-04-18T21:07:12.552712+0000","last_clean":"2024-04-18T21:07:12.552712+0000","last_became_active":"2024-04-18T21:06:42.761420+0000","last_became_peered":"2024-04-18T21:06:42.761420+0000","last_unstale":"2024-04-18T21:10:25.189043+0000","last_undegraded":"2024-04-18T21:10:25.189043+0000","last_fullsized":"2024-04-18T21:10:25.189043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749766+0000","last_change":"2024-04-18T21:10:25.200048+0000","last_active":"2024-04-18T21:10:25.200048+0000","last_peered":"2024-04-18T21:10:22.749766+0000","last_clean":"2024-04-18T21:10:22.749766+0000","last_became_active":"2024-04-18T21:10:17.140649+0000","last_became_peered":"2024-04-18T21:10:17.140649+0000","last_unstale":"2024-04-18T21:10:22.749766+0000","last_undegraded":"2024-04-18T21:10:22.749766+0000","last_fullsized":"2024-04-18T21:10:22.749766+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922666+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:24.922666+0000","last_peered":"2024-04-18T21:10:24.922666+0000","last_clean":"2024-04-18T21:10:24.922666+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:24.922666+0000","last_undegraded":"2024-04-18T21:10:24.922666+0000","last_fullsized":"2024-04-18T21:10:24.922666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":516,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.199668+0000","last_change":"2024-04-18T21:10:25.199668+0000","last_active":"2024-04-18T21:10:25.199668+0000","last_peered":"2024-04-18T21:07:22.962835+0000","last_clean":"2024-04-18T21:07:22.962835+0000","last_became_active":"2024-04-18T21:06:42.758100+0000","last_became_peered":"2024-04-18T21:06:42.758100+0000","last_unstale":"2024-04-18T21:10:25.199668+0000","last_undegraded":"2024-04-18T21:10:25.199668+0000","last_fullsized":"2024-04-18T21:10:25.199668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":554,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921454+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:24.921454+0000","last_peered":"2024-04-18T21:10:24.921454+0000","last_clean":"2024-04-18T21:10:24.921454+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:24.921454+0000","last_undegraded":"2024-04-18T21:10:24.921454+0000","last_fullsized":"2024-04-18T21:10:24.921454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":672,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926255+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:24.926255+0000","last_peered":"2024-04-18T21:10:24.926255+0000","last_clean":"2024-04-18T21:10:24.926255+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:24.926255+0000","last_undegraded":"2024-04-18T21:10:24.926255+0000","last_fullsized":"2024-04-18T21:10:24.926255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":318,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.747803+0000","last_change":"2024-04-18T21:10:25.193958+0000","last_active":"2024-04-18T21:10:25.193958+0000","last_peered":"2024-04-18T21:10:22.747803+0000","last_clean":"2024-04-18T21:10:22.747803+0000","last_became_active":"2024-04-18T21:10:17.135600+0000","last_became_peered":"2024-04-18T21:10:17.135600+0000","last_unstale":"2024-04-18T21:10:22.747803+0000","last_undegraded":"2024-04-18T21:10:22.747803+0000","last_fullsized":"2024-04-18T21:10:22.747803+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187633+0000","last_change":"2024-04-18T21:10:16.682987+0000","last_active":"2024-04-18T21:10:16.682987+0000","last_peered":"2024-04-18T21:10:14.839769+0000","last_clean":"2024-04-18T21:07:30.994987+0000","last_became_active":"2024-04-18T21:07:34.057035+0000","last_became_peered":"2024-04-18T21:07:34.057035+0000","last_unstale":"2024-04-18T21:10:25.187633+0000","last_undegraded":"2024-04-18T21:10:25.187633+0000","last_fullsized":"2024-04-18T21:10:25.187633+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":502,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.930566+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:24.930566+0000","last_peered":"2024-04-18T21:10:24.930566+0000","last_clean":"2024-04-18T21:10:24.930566+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:24.930566+0000","last_undegraded":"2024-04-18T21:10:24.930566+0000","last_fullsized":"2024-04-18T21:10:24.930566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":601,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.750092+0000","last_change":"2024-04-18T21:10:25.197311+0000","last_active":"2024-04-18T21:10:25.197311+0000","last_peered":"2024-04-18T21:10:22.750092+0000","last_clean":"2024-04-18T21:10:22.750092+0000","last_became_active":"2024-04-18T21:10:17.141516+0000","last_became_peered":"2024-04-18T21:10:17.141516+0000","last_unstale":"2024-04-18T21:10:22.750092+0000","last_undegraded":"2024-04-18T21:10:22.750092+0000","last_fullsized":"2024-04-18T21:10:22.750092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.914142+0000","last_change":"2024-04-18T21:10:17.128341+0000","last_active":"2024-04-18T21:10:17.128341+0000","last_peered":"2024-04-18T21:10:14.838882+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.051041+0000","last_became_peered":"2024-04-18T21:07:34.051041+0000","last_unstale":"2024-04-18T21:10:23.914142+0000","last_undegraded":"2024-04-18T21:10:23.914142+0000","last_fullsized":"2024-04-18T21:10:23.914142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932208+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:24.932208+0000","last_peered":"2024-04-18T21:10:24.932208+0000","last_clean":"2024-04-18T21:10:24.932208+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:24.932208+0000","last_undegraded":"2024-04-18T21:10:24.932208+0000","last_fullsized":"2024-04-18T21:10:24.932208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":704,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923628+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:24.923628+0000","last_peered":"2024-04-18T21:10:24.923628+0000","last_clean":"2024-04-18T21:10:24.923628+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:24.923628+0000","last_undegraded":"2024-04-18T21:10:24.923628+0000","last_fullsized":"2024-04-18T21:10:24.923628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932950+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:24.932950+0000","last_peered":"2024-04-18T21:10:24.932950+0000","last_clean":"2024-04-18T21:10:24.932950+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:24.932950+0000","last_undegraded":"2024-04-18T21:10:24.932950+0000","last_fullsized":"2024-04-18T21:10:24.932950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":449,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921615+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:24.921615+0000","last_peered":"2024-04-18T21:10:24.921615+0000","last_clean":"2024-04-18T21:10:24.921615+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:24.921615+0000","last_undegraded":"2024-04-18T21:10:24.921615+0000","last_fullsized":"2024-04-18T21:10:24.921615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":534,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923013+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:24.923013+0000","last_peered":"2024-04-18T21:10:24.923013+0000","last_clean":"2024-04-18T21:10:24.923013+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:24.923013+0000","last_undegraded":"2024-04-18T21:10:24.923013+0000","last_fullsized":"2024-04-18T21:10:24.923013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187440+0000","last_change":"2024-04-18T21:10:16.682526+0000","last_active":"2024-04-18T21:10:16.682526+0000","last_peered":"2024-04-18T21:10:14.840654+0000","last_clean":"2024-04-18T21:07:30.995015+0000","last_became_active":"2024-04-18T21:07:34.045061+0000","last_became_peered":"2024-04-18T21:07:34.045061+0000","last_unstale":"2024-04-18T21:10:25.187440+0000","last_undegraded":"2024-04-18T21:10:25.187440+0000","last_fullsized":"2024-04-18T21:10:25.187440+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":84,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.187794+0000","last_change":"2024-04-18T21:06:41.751500+0000","last_active":"2024-04-18T21:05:06.550148+0000","last_peered":"2024-04-18T21:05:06.550148+0000","last_clean":"2024-04-18T21:05:06.550148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T21:10:25.187794+0000","last_undegraded":"2024-04-18T21:10:25.187794+0000","last_fullsized":"2024-04-18T21:10:25.187794+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933361+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:24.933361+0000","last_peered":"2024-04-18T21:10:24.933361+0000","last_clean":"2024-04-18T21:10:24.933361+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:24.933361+0000","last_undegraded":"2024-04-18T21:10:24.933361+0000","last_fullsized":"2024-04-18T21:10:24.933361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":285,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190938+0000","last_change":"2024-04-18T21:10:25.190938+0000","last_active":"2024-04-18T21:10:25.190938+0000","last_peered":"2024-04-18T21:07:20.021859+0000","last_clean":"2024-04-18T21:07:20.021859+0000","last_became_active":"2024-04-18T21:06:42.770714+0000","last_became_peered":"2024-04-18T21:06:42.770714+0000","last_unstale":"2024-04-18T21:10:25.190938+0000","last_undegraded":"2024-04-18T21:10:25.190938+0000","last_fullsized":"2024-04-18T21:10:25.190938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933948+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:24.933948+0000","last_peered":"2024-04-18T21:10:24.933948+0000","last_clean":"2024-04-18T21:10:24.933948+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:24.933948+0000","last_undegraded":"2024-04-18T21:10:24.933948+0000","last_fullsized":"2024-04-18T21:10:24.933948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":575,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921470+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:24.921470+0000","last_peered":"2024-04-18T21:10:24.921470+0000","last_clean":"2024-04-18T21:10:24.921470+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:24.921470+0000","last_undegraded":"2024-04-18T21:10:24.921470+0000","last_fullsized":"2024-04-18T21:10:24.921470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933724+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:24.933724+0000","last_peered":"2024-04-18T21:10:24.933724+0000","last_clean":"2024-04-18T21:10:24.933724+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:24.933724+0000","last_undegraded":"2024-04-18T21:10:24.933724+0000","last_fullsized":"2024-04-18T21:10:24.933724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928748+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:24.928748+0000","last_peered":"2024-04-18T21:10:24.928748+0000","last_clean":"2024-04-18T21:10:24.928748+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:24.928748+0000","last_undegraded":"2024-04-18T21:10:24.928748+0000","last_fullsized":"2024-04-18T21:10:24.928748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":587,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925008+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:24.925008+0000","last_peered":"2024-04-18T21:10:24.925008+0000","last_clean":"2024-04-18T21:10:24.925008+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:24.925008+0000","last_undegraded":"2024-04-18T21:10:24.925008+0000","last_fullsized":"2024-04-18T21:10:24.925008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":219,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927275+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:24.927275+0000","last_peered":"2024-04-18T21:10:24.927275+0000","last_clean":"2024-04-18T21:10:24.927275+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:24.927275+0000","last_undegraded":"2024-04-18T21:10:24.927275+0000","last_fullsized":"2024-04-18T21:10:24.927275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933808+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:24.933808+0000","last_peered":"2024-04-18T21:10:24.933808+0000","last_clean":"2024-04-18T21:10:24.933808+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:24.933808+0000","last_undegraded":"2024-04-18T21:10:24.933808+0000","last_fullsized":"2024-04-18T21:10:24.933808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":559,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.928910+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:24.928910+0000","last_peered":"2024-04-18T21:10:24.928910+0000","last_clean":"2024-04-18T21:10:24.928910+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:24.928910+0000","last_undegraded":"2024-04-18T21:10:24.928910+0000","last_fullsized":"2024-04-18T21:10:24.928910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":239,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.933343+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:24.933343+0000","last_peered":"2024-04-18T21:10:24.933343+0000","last_clean":"2024-04-18T21:10:24.933343+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:24.933343+0000","last_undegraded":"2024-04-18T21:10:24.933343+0000","last_fullsized":"2024-04-18T21:10:24.933343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:23.917433+0000","last_change":"2024-04-18T21:10:17.121796+0000","last_active":"2024-04-18T21:10:17.121796+0000","last_peered":"2024-04-18T21:10:14.840628+0000","last_clean":"2024-04-18T21:05:02.525695+0000","last_became_active":"2024-04-18T21:07:34.054276+0000","last_became_peered":"2024-04-18T21:07:34.054276+0000","last_unstale":"2024-04-18T21:10:23.917433+0000","last_undegraded":"2024-04-18T21:10:23.917433+0000","last_fullsized":"2024-04-18T21:10:23.917433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":614,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.921123+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:24.921123+0000","last_peered":"2024-04-18T21:10:24.921123+0000","last_clean":"2024-04-18T21:10:24.921123+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:24.921123+0000","last_undegraded":"2024-04-18T21:10:24.921123+0000","last_fullsized":"2024-04-18T21:10:24.921123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":625,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.749809+0000","last_change":"2024-04-18T21:10:25.191106+0000","last_active":"2024-04-18T21:10:25.191106+0000","last_peered":"2024-04-18T21:10:22.749809+0000","last_clean":"2024-04-18T21:10:22.749809+0000","last_became_active":"2024-04-18T21:10:17.134137+0000","last_became_peered":"2024-04-18T21:10:17.134137+0000","last_unstale":"2024-04-18T21:10:22.749809+0000","last_undegraded":"2024-04-18T21:10:22.749809+0000","last_fullsized":"2024-04-18T21:10:22.749809+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":386,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-18T21:10:22.748811+0000","last_change":"2024-04-18T21:10:25.190602+0000","last_active":"2024-04-18T21:10:25.190602+0000","last_peered":"2024-04-18T21:10:22.748811+0000","last_clean":"2024-04-18T21:10:22.748811+0000","last_became_active":"2024-04-18T21:10:17.133733+0000","last_became_peered":"2024-04-18T21:10:17.133733+0000","last_unstale":"2024-04-18T21:10:22.748811+0000","last_undegraded":"2024-04-18T21:10:22.748811+0000","last_fullsized":"2024-04-18T21:10:22.748811+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":567,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926718+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:24.926718+0000","last_peered":"2024-04-18T21:10:24.926718+0000","last_clean":"2024-04-18T21:10:24.926718+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:24.926718+0000","last_undegraded":"2024-04-18T21:10:24.926718+0000","last_fullsized":"2024-04-18T21:10:24.926718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":240,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927489+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:24.927489+0000","last_peered":"2024-04-18T21:10:24.927489+0000","last_clean":"2024-04-18T21:10:24.927489+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:24.927489+0000","last_undegraded":"2024-04-18T21:10:24.927489+0000","last_fullsized":"2024-04-18T21:10:24.927489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":258,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196450+0000","last_change":"2024-04-18T21:10:25.196450+0000","last_active":"2024-04-18T21:10:25.196450+0000","last_peered":"2024-04-18T21:07:18.651325+0000","last_clean":"2024-04-18T21:07:18.651325+0000","last_became_active":"2024-04-18T21:06:42.764300+0000","last_became_peered":"2024-04-18T21:06:42.764300+0000","last_unstale":"2024-04-18T21:10:25.196450+0000","last_undegraded":"2024-04-18T21:10:25.196450+0000","last_fullsized":"2024-04-18T21:10:25.196450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":666,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927100+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:24.927100+0000","last_peered":"2024-04-18T21:10:24.927100+0000","last_clean":"2024-04-18T21:10:24.927100+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:24.927100+0000","last_undegraded":"2024-04-18T21:10:24.927100+0000","last_fullsized":"2024-04-18T21:10:24.927100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926999+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:24.926999+0000","last_peered":"2024-04-18T21:10:24.926999+0000","last_clean":"2024-04-18T21:10:24.926999+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:24.926999+0000","last_undegraded":"2024-04-18T21:10:24.926999+0000","last_fullsized":"2024-04-18T21:10:24.926999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":618,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927941+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:24.927941+0000","last_peered":"2024-04-18T21:10:24.927941+0000","last_clean":"2024-04-18T21:10:24.927941+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:24.927941+0000","last_undegraded":"2024-04-18T21:10:24.927941+0000","last_fullsized":"2024-04-18T21:10:24.927941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":526,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.924972+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:24.924972+0000","last_peered":"2024-04-18T21:10:24.924972+0000","last_clean":"2024-04-18T21:10:24.924972+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:24.924972+0000","last_undegraded":"2024-04-18T21:10:24.924972+0000","last_fullsized":"2024-04-18T21:10:24.924972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":772,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929236+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:24.929236+0000","last_peered":"2024-04-18T21:10:24.929236+0000","last_clean":"2024-04-18T21:10:24.929236+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:24.929236+0000","last_undegraded":"2024-04-18T21:10:24.929236+0000","last_fullsized":"2024-04-18T21:10:24.929236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932149+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:24.932149+0000","last_peered":"2024-04-18T21:10:24.932149+0000","last_clean":"2024-04-18T21:10:24.932149+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:24.932149+0000","last_undegraded":"2024-04-18T21:10:24.932149+0000","last_fullsized":"2024-04-18T21:10:24.932149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":369,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.929014+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:24.929014+0000","last_peered":"2024-04-18T21:10:24.929014+0000","last_clean":"2024-04-18T21:10:24.929014+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:24.929014+0000","last_undegraded":"2024-04-18T21:10:24.929014+0000","last_fullsized":"2024-04-18T21:10:24.929014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":599,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.925836+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:24.925836+0000","last_peered":"2024-04-18T21:10:24.925836+0000","last_clean":"2024-04-18T21:10:24.925836+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:24.925836+0000","last_undegraded":"2024-04-18T21:10:24.925836+0000","last_fullsized":"2024-04-18T21:10:24.925836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":290,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922229+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:24.922229+0000","last_peered":"2024-04-18T21:10:24.922229+0000","last_clean":"2024-04-18T21:10:24.922229+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:24.922229+0000","last_undegraded":"2024-04-18T21:10:24.922229+0000","last_fullsized":"2024-04-18T21:10:24.922229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":561,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922143+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:24.922143+0000","last_peered":"2024-04-18T21:10:24.922143+0000","last_clean":"2024-04-18T21:10:24.922143+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:24.922143+0000","last_undegraded":"2024-04-18T21:10:24.922143+0000","last_fullsized":"2024-04-18T21:10:24.922143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.922718+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:24.922718+0000","last_peered":"2024-04-18T21:10:24.922718+0000","last_clean":"2024-04-18T21:10:24.922718+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:24.922718+0000","last_undegraded":"2024-04-18T21:10:24.922718+0000","last_fullsized":"2024-04-18T21:10:24.922718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":520,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.190983+0000","last_change":"2024-04-18T21:10:25.190983+0000","last_active":"2024-04-18T21:10:25.190983+0000","last_peered":"2024-04-18T21:07:22.960952+0000","last_clean":"2024-04-18T21:07:22.960952+0000","last_became_active":"2024-04-18T21:06:42.761950+0000","last_became_peered":"2024-04-18T21:06:42.761950+0000","last_unstale":"2024-04-18T21:10:25.190983+0000","last_undegraded":"2024-04-18T21:10:25.190983+0000","last_fullsized":"2024-04-18T21:10:25.190983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":244,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189285+0000","last_change":"2024-04-18T21:10:25.189285+0000","last_active":"2024-04-18T21:10:25.189285+0000","last_peered":"2024-04-18T21:07:09.916748+0000","last_clean":"2024-04-18T21:07:09.916748+0000","last_became_active":"2024-04-18T21:06:42.766369+0000","last_became_peered":"2024-04-18T21:06:42.766369+0000","last_unstale":"2024-04-18T21:10:25.189285+0000","last_undegraded":"2024-04-18T21:10:25.189285+0000","last_fullsized":"2024-04-18T21:10:25.189285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":554,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.189389+0000","last_change":"2024-04-18T21:10:25.189389+0000","last_active":"2024-04-18T21:10:25.189389+0000","last_peered":"2024-04-18T21:07:22.917646+0000","last_clean":"2024-04-18T21:07:22.917646+0000","last_became_active":"2024-04-18T21:06:42.765321+0000","last_became_peered":"2024-04-18T21:06:42.765321+0000","last_unstale":"2024-04-18T21:10:25.189389+0000","last_undegraded":"2024-04-18T21:10:25.189389+0000","last_fullsized":"2024-04-18T21:10:25.189389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.927204+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:24.927204+0000","last_peered":"2024-04-18T21:10:24.927204+0000","last_clean":"2024-04-18T21:10:24.927204+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:24.927204+0000","last_undegraded":"2024-04-18T21:10:24.927204+0000","last_fullsized":"2024-04-18T21:10:24.927204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.923084+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:24.923084+0000","last_peered":"2024-04-18T21:10:24.923084+0000","last_clean":"2024-04-18T21:10:24.923084+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:24.923084+0000","last_undegraded":"2024-04-18T21:10:24.923084+0000","last_fullsized":"2024-04-18T21:10:24.923084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":328,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.932641+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:24.932641+0000","last_peered":"2024-04-18T21:10:24.932641+0000","last_clean":"2024-04-18T21:10:24.932641+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:24.932641+0000","last_undegraded":"2024-04-18T21:10:24.932641+0000","last_fullsized":"2024-04-18T21:10:24.932641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":595,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-18T21:10:25.196746+0000","last_change":"2024-04-18T21:10:25.196746+0000","last_active":"2024-04-18T21:10:25.196746+0000","last_peered":"2024-04-18T21:07:22.946951+0000","last_clean":"2024-04-18T21:07:22.946951+0000","last_became_active":"2024-04-18T21:06:42.763152+0000","last_became_peered":"2024-04-18T21:06:42.763152+0000","last_unstale":"2024-04-18T21:10:25.196746+0000","last_undegraded":"2024-04-18T21:10:25.196746+0000","last_fullsized":"2024-04-18T21:10:25.196746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":222,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T21:10:24.926518+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:24.926518+0000","last_peered":"2024-04-18T21:10:24.926518+0000","last_clean":"2024-04-18T21:10:24.926518+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:24.926518+0000","last_undegraded":"2024-04-18T21:10:24.926518+0000","last_fullsized":"2024-04-18T21:10:24.926518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28124,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28798976,"data_stored":84673283,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103528,"kb_used_data":27996,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268312,"statfs":{"total":96636764160,"available":96530751488,"internally_reserved":0,"allocated":28667904,"data_stored":81352623,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350980,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29072,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29769728,"data_stored":90498460,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:34.521 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:34.831 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:34.846 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-18T21:10:33.737097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265756,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849764,"statfs":{"total":289910292480,"available":289638158336,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.819350"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925304+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:25.925304+0000","last_peered":"2024-04-18T21:10:25.925304+0000","last_clean":"2024-04-18T21:10:25.925304+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:25.925304+0000","last_undegraded":"2024-04-18T21:10:25.925304+0000","last_fullsized":"2024-04-18T21:10:25.925304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925041+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:25.925041+0000","last_peered":"2024-04-18T21:10:25.925041+0000","last_clean":"2024-04-18T21:10:25.925041+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:25.925041+0000","last_undegraded":"2024-04-18T21:10:25.925041+0000","last_fullsized":"2024-04-18T21:10:25.925041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249269+0000","last_change":"2024-04-18T21:10:26.249269+0000","last_active":"2024-04-18T21:10:26.249269+0000","last_peered":"2024-04-18T21:10:26.249269+0000","last_clean":"2024-04-18T21:10:26.249269+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:10:26.249269+0000","last_undegraded":"2024-04-18T21:10:26.249269+0000","last_fullsized":"2024-04-18T21:10:26.249269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:15.741614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243242+0000","last_change":"2024-04-18T21:10:26.243242+0000","last_active":"2024-04-18T21:10:26.243242+0000","last_peered":"2024-04-18T21:10:26.243242+0000","last_clean":"2024-04-18T21:10:26.243242+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:26.243242+0000","last_undegraded":"2024-04-18T21:10:26.243242+0000","last_fullsized":"2024-04-18T21:10:26.243242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:39.920762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924299+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:25.924299+0000","last_peered":"2024-04-18T21:10:25.924299+0000","last_clean":"2024-04-18T21:10:25.924299+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:25.924299+0000","last_undegraded":"2024-04-18T21:10:25.924299+0000","last_fullsized":"2024-04-18T21:10:25.924299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":551,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244103+0000","last_change":"2024-04-18T21:10:26.244103+0000","last_active":"2024-04-18T21:10:26.244103+0000","last_peered":"2024-04-18T21:10:26.244103+0000","last_clean":"2024-04-18T21:10:26.244103+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:10:26.244103+0000","last_undegraded":"2024-04-18T21:10:26.244103+0000","last_fullsized":"2024-04-18T21:10:26.244103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:07.731233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.220897+0000","last_change":"2024-04-18T21:10:26.220897+0000","last_active":"2024-04-18T21:10:26.220897+0000","last_peered":"2024-04-18T21:10:26.220897+0000","last_clean":"2024-04-18T21:10:26.220897+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:26.220897+0000","last_undegraded":"2024-04-18T21:10:26.220897+0000","last_fullsized":"2024-04-18T21:10:26.220897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:54:32.599595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":530,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246695+0000","last_change":"2024-04-18T21:10:26.246695+0000","last_active":"2024-04-18T21:10:26.246695+0000","last_peered":"2024-04-18T21:10:26.246695+0000","last_clean":"2024-04-18T21:10:26.246695+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:26.246695+0000","last_undegraded":"2024-04-18T21:10:26.246695+0000","last_fullsized":"2024-04-18T21:10:26.246695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:16.203297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":661,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928706+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:25.928706+0000","last_peered":"2024-04-18T21:10:25.928706+0000","last_clean":"2024-04-18T21:10:25.928706+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:25.928706+0000","last_undegraded":"2024-04-18T21:10:25.928706+0000","last_fullsized":"2024-04-18T21:10:25.928706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925351+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:25.925351+0000","last_peered":"2024-04-18T21:10:25.925351+0000","last_clean":"2024-04-18T21:10:25.925351+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:25.925351+0000","last_undegraded":"2024-04-18T21:10:25.925351+0000","last_fullsized":"2024-04-18T21:10:25.925351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":523,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246170+0000","last_change":"2024-04-18T21:10:26.246170+0000","last_active":"2024-04-18T21:10:26.246170+0000","last_peered":"2024-04-18T21:10:26.246170+0000","last_clean":"2024-04-18T21:10:26.246170+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:26.246170+0000","last_undegraded":"2024-04-18T21:10:26.246170+0000","last_fullsized":"2024-04-18T21:10:26.246170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:15:25.555562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924042+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:25.924042+0000","last_peered":"2024-04-18T21:10:25.924042+0000","last_clean":"2024-04-18T21:10:25.924042+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:25.924042+0000","last_undegraded":"2024-04-18T21:10:25.924042+0000","last_fullsized":"2024-04-18T21:10:25.924042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924001+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:25.924001+0000","last_peered":"2024-04-18T21:10:25.924001+0000","last_clean":"2024-04-18T21:10:25.924001+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:25.924001+0000","last_undegraded":"2024-04-18T21:10:25.924001+0000","last_fullsized":"2024-04-18T21:10:25.924001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245509+0000","last_change":"2024-04-18T21:10:26.245509+0000","last_active":"2024-04-18T21:10:26.245509+0000","last_peered":"2024-04-18T21:10:26.245509+0000","last_clean":"2024-04-18T21:10:26.245509+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:26.245509+0000","last_undegraded":"2024-04-18T21:10:26.245509+0000","last_fullsized":"2024-04-18T21:10:26.245509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:39:57.418653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":653,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217549+0000","last_change":"2024-04-18T21:10:26.217549+0000","last_active":"2024-04-18T21:10:26.217549+0000","last_peered":"2024-04-18T21:10:26.217549+0000","last_clean":"2024-04-18T21:10:26.217549+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:26.217549+0000","last_undegraded":"2024-04-18T21:10:26.217549+0000","last_fullsized":"2024-04-18T21:10:26.217549+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:56.883654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247208+0000","last_change":"2024-04-18T21:10:26.247208+0000","last_active":"2024-04-18T21:10:26.247208+0000","last_peered":"2024-04-18T21:10:26.247208+0000","last_clean":"2024-04-18T21:10:26.247208+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:10:26.247208+0000","last_undegraded":"2024-04-18T21:10:26.247208+0000","last_fullsized":"2024-04-18T21:10:26.247208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:41:32.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":591,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929959+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:25.929959+0000","last_peered":"2024-04-18T21:10:25.929959+0000","last_clean":"2024-04-18T21:10:25.929959+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:25.929959+0000","last_undegraded":"2024-04-18T21:10:25.929959+0000","last_fullsized":"2024-04-18T21:10:25.929959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925499+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:25.925499+0000","last_peered":"2024-04-18T21:10:25.925499+0000","last_clean":"2024-04-18T21:10:25.925499+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:25.925499+0000","last_undegraded":"2024-04-18T21:10:25.925499+0000","last_fullsized":"2024-04-18T21:10:25.925499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928008+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:25.928008+0000","last_peered":"2024-04-18T21:10:25.928008+0000","last_clean":"2024-04-18T21:10:25.928008+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:25.928008+0000","last_undegraded":"2024-04-18T21:10:25.928008+0000","last_fullsized":"2024-04-18T21:10:25.928008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":587,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.236946+0000","last_change":"2024-04-18T21:10:26.236946+0000","last_active":"2024-04-18T21:10:26.236946+0000","last_peered":"2024-04-18T21:10:26.236946+0000","last_clean":"2024-04-18T21:10:26.236946+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:26.236946+0000","last_undegraded":"2024-04-18T21:10:26.236946+0000","last_fullsized":"2024-04-18T21:10:26.236946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:02.167729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":534,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240953+0000","last_change":"2024-04-18T21:10:26.240953+0000","last_active":"2024-04-18T21:10:26.240953+0000","last_peered":"2024-04-18T21:10:26.240953+0000","last_clean":"2024-04-18T21:10:26.240953+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:26.240953+0000","last_undegraded":"2024-04-18T21:10:26.240953+0000","last_fullsized":"2024-04-18T21:10:26.240953+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:34.504144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923664+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:25.923664+0000","last_peered":"2024-04-18T21:10:25.923664+0000","last_clean":"2024-04-18T21:10:25.923664+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:25.923664+0000","last_undegraded":"2024-04-18T21:10:25.923664+0000","last_fullsized":"2024-04-18T21:10:25.923664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927370+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:25.927370+0000","last_peered":"2024-04-18T21:10:25.927370+0000","last_clean":"2024-04-18T21:10:25.927370+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:25.927370+0000","last_undegraded":"2024-04-18T21:10:25.927370+0000","last_fullsized":"2024-04-18T21:10:25.927370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923000+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:25.923000+0000","last_peered":"2024-04-18T21:10:25.923000+0000","last_clean":"2024-04-18T21:10:25.923000+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:25.923000+0000","last_undegraded":"2024-04-18T21:10:25.923000+0000","last_fullsized":"2024-04-18T21:10:25.923000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925602+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:25.925602+0000","last_peered":"2024-04-18T21:10:25.925602+0000","last_clean":"2024-04-18T21:10:25.925602+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:25.925602+0000","last_undegraded":"2024-04-18T21:10:25.925602+0000","last_fullsized":"2024-04-18T21:10:25.925602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":742,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928662+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:25.928662+0000","last_peered":"2024-04-18T21:10:25.928662+0000","last_clean":"2024-04-18T21:10:25.928662+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:25.928662+0000","last_undegraded":"2024-04-18T21:10:25.928662+0000","last_fullsized":"2024-04-18T21:10:25.928662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":590,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249191+0000","last_change":"2024-04-18T21:10:26.249191+0000","last_active":"2024-04-18T21:10:26.249191+0000","last_peered":"2024-04-18T21:10:26.249191+0000","last_clean":"2024-04-18T21:10:26.249191+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:10:26.249191+0000","last_undegraded":"2024-04-18T21:10:26.249191+0000","last_fullsized":"2024-04-18T21:10:26.249191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:51.151882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925210+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:25.925210+0000","last_peered":"2024-04-18T21:10:25.925210+0000","last_clean":"2024-04-18T21:10:25.925210+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:25.925210+0000","last_undegraded":"2024-04-18T21:10:25.925210+0000","last_fullsized":"2024-04-18T21:10:25.925210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929537+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:25.929537+0000","last_peered":"2024-04-18T21:10:25.929537+0000","last_clean":"2024-04-18T21:10:25.929537+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:25.929537+0000","last_undegraded":"2024-04-18T21:10:25.929537+0000","last_fullsized":"2024-04-18T21:10:25.929537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":693,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924601+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:25.924601+0000","last_peered":"2024-04-18T21:10:25.924601+0000","last_clean":"2024-04-18T21:10:25.924601+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:25.924601+0000","last_undegraded":"2024-04-18T21:10:25.924601+0000","last_fullsized":"2024-04-18T21:10:25.924601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":663,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927670+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:25.927670+0000","last_peered":"2024-04-18T21:10:25.927670+0000","last_clean":"2024-04-18T21:10:25.927670+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:25.927670+0000","last_undegraded":"2024-04-18T21:10:25.927670+0000","last_fullsized":"2024-04-18T21:10:25.927670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":607,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246845+0000","last_change":"2024-04-18T21:10:26.246845+0000","last_active":"2024-04-18T21:10:26.246845+0000","last_peered":"2024-04-18T21:10:26.246845+0000","last_clean":"2024-04-18T21:10:26.246845+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:10:26.246845+0000","last_undegraded":"2024-04-18T21:10:26.246845+0000","last_fullsized":"2024-04-18T21:10:26.246845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:22:45.054487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924405+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:25.924405+0000","last_peered":"2024-04-18T21:10:25.924405+0000","last_clean":"2024-04-18T21:10:25.924405+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:25.924405+0000","last_undegraded":"2024-04-18T21:10:25.924405+0000","last_fullsized":"2024-04-18T21:10:25.924405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":628,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.210475+0000","last_change":"2024-04-18T21:10:26.210475+0000","last_active":"2024-04-18T21:10:26.210475+0000","last_peered":"2024-04-18T21:10:26.210475+0000","last_clean":"2024-04-18T21:10:26.210475+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:10:26.210475+0000","last_undegraded":"2024-04-18T21:10:26.210475+0000","last_fullsized":"2024-04-18T21:10:26.210475+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:55.667421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":585,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925203+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:25.925203+0000","last_peered":"2024-04-18T21:10:25.925203+0000","last_clean":"2024-04-18T21:10:25.925203+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:25.925203+0000","last_undegraded":"2024-04-18T21:10:25.925203+0000","last_fullsized":"2024-04-18T21:10:25.925203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":218,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929804+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:25.929804+0000","last_peered":"2024-04-18T21:10:25.929804+0000","last_clean":"2024-04-18T21:10:25.929804+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:25.929804+0000","last_undegraded":"2024-04-18T21:10:25.929804+0000","last_fullsized":"2024-04-18T21:10:25.929804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":622,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929193+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:25.929193+0000","last_peered":"2024-04-18T21:10:25.929193+0000","last_clean":"2024-04-18T21:10:25.929193+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:25.929193+0000","last_undegraded":"2024-04-18T21:10:25.929193+0000","last_fullsized":"2024-04-18T21:10:25.929193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923744+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:25.923744+0000","last_peered":"2024-04-18T21:10:25.923744+0000","last_clean":"2024-04-18T21:10:25.923744+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:25.923744+0000","last_undegraded":"2024-04-18T21:10:25.923744+0000","last_fullsized":"2024-04-18T21:10:25.923744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929063+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:25.929063+0000","last_peered":"2024-04-18T21:10:25.929063+0000","last_clean":"2024-04-18T21:10:25.929063+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:25.929063+0000","last_undegraded":"2024-04-18T21:10:25.929063+0000","last_fullsized":"2024-04-18T21:10:25.929063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247708+0000","last_change":"2024-04-18T21:10:26.247708+0000","last_active":"2024-04-18T21:10:26.247708+0000","last_peered":"2024-04-18T21:10:26.247708+0000","last_clean":"2024-04-18T21:10:26.247708+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:10:26.247708+0000","last_undegraded":"2024-04-18T21:10:26.247708+0000","last_fullsized":"2024-04-18T21:10:26.247708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:33.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.215608+0000","last_change":"2024-04-18T21:10:26.215608+0000","last_active":"2024-04-18T21:10:26.215608+0000","last_peered":"2024-04-18T21:10:26.215608+0000","last_clean":"2024-04-18T21:10:26.215608+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:26.215608+0000","last_undegraded":"2024-04-18T21:10:26.215608+0000","last_fullsized":"2024-04-18T21:10:26.215608+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:08.549962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":606,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923281+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:25.923281+0000","last_peered":"2024-04-18T21:10:25.923281+0000","last_clean":"2024-04-18T21:10:25.923281+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:25.923281+0000","last_undegraded":"2024-04-18T21:10:25.923281+0000","last_fullsized":"2024-04-18T21:10:25.923281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":449,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925960+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:25.925960+0000","last_peered":"2024-04-18T21:10:25.925960+0000","last_clean":"2024-04-18T21:10:25.925960+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:25.925960+0000","last_undegraded":"2024-04-18T21:10:25.925960+0000","last_fullsized":"2024-04-18T21:10:25.925960+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":646,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923351+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:25.923351+0000","last_peered":"2024-04-18T21:10:25.923351+0000","last_clean":"2024-04-18T21:10:25.923351+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:25.923351+0000","last_undegraded":"2024-04-18T21:10:25.923351+0000","last_fullsized":"2024-04-18T21:10:25.923351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241764+0000","last_change":"2024-04-18T21:10:26.241764+0000","last_active":"2024-04-18T21:10:26.241764+0000","last_peered":"2024-04-18T21:10:26.241764+0000","last_clean":"2024-04-18T21:10:26.241764+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:26.241764+0000","last_undegraded":"2024-04-18T21:10:26.241764+0000","last_fullsized":"2024-04-18T21:10:26.241764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:23.849579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":699,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244945+0000","last_change":"2024-04-18T21:10:26.244945+0000","last_active":"2024-04-18T21:10:26.244945+0000","last_peered":"2024-04-18T21:10:26.244945+0000","last_clean":"2024-04-18T21:10:26.244945+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:26.244945+0000","last_undegraded":"2024-04-18T21:10:26.244945+0000","last_fullsized":"2024-04-18T21:10:26.244945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:55:28.759810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232672+0000","last_change":"2024-04-18T21:10:26.232672+0000","last_active":"2024-04-18T21:10:26.232672+0000","last_peered":"2024-04-18T21:10:26.232672+0000","last_clean":"2024-04-18T21:10:26.232672+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:26.232672+0000","last_undegraded":"2024-04-18T21:10:26.232672+0000","last_fullsized":"2024-04-18T21:10:26.232672+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:05.720217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":700,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929763+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:25.929763+0000","last_peered":"2024-04-18T21:10:25.929763+0000","last_clean":"2024-04-18T21:10:25.929763+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:25.929763+0000","last_undegraded":"2024-04-18T21:10:25.929763+0000","last_fullsized":"2024-04-18T21:10:25.929763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":336,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930053+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:25.930053+0000","last_peered":"2024-04-18T21:10:25.930053+0000","last_clean":"2024-04-18T21:10:25.930053+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:25.930053+0000","last_undegraded":"2024-04-18T21:10:25.930053+0000","last_fullsized":"2024-04-18T21:10:25.930053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":625,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243532+0000","last_change":"2024-04-18T21:10:26.243532+0000","last_active":"2024-04-18T21:10:26.243532+0000","last_peered":"2024-04-18T21:10:26.243532+0000","last_clean":"2024-04-18T21:10:26.243532+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:26.243532+0000","last_undegraded":"2024-04-18T21:10:26.243532+0000","last_fullsized":"2024-04-18T21:10:26.243532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:33.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.242580+0000","last_change":"2024-04-18T21:10:26.242580+0000","last_active":"2024-04-18T21:10:26.242580+0000","last_peered":"2024-04-18T21:10:26.242580+0000","last_clean":"2024-04-18T21:10:26.242580+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:26.242580+0000","last_undegraded":"2024-04-18T21:10:26.242580+0000","last_fullsized":"2024-04-18T21:10:26.242580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:09.305905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244330+0000","last_change":"2024-04-18T21:10:26.244330+0000","last_active":"2024-04-18T21:10:26.244330+0000","last_peered":"2024-04-18T21:10:26.244330+0000","last_clean":"2024-04-18T21:10:26.244330+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:26.244330+0000","last_undegraded":"2024-04-18T21:10:26.244330+0000","last_fullsized":"2024-04-18T21:10:26.244330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:35.084780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924020+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:25.924020+0000","last_peered":"2024-04-18T21:10:25.924020+0000","last_clean":"2024-04-18T21:10:25.924020+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:25.924020+0000","last_undegraded":"2024-04-18T21:10:25.924020+0000","last_fullsized":"2024-04-18T21:10:25.924020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":524,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217877+0000","last_change":"2024-04-18T21:10:26.217877+0000","last_active":"2024-04-18T21:10:26.217877+0000","last_peered":"2024-04-18T21:10:26.217877+0000","last_clean":"2024-04-18T21:10:26.217877+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:26.217877+0000","last_undegraded":"2024-04-18T21:10:26.217877+0000","last_fullsized":"2024-04-18T21:10:26.217877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:04:08.598032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":556,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923265+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:25.923265+0000","last_peered":"2024-04-18T21:10:25.923265+0000","last_clean":"2024-04-18T21:10:25.923265+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:25.923265+0000","last_undegraded":"2024-04-18T21:10:25.923265+0000","last_fullsized":"2024-04-18T21:10:25.923265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":674,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929415+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:25.929415+0000","last_peered":"2024-04-18T21:10:25.929415+0000","last_clean":"2024-04-18T21:10:25.929415+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:25.929415+0000","last_undegraded":"2024-04-18T21:10:25.929415+0000","last_fullsized":"2024-04-18T21:10:25.929415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":326,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.200244+0000","last_change":"2024-04-18T21:10:26.200244+0000","last_active":"2024-04-18T21:10:26.200244+0000","last_peered":"2024-04-18T21:10:26.200244+0000","last_clean":"2024-04-18T21:10:26.200244+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:10:26.200244+0000","last_undegraded":"2024-04-18T21:10:26.200244+0000","last_fullsized":"2024-04-18T21:10:26.200244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:44.128206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.206570+0000","last_change":"2024-04-18T21:10:26.206570+0000","last_active":"2024-04-18T21:10:26.206570+0000","last_peered":"2024-04-18T21:10:26.206570+0000","last_clean":"2024-04-18T21:10:26.206570+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:10:26.206570+0000","last_undegraded":"2024-04-18T21:10:26.206570+0000","last_fullsized":"2024-04-18T21:10:26.206570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:30.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":504,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930412+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:25.930412+0000","last_peered":"2024-04-18T21:10:25.930412+0000","last_clean":"2024-04-18T21:10:25.930412+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:25.930412+0000","last_undegraded":"2024-04-18T21:10:25.930412+0000","last_fullsized":"2024-04-18T21:10:25.930412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245477+0000","last_change":"2024-04-18T21:10:26.245477+0000","last_active":"2024-04-18T21:10:26.245477+0000","last_peered":"2024-04-18T21:10:26.245477+0000","last_clean":"2024-04-18T21:10:26.245477+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:26.245477+0000","last_undegraded":"2024-04-18T21:10:26.245477+0000","last_fullsized":"2024-04-18T21:10:26.245477+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:49:33.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248163+0000","last_change":"2024-04-18T21:10:26.248163+0000","last_active":"2024-04-18T21:10:26.248163+0000","last_peered":"2024-04-18T21:10:26.248163+0000","last_clean":"2024-04-18T21:10:26.248163+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:10:26.248163+0000","last_undegraded":"2024-04-18T21:10:26.248163+0000","last_fullsized":"2024-04-18T21:10:26.248163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:13.436655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":353,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928209+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:25.928209+0000","last_peered":"2024-04-18T21:10:25.928209+0000","last_clean":"2024-04-18T21:10:25.928209+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:25.928209+0000","last_undegraded":"2024-04-18T21:10:25.928209+0000","last_fullsized":"2024-04-18T21:10:25.928209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":706,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925849+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:25.925849+0000","last_peered":"2024-04-18T21:10:25.925849+0000","last_clean":"2024-04-18T21:10:25.925849+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:25.925849+0000","last_undegraded":"2024-04-18T21:10:25.925849+0000","last_fullsized":"2024-04-18T21:10:25.925849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928973+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:25.928973+0000","last_peered":"2024-04-18T21:10:25.928973+0000","last_clean":"2024-04-18T21:10:25.928973+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:25.928973+0000","last_undegraded":"2024-04-18T21:10:25.928973+0000","last_fullsized":"2024-04-18T21:10:25.928973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":451,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923612+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:25.923612+0000","last_peered":"2024-04-18T21:10:25.923612+0000","last_clean":"2024-04-18T21:10:25.923612+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:25.923612+0000","last_undegraded":"2024-04-18T21:10:25.923612+0000","last_fullsized":"2024-04-18T21:10:25.923612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924329+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:25.924329+0000","last_peered":"2024-04-18T21:10:25.924329+0000","last_clean":"2024-04-18T21:10:25.924329+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:25.924329+0000","last_undegraded":"2024-04-18T21:10:25.924329+0000","last_fullsized":"2024-04-18T21:10:25.924329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.227561+0000","last_change":"2024-04-18T21:10:26.227561+0000","last_active":"2024-04-18T21:10:26.227561+0000","last_peered":"2024-04-18T21:10:26.227561+0000","last_clean":"2024-04-18T21:10:26.227561+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:26.227561+0000","last_undegraded":"2024-04-18T21:10:26.227561+0000","last_fullsized":"2024-04-18T21:10:26.227561+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:48.634607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211170+0000","last_change":"2024-04-18T21:10:26.211170+0000","last_active":"2024-04-18T21:10:26.211170+0000","last_peered":"2024-04-18T21:10:26.211170+0000","last_clean":"2024-04-18T21:10:26.211170+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:10:26.211170+0000","last_undegraded":"2024-04-18T21:10:26.211170+0000","last_fullsized":"2024-04-18T21:10:26.211170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:52.690052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928343+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:25.928343+0000","last_peered":"2024-04-18T21:10:25.928343+0000","last_clean":"2024-04-18T21:10:25.928343+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:25.928343+0000","last_undegraded":"2024-04-18T21:10:25.928343+0000","last_fullsized":"2024-04-18T21:10:25.928343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":293,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240855+0000","last_change":"2024-04-18T21:10:26.240855+0000","last_active":"2024-04-18T21:10:26.240855+0000","last_peered":"2024-04-18T21:10:26.240855+0000","last_clean":"2024-04-18T21:10:26.240855+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:26.240855+0000","last_undegraded":"2024-04-18T21:10:26.240855+0000","last_fullsized":"2024-04-18T21:10:26.240855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.992598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928666+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:25.928666+0000","last_peered":"2024-04-18T21:10:25.928666+0000","last_clean":"2024-04-18T21:10:25.928666+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:25.928666+0000","last_undegraded":"2024-04-18T21:10:25.928666+0000","last_fullsized":"2024-04-18T21:10:25.928666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924591+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:25.924591+0000","last_peered":"2024-04-18T21:10:25.924591+0000","last_clean":"2024-04-18T21:10:25.924591+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:25.924591+0000","last_undegraded":"2024-04-18T21:10:25.924591+0000","last_fullsized":"2024-04-18T21:10:25.924591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928454+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:25.928454+0000","last_peered":"2024-04-18T21:10:25.928454+0000","last_clean":"2024-04-18T21:10:25.928454+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:25.928454+0000","last_undegraded":"2024-04-18T21:10:25.928454+0000","last_fullsized":"2024-04-18T21:10:25.928454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926476+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:25.926476+0000","last_peered":"2024-04-18T21:10:25.926476+0000","last_clean":"2024-04-18T21:10:25.926476+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:25.926476+0000","last_undegraded":"2024-04-18T21:10:25.926476+0000","last_fullsized":"2024-04-18T21:10:25.926476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":589,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926856+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:25.926856+0000","last_peered":"2024-04-18T21:10:25.926856+0000","last_clean":"2024-04-18T21:10:25.926856+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:25.926856+0000","last_undegraded":"2024-04-18T21:10:25.926856+0000","last_fullsized":"2024-04-18T21:10:25.926856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930233+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:25.930233+0000","last_peered":"2024-04-18T21:10:25.930233+0000","last_clean":"2024-04-18T21:10:25.930233+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:25.930233+0000","last_undegraded":"2024-04-18T21:10:25.930233+0000","last_fullsized":"2024-04-18T21:10:25.930233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929500+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:25.929500+0000","last_peered":"2024-04-18T21:10:25.929500+0000","last_clean":"2024-04-18T21:10:25.929500+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:25.929500+0000","last_undegraded":"2024-04-18T21:10:25.929500+0000","last_fullsized":"2024-04-18T21:10:25.929500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":561,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928548+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:25.928548+0000","last_peered":"2024-04-18T21:10:25.928548+0000","last_clean":"2024-04-18T21:10:25.928548+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:25.928548+0000","last_undegraded":"2024-04-18T21:10:25.928548+0000","last_fullsized":"2024-04-18T21:10:25.928548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":241,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929493+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:25.929493+0000","last_peered":"2024-04-18T21:10:25.929493+0000","last_clean":"2024-04-18T21:10:25.929493+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:25.929493+0000","last_undegraded":"2024-04-18T21:10:25.929493+0000","last_fullsized":"2024-04-18T21:10:25.929493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.214755+0000","last_change":"2024-04-18T21:10:26.214755+0000","last_active":"2024-04-18T21:10:26.214755+0000","last_peered":"2024-04-18T21:10:26.214755+0000","last_clean":"2024-04-18T21:10:26.214755+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:10:26.214755+0000","last_undegraded":"2024-04-18T21:10:26.214755+0000","last_fullsized":"2024-04-18T21:10:26.214755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:19:13.072569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":616,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923453+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:25.923453+0000","last_peered":"2024-04-18T21:10:25.923453+0000","last_clean":"2024-04-18T21:10:25.923453+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:25.923453+0000","last_undegraded":"2024-04-18T21:10:25.923453+0000","last_fullsized":"2024-04-18T21:10:25.923453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":633,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241410+0000","last_change":"2024-04-18T21:10:26.241410+0000","last_active":"2024-04-18T21:10:26.241410+0000","last_peered":"2024-04-18T21:10:26.241410+0000","last_clean":"2024-04-18T21:10:26.241410+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:26.241410+0000","last_undegraded":"2024-04-18T21:10:26.241410+0000","last_fullsized":"2024-04-18T21:10:26.241410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:30.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":394,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.212269+0000","last_change":"2024-04-18T21:10:26.212269+0000","last_active":"2024-04-18T21:10:26.212269+0000","last_peered":"2024-04-18T21:10:26.212269+0000","last_clean":"2024-04-18T21:10:26.212269+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:10:26.212269+0000","last_undegraded":"2024-04-18T21:10:26.212269+0000","last_fullsized":"2024-04-18T21:10:26.212269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:48.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":569,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929263+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:25.929263+0000","last_peered":"2024-04-18T21:10:25.929263+0000","last_clean":"2024-04-18T21:10:25.929263+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:25.929263+0000","last_undegraded":"2024-04-18T21:10:25.929263+0000","last_fullsized":"2024-04-18T21:10:25.929263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":242,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926053+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:25.926053+0000","last_peered":"2024-04-18T21:10:25.926053+0000","last_clean":"2024-04-18T21:10:25.926053+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:25.926053+0000","last_undegraded":"2024-04-18T21:10:25.926053+0000","last_fullsized":"2024-04-18T21:10:25.926053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":266,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.205389+0000","last_change":"2024-04-18T21:10:26.205389+0000","last_active":"2024-04-18T21:10:26.205389+0000","last_peered":"2024-04-18T21:10:26.205389+0000","last_clean":"2024-04-18T21:10:26.205389+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:10:26.205389+0000","last_undegraded":"2024-04-18T21:10:26.205389+0000","last_fullsized":"2024-04-18T21:10:26.205389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:13.325246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":668,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927796+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:25.927796+0000","last_peered":"2024-04-18T21:10:25.927796+0000","last_clean":"2024-04-18T21:10:25.927796+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:25.927796+0000","last_undegraded":"2024-04-18T21:10:25.927796+0000","last_fullsized":"2024-04-18T21:10:25.927796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":228,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929949+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:25.929949+0000","last_peered":"2024-04-18T21:10:25.929949+0000","last_clean":"2024-04-18T21:10:25.929949+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:25.929949+0000","last_undegraded":"2024-04-18T21:10:25.929949+0000","last_fullsized":"2024-04-18T21:10:25.929949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":620,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928270+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:25.928270+0000","last_peered":"2024-04-18T21:10:25.928270+0000","last_clean":"2024-04-18T21:10:25.928270+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:25.928270+0000","last_undegraded":"2024-04-18T21:10:25.928270+0000","last_fullsized":"2024-04-18T21:10:25.928270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925894+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:25.925894+0000","last_peered":"2024-04-18T21:10:25.925894+0000","last_clean":"2024-04-18T21:10:25.925894+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:25.925894+0000","last_undegraded":"2024-04-18T21:10:25.925894+0000","last_fullsized":"2024-04-18T21:10:25.925894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":774,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929075+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:25.929075+0000","last_peered":"2024-04-18T21:10:25.929075+0000","last_clean":"2024-04-18T21:10:25.929075+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:25.929075+0000","last_undegraded":"2024-04-18T21:10:25.929075+0000","last_fullsized":"2024-04-18T21:10:25.929075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928898+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:25.928898+0000","last_peered":"2024-04-18T21:10:25.928898+0000","last_clean":"2024-04-18T21:10:25.928898+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:25.928898+0000","last_undegraded":"2024-04-18T21:10:25.928898+0000","last_fullsized":"2024-04-18T21:10:25.928898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":371,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928125+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:25.928125+0000","last_peered":"2024-04-18T21:10:25.928125+0000","last_clean":"2024-04-18T21:10:25.928125+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:25.928125+0000","last_undegraded":"2024-04-18T21:10:25.928125+0000","last_fullsized":"2024-04-18T21:10:25.928125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925068+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:25.925068+0000","last_peered":"2024-04-18T21:10:25.925068+0000","last_clean":"2024-04-18T21:10:25.925068+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:25.925068+0000","last_undegraded":"2024-04-18T21:10:25.925068+0000","last_fullsized":"2024-04-18T21:10:25.925068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":292,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924947+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:25.924947+0000","last_peered":"2024-04-18T21:10:25.924947+0000","last_clean":"2024-04-18T21:10:25.924947+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:25.924947+0000","last_undegraded":"2024-04-18T21:10:25.924947+0000","last_fullsized":"2024-04-18T21:10:25.924947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":563,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924552+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:25.924552+0000","last_peered":"2024-04-18T21:10:25.924552+0000","last_clean":"2024-04-18T21:10:25.924552+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:25.924552+0000","last_undegraded":"2024-04-18T21:10:25.924552+0000","last_fullsized":"2024-04-18T21:10:25.924552+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924602+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:25.924602+0000","last_peered":"2024-04-18T21:10:25.924602+0000","last_clean":"2024-04-18T21:10:25.924602+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:25.924602+0000","last_undegraded":"2024-04-18T21:10:25.924602+0000","last_fullsized":"2024-04-18T21:10:25.924602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232566+0000","last_change":"2024-04-18T21:10:26.232566+0000","last_active":"2024-04-18T21:10:26.232566+0000","last_peered":"2024-04-18T21:10:26.232566+0000","last_clean":"2024-04-18T21:10:26.232566+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:26.232566+0000","last_undegraded":"2024-04-18T21:10:26.232566+0000","last_fullsized":"2024-04-18T21:10:26.232566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:07.336018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":252,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211599+0000","last_change":"2024-04-18T21:10:26.211599+0000","last_active":"2024-04-18T21:10:26.211599+0000","last_peered":"2024-04-18T21:10:26.211599+0000","last_clean":"2024-04-18T21:10:26.211599+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:10:26.211599+0000","last_undegraded":"2024-04-18T21:10:26.211599+0000","last_fullsized":"2024-04-18T21:10:26.211599+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:05:13.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243246+0000","last_change":"2024-04-18T21:10:26.243246+0000","last_active":"2024-04-18T21:10:26.243246+0000","last_peered":"2024-04-18T21:10:26.243246+0000","last_clean":"2024-04-18T21:10:26.243246+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:26.243246+0000","last_undegraded":"2024-04-18T21:10:26.243246+0000","last_fullsized":"2024-04-18T21:10:26.243246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:27.471789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925518+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:25.925518+0000","last_peered":"2024-04-18T21:10:25.925518+0000","last_clean":"2024-04-18T21:10:25.925518+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:25.925518+0000","last_undegraded":"2024-04-18T21:10:25.925518+0000","last_fullsized":"2024-04-18T21:10:25.925518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924334+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:25.924334+0000","last_peered":"2024-04-18T21:10:25.924334+0000","last_clean":"2024-04-18T21:10:25.924334+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:25.924334+0000","last_undegraded":"2024-04-18T21:10:25.924334+0000","last_fullsized":"2024-04-18T21:10:25.924334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":330,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928940+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:25.928940+0000","last_peered":"2024-04-18T21:10:25.928940+0000","last_clean":"2024-04-18T21:10:25.928940+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:25.928940+0000","last_undegraded":"2024-04-18T21:10:25.928940+0000","last_fullsized":"2024-04-18T21:10:25.928940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247398+0000","last_change":"2024-04-18T21:10:26.247398+0000","last_active":"2024-04-18T21:10:26.247398+0000","last_peered":"2024-04-18T21:10:26.247398+0000","last_clean":"2024-04-18T21:10:26.247398+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:10:26.247398+0000","last_undegraded":"2024-04-18T21:10:26.247398+0000","last_fullsized":"2024-04-18T21:10:26.247398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:43.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":224,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929751+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:25.929751+0000","last_peered":"2024-04-18T21:10:25.929751+0000","last_clean":"2024-04-18T21:10:25.929751+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:25.929751+0000","last_undegraded":"2024-04-18T21:10:25.929751+0000","last_fullsized":"2024-04-18T21:10:25.929751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738440,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103552,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268288,"statfs":{"total":96636764160,"available":96530726912,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350981,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58540,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313300,"statfs":{"total":96636764160,"available":96576819200,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:34.850 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-18T21:10:34.850 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-18T21:10:35.206 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-18T21:10:35.218 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T21:10:35.218 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:35.529 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:35.531 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:35.548 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-18T21:10:33.737097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265756,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849764,"statfs":{"total":289910292480,"available":289638158336,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.819350"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925304+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:25.925304+0000","last_peered":"2024-04-18T21:10:25.925304+0000","last_clean":"2024-04-18T21:10:25.925304+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:25.925304+0000","last_undegraded":"2024-04-18T21:10:25.925304+0000","last_fullsized":"2024-04-18T21:10:25.925304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925041+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:25.925041+0000","last_peered":"2024-04-18T21:10:25.925041+0000","last_clean":"2024-04-18T21:10:25.925041+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:25.925041+0000","last_undegraded":"2024-04-18T21:10:25.925041+0000","last_fullsized":"2024-04-18T21:10:25.925041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249269+0000","last_change":"2024-04-18T21:10:26.249269+0000","last_active":"2024-04-18T21:10:26.249269+0000","last_peered":"2024-04-18T21:10:26.249269+0000","last_clean":"2024-04-18T21:10:26.249269+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:10:26.249269+0000","last_undegraded":"2024-04-18T21:10:26.249269+0000","last_fullsized":"2024-04-18T21:10:26.249269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:15.741614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243242+0000","last_change":"2024-04-18T21:10:26.243242+0000","last_active":"2024-04-18T21:10:26.243242+0000","last_peered":"2024-04-18T21:10:26.243242+0000","last_clean":"2024-04-18T21:10:26.243242+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:26.243242+0000","last_undegraded":"2024-04-18T21:10:26.243242+0000","last_fullsized":"2024-04-18T21:10:26.243242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:39.920762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924299+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:25.924299+0000","last_peered":"2024-04-18T21:10:25.924299+0000","last_clean":"2024-04-18T21:10:25.924299+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:25.924299+0000","last_undegraded":"2024-04-18T21:10:25.924299+0000","last_fullsized":"2024-04-18T21:10:25.924299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":551,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244103+0000","last_change":"2024-04-18T21:10:26.244103+0000","last_active":"2024-04-18T21:10:26.244103+0000","last_peered":"2024-04-18T21:10:26.244103+0000","last_clean":"2024-04-18T21:10:26.244103+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:10:26.244103+0000","last_undegraded":"2024-04-18T21:10:26.244103+0000","last_fullsized":"2024-04-18T21:10:26.244103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:07.731233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.220897+0000","last_change":"2024-04-18T21:10:26.220897+0000","last_active":"2024-04-18T21:10:26.220897+0000","last_peered":"2024-04-18T21:10:26.220897+0000","last_clean":"2024-04-18T21:10:26.220897+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:26.220897+0000","last_undegraded":"2024-04-18T21:10:26.220897+0000","last_fullsized":"2024-04-18T21:10:26.220897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:54:32.599595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":530,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246695+0000","last_change":"2024-04-18T21:10:26.246695+0000","last_active":"2024-04-18T21:10:26.246695+0000","last_peered":"2024-04-18T21:10:26.246695+0000","last_clean":"2024-04-18T21:10:26.246695+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:26.246695+0000","last_undegraded":"2024-04-18T21:10:26.246695+0000","last_fullsized":"2024-04-18T21:10:26.246695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:16.203297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":661,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928706+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:25.928706+0000","last_peered":"2024-04-18T21:10:25.928706+0000","last_clean":"2024-04-18T21:10:25.928706+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:25.928706+0000","last_undegraded":"2024-04-18T21:10:25.928706+0000","last_fullsized":"2024-04-18T21:10:25.928706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925351+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:25.925351+0000","last_peered":"2024-04-18T21:10:25.925351+0000","last_clean":"2024-04-18T21:10:25.925351+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:25.925351+0000","last_undegraded":"2024-04-18T21:10:25.925351+0000","last_fullsized":"2024-04-18T21:10:25.925351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":523,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246170+0000","last_change":"2024-04-18T21:10:26.246170+0000","last_active":"2024-04-18T21:10:26.246170+0000","last_peered":"2024-04-18T21:10:26.246170+0000","last_clean":"2024-04-18T21:10:26.246170+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:26.246170+0000","last_undegraded":"2024-04-18T21:10:26.246170+0000","last_fullsized":"2024-04-18T21:10:26.246170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:15:25.555562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924042+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:25.924042+0000","last_peered":"2024-04-18T21:10:25.924042+0000","last_clean":"2024-04-18T21:10:25.924042+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:25.924042+0000","last_undegraded":"2024-04-18T21:10:25.924042+0000","last_fullsized":"2024-04-18T21:10:25.924042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924001+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:25.924001+0000","last_peered":"2024-04-18T21:10:25.924001+0000","last_clean":"2024-04-18T21:10:25.924001+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:25.924001+0000","last_undegraded":"2024-04-18T21:10:25.924001+0000","last_fullsized":"2024-04-18T21:10:25.924001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245509+0000","last_change":"2024-04-18T21:10:26.245509+0000","last_active":"2024-04-18T21:10:26.245509+0000","last_peered":"2024-04-18T21:10:26.245509+0000","last_clean":"2024-04-18T21:10:26.245509+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:26.245509+0000","last_undegraded":"2024-04-18T21:10:26.245509+0000","last_fullsized":"2024-04-18T21:10:26.245509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:39:57.418653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":653,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217549+0000","last_change":"2024-04-18T21:10:26.217549+0000","last_active":"2024-04-18T21:10:26.217549+0000","last_peered":"2024-04-18T21:10:26.217549+0000","last_clean":"2024-04-18T21:10:26.217549+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:26.217549+0000","last_undegraded":"2024-04-18T21:10:26.217549+0000","last_fullsized":"2024-04-18T21:10:26.217549+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:56.883654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247208+0000","last_change":"2024-04-18T21:10:26.247208+0000","last_active":"2024-04-18T21:10:26.247208+0000","last_peered":"2024-04-18T21:10:26.247208+0000","last_clean":"2024-04-18T21:10:26.247208+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:10:26.247208+0000","last_undegraded":"2024-04-18T21:10:26.247208+0000","last_fullsized":"2024-04-18T21:10:26.247208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:41:32.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":591,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929959+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:25.929959+0000","last_peered":"2024-04-18T21:10:25.929959+0000","last_clean":"2024-04-18T21:10:25.929959+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:25.929959+0000","last_undegraded":"2024-04-18T21:10:25.929959+0000","last_fullsized":"2024-04-18T21:10:25.929959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925499+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:25.925499+0000","last_peered":"2024-04-18T21:10:25.925499+0000","last_clean":"2024-04-18T21:10:25.925499+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:25.925499+0000","last_undegraded":"2024-04-18T21:10:25.925499+0000","last_fullsized":"2024-04-18T21:10:25.925499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928008+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:25.928008+0000","last_peered":"2024-04-18T21:10:25.928008+0000","last_clean":"2024-04-18T21:10:25.928008+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:25.928008+0000","last_undegraded":"2024-04-18T21:10:25.928008+0000","last_fullsized":"2024-04-18T21:10:25.928008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":587,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.236946+0000","last_change":"2024-04-18T21:10:26.236946+0000","last_active":"2024-04-18T21:10:26.236946+0000","last_peered":"2024-04-18T21:10:26.236946+0000","last_clean":"2024-04-18T21:10:26.236946+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:26.236946+0000","last_undegraded":"2024-04-18T21:10:26.236946+0000","last_fullsized":"2024-04-18T21:10:26.236946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:02.167729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":534,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240953+0000","last_change":"2024-04-18T21:10:26.240953+0000","last_active":"2024-04-18T21:10:26.240953+0000","last_peered":"2024-04-18T21:10:26.240953+0000","last_clean":"2024-04-18T21:10:26.240953+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:26.240953+0000","last_undegraded":"2024-04-18T21:10:26.240953+0000","last_fullsized":"2024-04-18T21:10:26.240953+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:34.504144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923664+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:25.923664+0000","last_peered":"2024-04-18T21:10:25.923664+0000","last_clean":"2024-04-18T21:10:25.923664+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:25.923664+0000","last_undegraded":"2024-04-18T21:10:25.923664+0000","last_fullsized":"2024-04-18T21:10:25.923664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927370+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:25.927370+0000","last_peered":"2024-04-18T21:10:25.927370+0000","last_clean":"2024-04-18T21:10:25.927370+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:25.927370+0000","last_undegraded":"2024-04-18T21:10:25.927370+0000","last_fullsized":"2024-04-18T21:10:25.927370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923000+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:25.923000+0000","last_peered":"2024-04-18T21:10:25.923000+0000","last_clean":"2024-04-18T21:10:25.923000+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:25.923000+0000","last_undegraded":"2024-04-18T21:10:25.923000+0000","last_fullsized":"2024-04-18T21:10:25.923000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925602+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:25.925602+0000","last_peered":"2024-04-18T21:10:25.925602+0000","last_clean":"2024-04-18T21:10:25.925602+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:25.925602+0000","last_undegraded":"2024-04-18T21:10:25.925602+0000","last_fullsized":"2024-04-18T21:10:25.925602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":742,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928662+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:25.928662+0000","last_peered":"2024-04-18T21:10:25.928662+0000","last_clean":"2024-04-18T21:10:25.928662+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:25.928662+0000","last_undegraded":"2024-04-18T21:10:25.928662+0000","last_fullsized":"2024-04-18T21:10:25.928662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":590,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249191+0000","last_change":"2024-04-18T21:10:26.249191+0000","last_active":"2024-04-18T21:10:26.249191+0000","last_peered":"2024-04-18T21:10:26.249191+0000","last_clean":"2024-04-18T21:10:26.249191+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:10:26.249191+0000","last_undegraded":"2024-04-18T21:10:26.249191+0000","last_fullsized":"2024-04-18T21:10:26.249191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:51.151882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925210+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:25.925210+0000","last_peered":"2024-04-18T21:10:25.925210+0000","last_clean":"2024-04-18T21:10:25.925210+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:25.925210+0000","last_undegraded":"2024-04-18T21:10:25.925210+0000","last_fullsized":"2024-04-18T21:10:25.925210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929537+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:25.929537+0000","last_peered":"2024-04-18T21:10:25.929537+0000","last_clean":"2024-04-18T21:10:25.929537+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:25.929537+0000","last_undegraded":"2024-04-18T21:10:25.929537+0000","last_fullsized":"2024-04-18T21:10:25.929537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":693,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924601+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:25.924601+0000","last_peered":"2024-04-18T21:10:25.924601+0000","last_clean":"2024-04-18T21:10:25.924601+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:25.924601+0000","last_undegraded":"2024-04-18T21:10:25.924601+0000","last_fullsized":"2024-04-18T21:10:25.924601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":663,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927670+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:25.927670+0000","last_peered":"2024-04-18T21:10:25.927670+0000","last_clean":"2024-04-18T21:10:25.927670+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:25.927670+0000","last_undegraded":"2024-04-18T21:10:25.927670+0000","last_fullsized":"2024-04-18T21:10:25.927670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":607,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246845+0000","last_change":"2024-04-18T21:10:26.246845+0000","last_active":"2024-04-18T21:10:26.246845+0000","last_peered":"2024-04-18T21:10:26.246845+0000","last_clean":"2024-04-18T21:10:26.246845+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:10:26.246845+0000","last_undegraded":"2024-04-18T21:10:26.246845+0000","last_fullsized":"2024-04-18T21:10:26.246845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:22:45.054487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924405+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:25.924405+0000","last_peered":"2024-04-18T21:10:25.924405+0000","last_clean":"2024-04-18T21:10:25.924405+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:25.924405+0000","last_undegraded":"2024-04-18T21:10:25.924405+0000","last_fullsized":"2024-04-18T21:10:25.924405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":628,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.210475+0000","last_change":"2024-04-18T21:10:26.210475+0000","last_active":"2024-04-18T21:10:26.210475+0000","last_peered":"2024-04-18T21:10:26.210475+0000","last_clean":"2024-04-18T21:10:26.210475+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:10:26.210475+0000","last_undegraded":"2024-04-18T21:10:26.210475+0000","last_fullsized":"2024-04-18T21:10:26.210475+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:55.667421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":585,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925203+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:25.925203+0000","last_peered":"2024-04-18T21:10:25.925203+0000","last_clean":"2024-04-18T21:10:25.925203+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:25.925203+0000","last_undegraded":"2024-04-18T21:10:25.925203+0000","last_fullsized":"2024-04-18T21:10:25.925203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":218,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929804+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:25.929804+0000","last_peered":"2024-04-18T21:10:25.929804+0000","last_clean":"2024-04-18T21:10:25.929804+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:25.929804+0000","last_undegraded":"2024-04-18T21:10:25.929804+0000","last_fullsized":"2024-04-18T21:10:25.929804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":622,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929193+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:25.929193+0000","last_peered":"2024-04-18T21:10:25.929193+0000","last_clean":"2024-04-18T21:10:25.929193+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:25.929193+0000","last_undegraded":"2024-04-18T21:10:25.929193+0000","last_fullsized":"2024-04-18T21:10:25.929193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923744+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:25.923744+0000","last_peered":"2024-04-18T21:10:25.923744+0000","last_clean":"2024-04-18T21:10:25.923744+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:25.923744+0000","last_undegraded":"2024-04-18T21:10:25.923744+0000","last_fullsized":"2024-04-18T21:10:25.923744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929063+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:25.929063+0000","last_peered":"2024-04-18T21:10:25.929063+0000","last_clean":"2024-04-18T21:10:25.929063+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:25.929063+0000","last_undegraded":"2024-04-18T21:10:25.929063+0000","last_fullsized":"2024-04-18T21:10:25.929063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247708+0000","last_change":"2024-04-18T21:10:26.247708+0000","last_active":"2024-04-18T21:10:26.247708+0000","last_peered":"2024-04-18T21:10:26.247708+0000","last_clean":"2024-04-18T21:10:26.247708+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:10:26.247708+0000","last_undegraded":"2024-04-18T21:10:26.247708+0000","last_fullsized":"2024-04-18T21:10:26.247708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:33.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.215608+0000","last_change":"2024-04-18T21:10:26.215608+0000","last_active":"2024-04-18T21:10:26.215608+0000","last_peered":"2024-04-18T21:10:26.215608+0000","last_clean":"2024-04-18T21:10:26.215608+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:26.215608+0000","last_undegraded":"2024-04-18T21:10:26.215608+0000","last_fullsized":"2024-04-18T21:10:26.215608+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:08.549962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":606,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923281+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:25.923281+0000","last_peered":"2024-04-18T21:10:25.923281+0000","last_clean":"2024-04-18T21:10:25.923281+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:25.923281+0000","last_undegraded":"2024-04-18T21:10:25.923281+0000","last_fullsized":"2024-04-18T21:10:25.923281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":449,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925960+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:25.925960+0000","last_peered":"2024-04-18T21:10:25.925960+0000","last_clean":"2024-04-18T21:10:25.925960+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:25.925960+0000","last_undegraded":"2024-04-18T21:10:25.925960+0000","last_fullsized":"2024-04-18T21:10:25.925960+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":646,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923351+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:25.923351+0000","last_peered":"2024-04-18T21:10:25.923351+0000","last_clean":"2024-04-18T21:10:25.923351+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:25.923351+0000","last_undegraded":"2024-04-18T21:10:25.923351+0000","last_fullsized":"2024-04-18T21:10:25.923351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241764+0000","last_change":"2024-04-18T21:10:26.241764+0000","last_active":"2024-04-18T21:10:26.241764+0000","last_peered":"2024-04-18T21:10:26.241764+0000","last_clean":"2024-04-18T21:10:26.241764+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:26.241764+0000","last_undegraded":"2024-04-18T21:10:26.241764+0000","last_fullsized":"2024-04-18T21:10:26.241764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:23.849579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":699,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244945+0000","last_change":"2024-04-18T21:10:26.244945+0000","last_active":"2024-04-18T21:10:26.244945+0000","last_peered":"2024-04-18T21:10:26.244945+0000","last_clean":"2024-04-18T21:10:26.244945+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:26.244945+0000","last_undegraded":"2024-04-18T21:10:26.244945+0000","last_fullsized":"2024-04-18T21:10:26.244945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:55:28.759810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232672+0000","last_change":"2024-04-18T21:10:26.232672+0000","last_active":"2024-04-18T21:10:26.232672+0000","last_peered":"2024-04-18T21:10:26.232672+0000","last_clean":"2024-04-18T21:10:26.232672+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:26.232672+0000","last_undegraded":"2024-04-18T21:10:26.232672+0000","last_fullsized":"2024-04-18T21:10:26.232672+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:05.720217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":700,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929763+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:25.929763+0000","last_peered":"2024-04-18T21:10:25.929763+0000","last_clean":"2024-04-18T21:10:25.929763+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:25.929763+0000","last_undegraded":"2024-04-18T21:10:25.929763+0000","last_fullsized":"2024-04-18T21:10:25.929763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":336,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930053+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:25.930053+0000","last_peered":"2024-04-18T21:10:25.930053+0000","last_clean":"2024-04-18T21:10:25.930053+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:25.930053+0000","last_undegraded":"2024-04-18T21:10:25.930053+0000","last_fullsized":"2024-04-18T21:10:25.930053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":625,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243532+0000","last_change":"2024-04-18T21:10:26.243532+0000","last_active":"2024-04-18T21:10:26.243532+0000","last_peered":"2024-04-18T21:10:26.243532+0000","last_clean":"2024-04-18T21:10:26.243532+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:26.243532+0000","last_undegraded":"2024-04-18T21:10:26.243532+0000","last_fullsized":"2024-04-18T21:10:26.243532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:33.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.242580+0000","last_change":"2024-04-18T21:10:26.242580+0000","last_active":"2024-04-18T21:10:26.242580+0000","last_peered":"2024-04-18T21:10:26.242580+0000","last_clean":"2024-04-18T21:10:26.242580+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:26.242580+0000","last_undegraded":"2024-04-18T21:10:26.242580+0000","last_fullsized":"2024-04-18T21:10:26.242580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:09.305905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244330+0000","last_change":"2024-04-18T21:10:26.244330+0000","last_active":"2024-04-18T21:10:26.244330+0000","last_peered":"2024-04-18T21:10:26.244330+0000","last_clean":"2024-04-18T21:10:26.244330+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:26.244330+0000","last_undegraded":"2024-04-18T21:10:26.244330+0000","last_fullsized":"2024-04-18T21:10:26.244330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:35.084780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924020+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:25.924020+0000","last_peered":"2024-04-18T21:10:25.924020+0000","last_clean":"2024-04-18T21:10:25.924020+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:25.924020+0000","last_undegraded":"2024-04-18T21:10:25.924020+0000","last_fullsized":"2024-04-18T21:10:25.924020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":524,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217877+0000","last_change":"2024-04-18T21:10:26.217877+0000","last_active":"2024-04-18T21:10:26.217877+0000","last_peered":"2024-04-18T21:10:26.217877+0000","last_clean":"2024-04-18T21:10:26.217877+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:26.217877+0000","last_undegraded":"2024-04-18T21:10:26.217877+0000","last_fullsized":"2024-04-18T21:10:26.217877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:04:08.598032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":556,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923265+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:25.923265+0000","last_peered":"2024-04-18T21:10:25.923265+0000","last_clean":"2024-04-18T21:10:25.923265+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:25.923265+0000","last_undegraded":"2024-04-18T21:10:25.923265+0000","last_fullsized":"2024-04-18T21:10:25.923265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":674,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929415+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:25.929415+0000","last_peered":"2024-04-18T21:10:25.929415+0000","last_clean":"2024-04-18T21:10:25.929415+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:25.929415+0000","last_undegraded":"2024-04-18T21:10:25.929415+0000","last_fullsized":"2024-04-18T21:10:25.929415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":326,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.200244+0000","last_change":"2024-04-18T21:10:26.200244+0000","last_active":"2024-04-18T21:10:26.200244+0000","last_peered":"2024-04-18T21:10:26.200244+0000","last_clean":"2024-04-18T21:10:26.200244+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:10:26.200244+0000","last_undegraded":"2024-04-18T21:10:26.200244+0000","last_fullsized":"2024-04-18T21:10:26.200244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:44.128206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.206570+0000","last_change":"2024-04-18T21:10:26.206570+0000","last_active":"2024-04-18T21:10:26.206570+0000","last_peered":"2024-04-18T21:10:26.206570+0000","last_clean":"2024-04-18T21:10:26.206570+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:10:26.206570+0000","last_undegraded":"2024-04-18T21:10:26.206570+0000","last_fullsized":"2024-04-18T21:10:26.206570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:30.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":504,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930412+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:25.930412+0000","last_peered":"2024-04-18T21:10:25.930412+0000","last_clean":"2024-04-18T21:10:25.930412+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:25.930412+0000","last_undegraded":"2024-04-18T21:10:25.930412+0000","last_fullsized":"2024-04-18T21:10:25.930412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245477+0000","last_change":"2024-04-18T21:10:26.245477+0000","last_active":"2024-04-18T21:10:26.245477+0000","last_peered":"2024-04-18T21:10:26.245477+0000","last_clean":"2024-04-18T21:10:26.245477+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:26.245477+0000","last_undegraded":"2024-04-18T21:10:26.245477+0000","last_fullsized":"2024-04-18T21:10:26.245477+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:49:33.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248163+0000","last_change":"2024-04-18T21:10:26.248163+0000","last_active":"2024-04-18T21:10:26.248163+0000","last_peered":"2024-04-18T21:10:26.248163+0000","last_clean":"2024-04-18T21:10:26.248163+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:10:26.248163+0000","last_undegraded":"2024-04-18T21:10:26.248163+0000","last_fullsized":"2024-04-18T21:10:26.248163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:13.436655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":353,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928209+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:25.928209+0000","last_peered":"2024-04-18T21:10:25.928209+0000","last_clean":"2024-04-18T21:10:25.928209+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:25.928209+0000","last_undegraded":"2024-04-18T21:10:25.928209+0000","last_fullsized":"2024-04-18T21:10:25.928209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":706,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925849+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:25.925849+0000","last_peered":"2024-04-18T21:10:25.925849+0000","last_clean":"2024-04-18T21:10:25.925849+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:25.925849+0000","last_undegraded":"2024-04-18T21:10:25.925849+0000","last_fullsized":"2024-04-18T21:10:25.925849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928973+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:25.928973+0000","last_peered":"2024-04-18T21:10:25.928973+0000","last_clean":"2024-04-18T21:10:25.928973+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:25.928973+0000","last_undegraded":"2024-04-18T21:10:25.928973+0000","last_fullsized":"2024-04-18T21:10:25.928973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":451,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923612+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:25.923612+0000","last_peered":"2024-04-18T21:10:25.923612+0000","last_clean":"2024-04-18T21:10:25.923612+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:25.923612+0000","last_undegraded":"2024-04-18T21:10:25.923612+0000","last_fullsized":"2024-04-18T21:10:25.923612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924329+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:25.924329+0000","last_peered":"2024-04-18T21:10:25.924329+0000","last_clean":"2024-04-18T21:10:25.924329+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:25.924329+0000","last_undegraded":"2024-04-18T21:10:25.924329+0000","last_fullsized":"2024-04-18T21:10:25.924329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.227561+0000","last_change":"2024-04-18T21:10:26.227561+0000","last_active":"2024-04-18T21:10:26.227561+0000","last_peered":"2024-04-18T21:10:26.227561+0000","last_clean":"2024-04-18T21:10:26.227561+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:26.227561+0000","last_undegraded":"2024-04-18T21:10:26.227561+0000","last_fullsized":"2024-04-18T21:10:26.227561+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:48.634607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211170+0000","last_change":"2024-04-18T21:10:26.211170+0000","last_active":"2024-04-18T21:10:26.211170+0000","last_peered":"2024-04-18T21:10:26.211170+0000","last_clean":"2024-04-18T21:10:26.211170+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:10:26.211170+0000","last_undegraded":"2024-04-18T21:10:26.211170+0000","last_fullsized":"2024-04-18T21:10:26.211170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:52.690052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928343+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:25.928343+0000","last_peered":"2024-04-18T21:10:25.928343+0000","last_clean":"2024-04-18T21:10:25.928343+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:25.928343+0000","last_undegraded":"2024-04-18T21:10:25.928343+0000","last_fullsized":"2024-04-18T21:10:25.928343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":293,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240855+0000","last_change":"2024-04-18T21:10:26.240855+0000","last_active":"2024-04-18T21:10:26.240855+0000","last_peered":"2024-04-18T21:10:26.240855+0000","last_clean":"2024-04-18T21:10:26.240855+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:26.240855+0000","last_undegraded":"2024-04-18T21:10:26.240855+0000","last_fullsized":"2024-04-18T21:10:26.240855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.992598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928666+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:25.928666+0000","last_peered":"2024-04-18T21:10:25.928666+0000","last_clean":"2024-04-18T21:10:25.928666+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:25.928666+0000","last_undegraded":"2024-04-18T21:10:25.928666+0000","last_fullsized":"2024-04-18T21:10:25.928666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924591+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:25.924591+0000","last_peered":"2024-04-18T21:10:25.924591+0000","last_clean":"2024-04-18T21:10:25.924591+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:25.924591+0000","last_undegraded":"2024-04-18T21:10:25.924591+0000","last_fullsized":"2024-04-18T21:10:25.924591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928454+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:25.928454+0000","last_peered":"2024-04-18T21:10:25.928454+0000","last_clean":"2024-04-18T21:10:25.928454+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:25.928454+0000","last_undegraded":"2024-04-18T21:10:25.928454+0000","last_fullsized":"2024-04-18T21:10:25.928454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926476+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:25.926476+0000","last_peered":"2024-04-18T21:10:25.926476+0000","last_clean":"2024-04-18T21:10:25.926476+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:25.926476+0000","last_undegraded":"2024-04-18T21:10:25.926476+0000","last_fullsized":"2024-04-18T21:10:25.926476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":589,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926856+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:25.926856+0000","last_peered":"2024-04-18T21:10:25.926856+0000","last_clean":"2024-04-18T21:10:25.926856+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:25.926856+0000","last_undegraded":"2024-04-18T21:10:25.926856+0000","last_fullsized":"2024-04-18T21:10:25.926856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930233+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:25.930233+0000","last_peered":"2024-04-18T21:10:25.930233+0000","last_clean":"2024-04-18T21:10:25.930233+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:25.930233+0000","last_undegraded":"2024-04-18T21:10:25.930233+0000","last_fullsized":"2024-04-18T21:10:25.930233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929500+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:25.929500+0000","last_peered":"2024-04-18T21:10:25.929500+0000","last_clean":"2024-04-18T21:10:25.929500+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:25.929500+0000","last_undegraded":"2024-04-18T21:10:25.929500+0000","last_fullsized":"2024-04-18T21:10:25.929500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":561,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928548+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:25.928548+0000","last_peered":"2024-04-18T21:10:25.928548+0000","last_clean":"2024-04-18T21:10:25.928548+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:25.928548+0000","last_undegraded":"2024-04-18T21:10:25.928548+0000","last_fullsized":"2024-04-18T21:10:25.928548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":241,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929493+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:25.929493+0000","last_peered":"2024-04-18T21:10:25.929493+0000","last_clean":"2024-04-18T21:10:25.929493+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:25.929493+0000","last_undegraded":"2024-04-18T21:10:25.929493+0000","last_fullsized":"2024-04-18T21:10:25.929493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.214755+0000","last_change":"2024-04-18T21:10:26.214755+0000","last_active":"2024-04-18T21:10:26.214755+0000","last_peered":"2024-04-18T21:10:26.214755+0000","last_clean":"2024-04-18T21:10:26.214755+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:10:26.214755+0000","last_undegraded":"2024-04-18T21:10:26.214755+0000","last_fullsized":"2024-04-18T21:10:26.214755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:19:13.072569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":616,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923453+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:25.923453+0000","last_peered":"2024-04-18T21:10:25.923453+0000","last_clean":"2024-04-18T21:10:25.923453+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:25.923453+0000","last_undegraded":"2024-04-18T21:10:25.923453+0000","last_fullsized":"2024-04-18T21:10:25.923453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":633,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241410+0000","last_change":"2024-04-18T21:10:26.241410+0000","last_active":"2024-04-18T21:10:26.241410+0000","last_peered":"2024-04-18T21:10:26.241410+0000","last_clean":"2024-04-18T21:10:26.241410+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:26.241410+0000","last_undegraded":"2024-04-18T21:10:26.241410+0000","last_fullsized":"2024-04-18T21:10:26.241410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:30.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":394,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.212269+0000","last_change":"2024-04-18T21:10:26.212269+0000","last_active":"2024-04-18T21:10:26.212269+0000","last_peered":"2024-04-18T21:10:26.212269+0000","last_clean":"2024-04-18T21:10:26.212269+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:10:26.212269+0000","last_undegraded":"2024-04-18T21:10:26.212269+0000","last_fullsized":"2024-04-18T21:10:26.212269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:48.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":569,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929263+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:25.929263+0000","last_peered":"2024-04-18T21:10:25.929263+0000","last_clean":"2024-04-18T21:10:25.929263+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:25.929263+0000","last_undegraded":"2024-04-18T21:10:25.929263+0000","last_fullsized":"2024-04-18T21:10:25.929263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":242,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926053+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:25.926053+0000","last_peered":"2024-04-18T21:10:25.926053+0000","last_clean":"2024-04-18T21:10:25.926053+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:25.926053+0000","last_undegraded":"2024-04-18T21:10:25.926053+0000","last_fullsized":"2024-04-18T21:10:25.926053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":266,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.205389+0000","last_change":"2024-04-18T21:10:26.205389+0000","last_active":"2024-04-18T21:10:26.205389+0000","last_peered":"2024-04-18T21:10:26.205389+0000","last_clean":"2024-04-18T21:10:26.205389+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:10:26.205389+0000","last_undegraded":"2024-04-18T21:10:26.205389+0000","last_fullsized":"2024-04-18T21:10:26.205389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:13.325246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":668,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927796+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:25.927796+0000","last_peered":"2024-04-18T21:10:25.927796+0000","last_clean":"2024-04-18T21:10:25.927796+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:25.927796+0000","last_undegraded":"2024-04-18T21:10:25.927796+0000","last_fullsized":"2024-04-18T21:10:25.927796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":228,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929949+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:25.929949+0000","last_peered":"2024-04-18T21:10:25.929949+0000","last_clean":"2024-04-18T21:10:25.929949+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:25.929949+0000","last_undegraded":"2024-04-18T21:10:25.929949+0000","last_fullsized":"2024-04-18T21:10:25.929949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":620,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928270+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:25.928270+0000","last_peered":"2024-04-18T21:10:25.928270+0000","last_clean":"2024-04-18T21:10:25.928270+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:25.928270+0000","last_undegraded":"2024-04-18T21:10:25.928270+0000","last_fullsized":"2024-04-18T21:10:25.928270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925894+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:25.925894+0000","last_peered":"2024-04-18T21:10:25.925894+0000","last_clean":"2024-04-18T21:10:25.925894+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:25.925894+0000","last_undegraded":"2024-04-18T21:10:25.925894+0000","last_fullsized":"2024-04-18T21:10:25.925894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":774,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929075+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:25.929075+0000","last_peered":"2024-04-18T21:10:25.929075+0000","last_clean":"2024-04-18T21:10:25.929075+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:25.929075+0000","last_undegraded":"2024-04-18T21:10:25.929075+0000","last_fullsized":"2024-04-18T21:10:25.929075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928898+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:25.928898+0000","last_peered":"2024-04-18T21:10:25.928898+0000","last_clean":"2024-04-18T21:10:25.928898+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:25.928898+0000","last_undegraded":"2024-04-18T21:10:25.928898+0000","last_fullsized":"2024-04-18T21:10:25.928898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":371,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928125+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:25.928125+0000","last_peered":"2024-04-18T21:10:25.928125+0000","last_clean":"2024-04-18T21:10:25.928125+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:25.928125+0000","last_undegraded":"2024-04-18T21:10:25.928125+0000","last_fullsized":"2024-04-18T21:10:25.928125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925068+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:25.925068+0000","last_peered":"2024-04-18T21:10:25.925068+0000","last_clean":"2024-04-18T21:10:25.925068+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:25.925068+0000","last_undegraded":"2024-04-18T21:10:25.925068+0000","last_fullsized":"2024-04-18T21:10:25.925068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":292,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924947+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:25.924947+0000","last_peered":"2024-04-18T21:10:25.924947+0000","last_clean":"2024-04-18T21:10:25.924947+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:25.924947+0000","last_undegraded":"2024-04-18T21:10:25.924947+0000","last_fullsized":"2024-04-18T21:10:25.924947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":563,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924552+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:25.924552+0000","last_peered":"2024-04-18T21:10:25.924552+0000","last_clean":"2024-04-18T21:10:25.924552+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:25.924552+0000","last_undegraded":"2024-04-18T21:10:25.924552+0000","last_fullsized":"2024-04-18T21:10:25.924552+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924602+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:25.924602+0000","last_peered":"2024-04-18T21:10:25.924602+0000","last_clean":"2024-04-18T21:10:25.924602+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:25.924602+0000","last_undegraded":"2024-04-18T21:10:25.924602+0000","last_fullsized":"2024-04-18T21:10:25.924602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232566+0000","last_change":"2024-04-18T21:10:26.232566+0000","last_active":"2024-04-18T21:10:26.232566+0000","last_peered":"2024-04-18T21:10:26.232566+0000","last_clean":"2024-04-18T21:10:26.232566+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:26.232566+0000","last_undegraded":"2024-04-18T21:10:26.232566+0000","last_fullsized":"2024-04-18T21:10:26.232566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:07.336018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":252,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211599+0000","last_change":"2024-04-18T21:10:26.211599+0000","last_active":"2024-04-18T21:10:26.211599+0000","last_peered":"2024-04-18T21:10:26.211599+0000","last_clean":"2024-04-18T21:10:26.211599+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:10:26.211599+0000","last_undegraded":"2024-04-18T21:10:26.211599+0000","last_fullsized":"2024-04-18T21:10:26.211599+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:05:13.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243246+0000","last_change":"2024-04-18T21:10:26.243246+0000","last_active":"2024-04-18T21:10:26.243246+0000","last_peered":"2024-04-18T21:10:26.243246+0000","last_clean":"2024-04-18T21:10:26.243246+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:26.243246+0000","last_undegraded":"2024-04-18T21:10:26.243246+0000","last_fullsized":"2024-04-18T21:10:26.243246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:27.471789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925518+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:25.925518+0000","last_peered":"2024-04-18T21:10:25.925518+0000","last_clean":"2024-04-18T21:10:25.925518+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:25.925518+0000","last_undegraded":"2024-04-18T21:10:25.925518+0000","last_fullsized":"2024-04-18T21:10:25.925518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924334+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:25.924334+0000","last_peered":"2024-04-18T21:10:25.924334+0000","last_clean":"2024-04-18T21:10:25.924334+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:25.924334+0000","last_undegraded":"2024-04-18T21:10:25.924334+0000","last_fullsized":"2024-04-18T21:10:25.924334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":330,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928940+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:25.928940+0000","last_peered":"2024-04-18T21:10:25.928940+0000","last_clean":"2024-04-18T21:10:25.928940+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:25.928940+0000","last_undegraded":"2024-04-18T21:10:25.928940+0000","last_fullsized":"2024-04-18T21:10:25.928940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247398+0000","last_change":"2024-04-18T21:10:26.247398+0000","last_active":"2024-04-18T21:10:26.247398+0000","last_peered":"2024-04-18T21:10:26.247398+0000","last_clean":"2024-04-18T21:10:26.247398+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:10:26.247398+0000","last_undegraded":"2024-04-18T21:10:26.247398+0000","last_fullsized":"2024-04-18T21:10:26.247398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:43.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":224,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929751+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:25.929751+0000","last_peered":"2024-04-18T21:10:25.929751+0000","last_clean":"2024-04-18T21:10:25.929751+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:25.929751+0000","last_undegraded":"2024-04-18T21:10:25.929751+0000","last_fullsized":"2024-04-18T21:10:25.929751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738440,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103552,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268288,"statfs":{"total":96636764160,"available":96530726912,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350981,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58540,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313300,"statfs":{"total":96636764160,"available":96576819200,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:35.552 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:35.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:35.897 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:35.912 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-04-18T21:10:35.737583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265756,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849764,"statfs":{"total":289910292480,"available":289638158336,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003571"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925304+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:25.925304+0000","last_peered":"2024-04-18T21:10:25.925304+0000","last_clean":"2024-04-18T21:10:25.925304+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:25.925304+0000","last_undegraded":"2024-04-18T21:10:25.925304+0000","last_fullsized":"2024-04-18T21:10:25.925304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925041+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:25.925041+0000","last_peered":"2024-04-18T21:10:25.925041+0000","last_clean":"2024-04-18T21:10:25.925041+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:25.925041+0000","last_undegraded":"2024-04-18T21:10:25.925041+0000","last_fullsized":"2024-04-18T21:10:25.925041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249269+0000","last_change":"2024-04-18T21:10:26.249269+0000","last_active":"2024-04-18T21:10:26.249269+0000","last_peered":"2024-04-18T21:10:26.249269+0000","last_clean":"2024-04-18T21:10:26.249269+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:10:26.249269+0000","last_undegraded":"2024-04-18T21:10:26.249269+0000","last_fullsized":"2024-04-18T21:10:26.249269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:15.741614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243242+0000","last_change":"2024-04-18T21:10:26.243242+0000","last_active":"2024-04-18T21:10:26.243242+0000","last_peered":"2024-04-18T21:10:26.243242+0000","last_clean":"2024-04-18T21:10:26.243242+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:26.243242+0000","last_undegraded":"2024-04-18T21:10:26.243242+0000","last_fullsized":"2024-04-18T21:10:26.243242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:39.920762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924299+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:25.924299+0000","last_peered":"2024-04-18T21:10:25.924299+0000","last_clean":"2024-04-18T21:10:25.924299+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:25.924299+0000","last_undegraded":"2024-04-18T21:10:25.924299+0000","last_fullsized":"2024-04-18T21:10:25.924299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":551,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244103+0000","last_change":"2024-04-18T21:10:26.244103+0000","last_active":"2024-04-18T21:10:26.244103+0000","last_peered":"2024-04-18T21:10:26.244103+0000","last_clean":"2024-04-18T21:10:26.244103+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:10:26.244103+0000","last_undegraded":"2024-04-18T21:10:26.244103+0000","last_fullsized":"2024-04-18T21:10:26.244103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:07.731233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.220897+0000","last_change":"2024-04-18T21:10:26.220897+0000","last_active":"2024-04-18T21:10:26.220897+0000","last_peered":"2024-04-18T21:10:26.220897+0000","last_clean":"2024-04-18T21:10:26.220897+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:26.220897+0000","last_undegraded":"2024-04-18T21:10:26.220897+0000","last_fullsized":"2024-04-18T21:10:26.220897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:54:32.599595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":530,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246695+0000","last_change":"2024-04-18T21:10:26.246695+0000","last_active":"2024-04-18T21:10:26.246695+0000","last_peered":"2024-04-18T21:10:26.246695+0000","last_clean":"2024-04-18T21:10:26.246695+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:26.246695+0000","last_undegraded":"2024-04-18T21:10:26.246695+0000","last_fullsized":"2024-04-18T21:10:26.246695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:16.203297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":661,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928706+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:25.928706+0000","last_peered":"2024-04-18T21:10:25.928706+0000","last_clean":"2024-04-18T21:10:25.928706+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:25.928706+0000","last_undegraded":"2024-04-18T21:10:25.928706+0000","last_fullsized":"2024-04-18T21:10:25.928706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925351+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:25.925351+0000","last_peered":"2024-04-18T21:10:25.925351+0000","last_clean":"2024-04-18T21:10:25.925351+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:25.925351+0000","last_undegraded":"2024-04-18T21:10:25.925351+0000","last_fullsized":"2024-04-18T21:10:25.925351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":523,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246170+0000","last_change":"2024-04-18T21:10:26.246170+0000","last_active":"2024-04-18T21:10:26.246170+0000","last_peered":"2024-04-18T21:10:26.246170+0000","last_clean":"2024-04-18T21:10:26.246170+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:26.246170+0000","last_undegraded":"2024-04-18T21:10:26.246170+0000","last_fullsized":"2024-04-18T21:10:26.246170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:15:25.555562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924042+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:25.924042+0000","last_peered":"2024-04-18T21:10:25.924042+0000","last_clean":"2024-04-18T21:10:25.924042+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:25.924042+0000","last_undegraded":"2024-04-18T21:10:25.924042+0000","last_fullsized":"2024-04-18T21:10:25.924042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924001+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:25.924001+0000","last_peered":"2024-04-18T21:10:25.924001+0000","last_clean":"2024-04-18T21:10:25.924001+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:25.924001+0000","last_undegraded":"2024-04-18T21:10:25.924001+0000","last_fullsized":"2024-04-18T21:10:25.924001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245509+0000","last_change":"2024-04-18T21:10:26.245509+0000","last_active":"2024-04-18T21:10:26.245509+0000","last_peered":"2024-04-18T21:10:26.245509+0000","last_clean":"2024-04-18T21:10:26.245509+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:26.245509+0000","last_undegraded":"2024-04-18T21:10:26.245509+0000","last_fullsized":"2024-04-18T21:10:26.245509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:39:57.418653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":653,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217549+0000","last_change":"2024-04-18T21:10:26.217549+0000","last_active":"2024-04-18T21:10:26.217549+0000","last_peered":"2024-04-18T21:10:26.217549+0000","last_clean":"2024-04-18T21:10:26.217549+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:26.217549+0000","last_undegraded":"2024-04-18T21:10:26.217549+0000","last_fullsized":"2024-04-18T21:10:26.217549+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:56.883654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247208+0000","last_change":"2024-04-18T21:10:26.247208+0000","last_active":"2024-04-18T21:10:26.247208+0000","last_peered":"2024-04-18T21:10:26.247208+0000","last_clean":"2024-04-18T21:10:26.247208+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:10:26.247208+0000","last_undegraded":"2024-04-18T21:10:26.247208+0000","last_fullsized":"2024-04-18T21:10:26.247208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:41:32.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":591,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929959+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:25.929959+0000","last_peered":"2024-04-18T21:10:25.929959+0000","last_clean":"2024-04-18T21:10:25.929959+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:25.929959+0000","last_undegraded":"2024-04-18T21:10:25.929959+0000","last_fullsized":"2024-04-18T21:10:25.929959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925499+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:25.925499+0000","last_peered":"2024-04-18T21:10:25.925499+0000","last_clean":"2024-04-18T21:10:25.925499+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:25.925499+0000","last_undegraded":"2024-04-18T21:10:25.925499+0000","last_fullsized":"2024-04-18T21:10:25.925499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928008+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:25.928008+0000","last_peered":"2024-04-18T21:10:25.928008+0000","last_clean":"2024-04-18T21:10:25.928008+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:25.928008+0000","last_undegraded":"2024-04-18T21:10:25.928008+0000","last_fullsized":"2024-04-18T21:10:25.928008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":587,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.236946+0000","last_change":"2024-04-18T21:10:26.236946+0000","last_active":"2024-04-18T21:10:26.236946+0000","last_peered":"2024-04-18T21:10:26.236946+0000","last_clean":"2024-04-18T21:10:26.236946+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:26.236946+0000","last_undegraded":"2024-04-18T21:10:26.236946+0000","last_fullsized":"2024-04-18T21:10:26.236946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:02.167729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":534,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240953+0000","last_change":"2024-04-18T21:10:26.240953+0000","last_active":"2024-04-18T21:10:26.240953+0000","last_peered":"2024-04-18T21:10:26.240953+0000","last_clean":"2024-04-18T21:10:26.240953+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:26.240953+0000","last_undegraded":"2024-04-18T21:10:26.240953+0000","last_fullsized":"2024-04-18T21:10:26.240953+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:34.504144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923664+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:25.923664+0000","last_peered":"2024-04-18T21:10:25.923664+0000","last_clean":"2024-04-18T21:10:25.923664+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:25.923664+0000","last_undegraded":"2024-04-18T21:10:25.923664+0000","last_fullsized":"2024-04-18T21:10:25.923664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927370+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:25.927370+0000","last_peered":"2024-04-18T21:10:25.927370+0000","last_clean":"2024-04-18T21:10:25.927370+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:25.927370+0000","last_undegraded":"2024-04-18T21:10:25.927370+0000","last_fullsized":"2024-04-18T21:10:25.927370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923000+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:25.923000+0000","last_peered":"2024-04-18T21:10:25.923000+0000","last_clean":"2024-04-18T21:10:25.923000+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:25.923000+0000","last_undegraded":"2024-04-18T21:10:25.923000+0000","last_fullsized":"2024-04-18T21:10:25.923000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925602+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:25.925602+0000","last_peered":"2024-04-18T21:10:25.925602+0000","last_clean":"2024-04-18T21:10:25.925602+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:25.925602+0000","last_undegraded":"2024-04-18T21:10:25.925602+0000","last_fullsized":"2024-04-18T21:10:25.925602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":742,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928662+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:25.928662+0000","last_peered":"2024-04-18T21:10:25.928662+0000","last_clean":"2024-04-18T21:10:25.928662+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:25.928662+0000","last_undegraded":"2024-04-18T21:10:25.928662+0000","last_fullsized":"2024-04-18T21:10:25.928662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":590,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249191+0000","last_change":"2024-04-18T21:10:26.249191+0000","last_active":"2024-04-18T21:10:26.249191+0000","last_peered":"2024-04-18T21:10:26.249191+0000","last_clean":"2024-04-18T21:10:26.249191+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:10:26.249191+0000","last_undegraded":"2024-04-18T21:10:26.249191+0000","last_fullsized":"2024-04-18T21:10:26.249191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:51.151882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925210+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:25.925210+0000","last_peered":"2024-04-18T21:10:25.925210+0000","last_clean":"2024-04-18T21:10:25.925210+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:25.925210+0000","last_undegraded":"2024-04-18T21:10:25.925210+0000","last_fullsized":"2024-04-18T21:10:25.925210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929537+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:25.929537+0000","last_peered":"2024-04-18T21:10:25.929537+0000","last_clean":"2024-04-18T21:10:25.929537+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:25.929537+0000","last_undegraded":"2024-04-18T21:10:25.929537+0000","last_fullsized":"2024-04-18T21:10:25.929537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":693,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924601+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:25.924601+0000","last_peered":"2024-04-18T21:10:25.924601+0000","last_clean":"2024-04-18T21:10:25.924601+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:25.924601+0000","last_undegraded":"2024-04-18T21:10:25.924601+0000","last_fullsized":"2024-04-18T21:10:25.924601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":663,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927670+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:25.927670+0000","last_peered":"2024-04-18T21:10:25.927670+0000","last_clean":"2024-04-18T21:10:25.927670+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:25.927670+0000","last_undegraded":"2024-04-18T21:10:25.927670+0000","last_fullsized":"2024-04-18T21:10:25.927670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":607,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246845+0000","last_change":"2024-04-18T21:10:26.246845+0000","last_active":"2024-04-18T21:10:26.246845+0000","last_peered":"2024-04-18T21:10:26.246845+0000","last_clean":"2024-04-18T21:10:26.246845+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:10:26.246845+0000","last_undegraded":"2024-04-18T21:10:26.246845+0000","last_fullsized":"2024-04-18T21:10:26.246845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:22:45.054487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924405+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:25.924405+0000","last_peered":"2024-04-18T21:10:25.924405+0000","last_clean":"2024-04-18T21:10:25.924405+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:25.924405+0000","last_undegraded":"2024-04-18T21:10:25.924405+0000","last_fullsized":"2024-04-18T21:10:25.924405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":628,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.210475+0000","last_change":"2024-04-18T21:10:26.210475+0000","last_active":"2024-04-18T21:10:26.210475+0000","last_peered":"2024-04-18T21:10:26.210475+0000","last_clean":"2024-04-18T21:10:26.210475+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:10:26.210475+0000","last_undegraded":"2024-04-18T21:10:26.210475+0000","last_fullsized":"2024-04-18T21:10:26.210475+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:55.667421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":585,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925203+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:25.925203+0000","last_peered":"2024-04-18T21:10:25.925203+0000","last_clean":"2024-04-18T21:10:25.925203+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:25.925203+0000","last_undegraded":"2024-04-18T21:10:25.925203+0000","last_fullsized":"2024-04-18T21:10:25.925203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":218,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929804+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:25.929804+0000","last_peered":"2024-04-18T21:10:25.929804+0000","last_clean":"2024-04-18T21:10:25.929804+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:25.929804+0000","last_undegraded":"2024-04-18T21:10:25.929804+0000","last_fullsized":"2024-04-18T21:10:25.929804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":622,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929193+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:25.929193+0000","last_peered":"2024-04-18T21:10:25.929193+0000","last_clean":"2024-04-18T21:10:25.929193+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:25.929193+0000","last_undegraded":"2024-04-18T21:10:25.929193+0000","last_fullsized":"2024-04-18T21:10:25.929193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923744+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:25.923744+0000","last_peered":"2024-04-18T21:10:25.923744+0000","last_clean":"2024-04-18T21:10:25.923744+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:25.923744+0000","last_undegraded":"2024-04-18T21:10:25.923744+0000","last_fullsized":"2024-04-18T21:10:25.923744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929063+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:25.929063+0000","last_peered":"2024-04-18T21:10:25.929063+0000","last_clean":"2024-04-18T21:10:25.929063+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:25.929063+0000","last_undegraded":"2024-04-18T21:10:25.929063+0000","last_fullsized":"2024-04-18T21:10:25.929063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247708+0000","last_change":"2024-04-18T21:10:26.247708+0000","last_active":"2024-04-18T21:10:26.247708+0000","last_peered":"2024-04-18T21:10:26.247708+0000","last_clean":"2024-04-18T21:10:26.247708+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:10:26.247708+0000","last_undegraded":"2024-04-18T21:10:26.247708+0000","last_fullsized":"2024-04-18T21:10:26.247708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:33.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.215608+0000","last_change":"2024-04-18T21:10:26.215608+0000","last_active":"2024-04-18T21:10:26.215608+0000","last_peered":"2024-04-18T21:10:26.215608+0000","last_clean":"2024-04-18T21:10:26.215608+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:26.215608+0000","last_undegraded":"2024-04-18T21:10:26.215608+0000","last_fullsized":"2024-04-18T21:10:26.215608+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:08.549962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":606,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923281+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:25.923281+0000","last_peered":"2024-04-18T21:10:25.923281+0000","last_clean":"2024-04-18T21:10:25.923281+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:25.923281+0000","last_undegraded":"2024-04-18T21:10:25.923281+0000","last_fullsized":"2024-04-18T21:10:25.923281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":449,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925960+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:25.925960+0000","last_peered":"2024-04-18T21:10:25.925960+0000","last_clean":"2024-04-18T21:10:25.925960+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:25.925960+0000","last_undegraded":"2024-04-18T21:10:25.925960+0000","last_fullsized":"2024-04-18T21:10:25.925960+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":646,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923351+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:25.923351+0000","last_peered":"2024-04-18T21:10:25.923351+0000","last_clean":"2024-04-18T21:10:25.923351+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:25.923351+0000","last_undegraded":"2024-04-18T21:10:25.923351+0000","last_fullsized":"2024-04-18T21:10:25.923351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241764+0000","last_change":"2024-04-18T21:10:26.241764+0000","last_active":"2024-04-18T21:10:26.241764+0000","last_peered":"2024-04-18T21:10:26.241764+0000","last_clean":"2024-04-18T21:10:26.241764+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:26.241764+0000","last_undegraded":"2024-04-18T21:10:26.241764+0000","last_fullsized":"2024-04-18T21:10:26.241764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:23.849579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":699,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244945+0000","last_change":"2024-04-18T21:10:26.244945+0000","last_active":"2024-04-18T21:10:26.244945+0000","last_peered":"2024-04-18T21:10:26.244945+0000","last_clean":"2024-04-18T21:10:26.244945+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:26.244945+0000","last_undegraded":"2024-04-18T21:10:26.244945+0000","last_fullsized":"2024-04-18T21:10:26.244945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:55:28.759810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232672+0000","last_change":"2024-04-18T21:10:26.232672+0000","last_active":"2024-04-18T21:10:26.232672+0000","last_peered":"2024-04-18T21:10:26.232672+0000","last_clean":"2024-04-18T21:10:26.232672+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:26.232672+0000","last_undegraded":"2024-04-18T21:10:26.232672+0000","last_fullsized":"2024-04-18T21:10:26.232672+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:05.720217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":700,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929763+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:25.929763+0000","last_peered":"2024-04-18T21:10:25.929763+0000","last_clean":"2024-04-18T21:10:25.929763+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:25.929763+0000","last_undegraded":"2024-04-18T21:10:25.929763+0000","last_fullsized":"2024-04-18T21:10:25.929763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":336,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930053+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:25.930053+0000","last_peered":"2024-04-18T21:10:25.930053+0000","last_clean":"2024-04-18T21:10:25.930053+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:25.930053+0000","last_undegraded":"2024-04-18T21:10:25.930053+0000","last_fullsized":"2024-04-18T21:10:25.930053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":625,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243532+0000","last_change":"2024-04-18T21:10:26.243532+0000","last_active":"2024-04-18T21:10:26.243532+0000","last_peered":"2024-04-18T21:10:26.243532+0000","last_clean":"2024-04-18T21:10:26.243532+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:26.243532+0000","last_undegraded":"2024-04-18T21:10:26.243532+0000","last_fullsized":"2024-04-18T21:10:26.243532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:33.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.242580+0000","last_change":"2024-04-18T21:10:26.242580+0000","last_active":"2024-04-18T21:10:26.242580+0000","last_peered":"2024-04-18T21:10:26.242580+0000","last_clean":"2024-04-18T21:10:26.242580+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:26.242580+0000","last_undegraded":"2024-04-18T21:10:26.242580+0000","last_fullsized":"2024-04-18T21:10:26.242580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:09.305905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244330+0000","last_change":"2024-04-18T21:10:26.244330+0000","last_active":"2024-04-18T21:10:26.244330+0000","last_peered":"2024-04-18T21:10:26.244330+0000","last_clean":"2024-04-18T21:10:26.244330+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:26.244330+0000","last_undegraded":"2024-04-18T21:10:26.244330+0000","last_fullsized":"2024-04-18T21:10:26.244330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:35.084780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924020+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:25.924020+0000","last_peered":"2024-04-18T21:10:25.924020+0000","last_clean":"2024-04-18T21:10:25.924020+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:25.924020+0000","last_undegraded":"2024-04-18T21:10:25.924020+0000","last_fullsized":"2024-04-18T21:10:25.924020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":524,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217877+0000","last_change":"2024-04-18T21:10:26.217877+0000","last_active":"2024-04-18T21:10:26.217877+0000","last_peered":"2024-04-18T21:10:26.217877+0000","last_clean":"2024-04-18T21:10:26.217877+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:26.217877+0000","last_undegraded":"2024-04-18T21:10:26.217877+0000","last_fullsized":"2024-04-18T21:10:26.217877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:04:08.598032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":556,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923265+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:25.923265+0000","last_peered":"2024-04-18T21:10:25.923265+0000","last_clean":"2024-04-18T21:10:25.923265+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:25.923265+0000","last_undegraded":"2024-04-18T21:10:25.923265+0000","last_fullsized":"2024-04-18T21:10:25.923265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":674,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929415+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:25.929415+0000","last_peered":"2024-04-18T21:10:25.929415+0000","last_clean":"2024-04-18T21:10:25.929415+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:25.929415+0000","last_undegraded":"2024-04-18T21:10:25.929415+0000","last_fullsized":"2024-04-18T21:10:25.929415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":326,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.200244+0000","last_change":"2024-04-18T21:10:26.200244+0000","last_active":"2024-04-18T21:10:26.200244+0000","last_peered":"2024-04-18T21:10:26.200244+0000","last_clean":"2024-04-18T21:10:26.200244+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:10:26.200244+0000","last_undegraded":"2024-04-18T21:10:26.200244+0000","last_fullsized":"2024-04-18T21:10:26.200244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:44.128206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.206570+0000","last_change":"2024-04-18T21:10:26.206570+0000","last_active":"2024-04-18T21:10:26.206570+0000","last_peered":"2024-04-18T21:10:26.206570+0000","last_clean":"2024-04-18T21:10:26.206570+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:10:26.206570+0000","last_undegraded":"2024-04-18T21:10:26.206570+0000","last_fullsized":"2024-04-18T21:10:26.206570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:30.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":504,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930412+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:25.930412+0000","last_peered":"2024-04-18T21:10:25.930412+0000","last_clean":"2024-04-18T21:10:25.930412+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:25.930412+0000","last_undegraded":"2024-04-18T21:10:25.930412+0000","last_fullsized":"2024-04-18T21:10:25.930412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245477+0000","last_change":"2024-04-18T21:10:26.245477+0000","last_active":"2024-04-18T21:10:26.245477+0000","last_peered":"2024-04-18T21:10:26.245477+0000","last_clean":"2024-04-18T21:10:26.245477+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:26.245477+0000","last_undegraded":"2024-04-18T21:10:26.245477+0000","last_fullsized":"2024-04-18T21:10:26.245477+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:49:33.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248163+0000","last_change":"2024-04-18T21:10:26.248163+0000","last_active":"2024-04-18T21:10:26.248163+0000","last_peered":"2024-04-18T21:10:26.248163+0000","last_clean":"2024-04-18T21:10:26.248163+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:10:26.248163+0000","last_undegraded":"2024-04-18T21:10:26.248163+0000","last_fullsized":"2024-04-18T21:10:26.248163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:13.436655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":353,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928209+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:25.928209+0000","last_peered":"2024-04-18T21:10:25.928209+0000","last_clean":"2024-04-18T21:10:25.928209+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:25.928209+0000","last_undegraded":"2024-04-18T21:10:25.928209+0000","last_fullsized":"2024-04-18T21:10:25.928209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":706,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925849+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:25.925849+0000","last_peered":"2024-04-18T21:10:25.925849+0000","last_clean":"2024-04-18T21:10:25.925849+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:25.925849+0000","last_undegraded":"2024-04-18T21:10:25.925849+0000","last_fullsized":"2024-04-18T21:10:25.925849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928973+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:25.928973+0000","last_peered":"2024-04-18T21:10:25.928973+0000","last_clean":"2024-04-18T21:10:25.928973+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:25.928973+0000","last_undegraded":"2024-04-18T21:10:25.928973+0000","last_fullsized":"2024-04-18T21:10:25.928973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":451,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923612+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:25.923612+0000","last_peered":"2024-04-18T21:10:25.923612+0000","last_clean":"2024-04-18T21:10:25.923612+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:25.923612+0000","last_undegraded":"2024-04-18T21:10:25.923612+0000","last_fullsized":"2024-04-18T21:10:25.923612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924329+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:25.924329+0000","last_peered":"2024-04-18T21:10:25.924329+0000","last_clean":"2024-04-18T21:10:25.924329+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:25.924329+0000","last_undegraded":"2024-04-18T21:10:25.924329+0000","last_fullsized":"2024-04-18T21:10:25.924329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.227561+0000","last_change":"2024-04-18T21:10:26.227561+0000","last_active":"2024-04-18T21:10:26.227561+0000","last_peered":"2024-04-18T21:10:26.227561+0000","last_clean":"2024-04-18T21:10:26.227561+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:26.227561+0000","last_undegraded":"2024-04-18T21:10:26.227561+0000","last_fullsized":"2024-04-18T21:10:26.227561+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:48.634607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211170+0000","last_change":"2024-04-18T21:10:26.211170+0000","last_active":"2024-04-18T21:10:26.211170+0000","last_peered":"2024-04-18T21:10:26.211170+0000","last_clean":"2024-04-18T21:10:26.211170+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:10:26.211170+0000","last_undegraded":"2024-04-18T21:10:26.211170+0000","last_fullsized":"2024-04-18T21:10:26.211170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:52.690052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928343+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:25.928343+0000","last_peered":"2024-04-18T21:10:25.928343+0000","last_clean":"2024-04-18T21:10:25.928343+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:25.928343+0000","last_undegraded":"2024-04-18T21:10:25.928343+0000","last_fullsized":"2024-04-18T21:10:25.928343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":293,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240855+0000","last_change":"2024-04-18T21:10:26.240855+0000","last_active":"2024-04-18T21:10:26.240855+0000","last_peered":"2024-04-18T21:10:26.240855+0000","last_clean":"2024-04-18T21:10:26.240855+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:26.240855+0000","last_undegraded":"2024-04-18T21:10:26.240855+0000","last_fullsized":"2024-04-18T21:10:26.240855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.992598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928666+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:25.928666+0000","last_peered":"2024-04-18T21:10:25.928666+0000","last_clean":"2024-04-18T21:10:25.928666+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:25.928666+0000","last_undegraded":"2024-04-18T21:10:25.928666+0000","last_fullsized":"2024-04-18T21:10:25.928666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924591+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:25.924591+0000","last_peered":"2024-04-18T21:10:25.924591+0000","last_clean":"2024-04-18T21:10:25.924591+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:25.924591+0000","last_undegraded":"2024-04-18T21:10:25.924591+0000","last_fullsized":"2024-04-18T21:10:25.924591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928454+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:25.928454+0000","last_peered":"2024-04-18T21:10:25.928454+0000","last_clean":"2024-04-18T21:10:25.928454+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:25.928454+0000","last_undegraded":"2024-04-18T21:10:25.928454+0000","last_fullsized":"2024-04-18T21:10:25.928454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926476+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:25.926476+0000","last_peered":"2024-04-18T21:10:25.926476+0000","last_clean":"2024-04-18T21:10:25.926476+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:25.926476+0000","last_undegraded":"2024-04-18T21:10:25.926476+0000","last_fullsized":"2024-04-18T21:10:25.926476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":589,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926856+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:25.926856+0000","last_peered":"2024-04-18T21:10:25.926856+0000","last_clean":"2024-04-18T21:10:25.926856+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:25.926856+0000","last_undegraded":"2024-04-18T21:10:25.926856+0000","last_fullsized":"2024-04-18T21:10:25.926856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930233+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:25.930233+0000","last_peered":"2024-04-18T21:10:25.930233+0000","last_clean":"2024-04-18T21:10:25.930233+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:25.930233+0000","last_undegraded":"2024-04-18T21:10:25.930233+0000","last_fullsized":"2024-04-18T21:10:25.930233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929500+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:25.929500+0000","last_peered":"2024-04-18T21:10:25.929500+0000","last_clean":"2024-04-18T21:10:25.929500+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:25.929500+0000","last_undegraded":"2024-04-18T21:10:25.929500+0000","last_fullsized":"2024-04-18T21:10:25.929500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":561,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928548+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:25.928548+0000","last_peered":"2024-04-18T21:10:25.928548+0000","last_clean":"2024-04-18T21:10:25.928548+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:25.928548+0000","last_undegraded":"2024-04-18T21:10:25.928548+0000","last_fullsized":"2024-04-18T21:10:25.928548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":241,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929493+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:25.929493+0000","last_peered":"2024-04-18T21:10:25.929493+0000","last_clean":"2024-04-18T21:10:25.929493+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:25.929493+0000","last_undegraded":"2024-04-18T21:10:25.929493+0000","last_fullsized":"2024-04-18T21:10:25.929493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.214755+0000","last_change":"2024-04-18T21:10:26.214755+0000","last_active":"2024-04-18T21:10:26.214755+0000","last_peered":"2024-04-18T21:10:26.214755+0000","last_clean":"2024-04-18T21:10:26.214755+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:10:26.214755+0000","last_undegraded":"2024-04-18T21:10:26.214755+0000","last_fullsized":"2024-04-18T21:10:26.214755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:19:13.072569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":616,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923453+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:25.923453+0000","last_peered":"2024-04-18T21:10:25.923453+0000","last_clean":"2024-04-18T21:10:25.923453+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:25.923453+0000","last_undegraded":"2024-04-18T21:10:25.923453+0000","last_fullsized":"2024-04-18T21:10:25.923453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":633,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241410+0000","last_change":"2024-04-18T21:10:26.241410+0000","last_active":"2024-04-18T21:10:26.241410+0000","last_peered":"2024-04-18T21:10:26.241410+0000","last_clean":"2024-04-18T21:10:26.241410+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:26.241410+0000","last_undegraded":"2024-04-18T21:10:26.241410+0000","last_fullsized":"2024-04-18T21:10:26.241410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:30.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":394,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.212269+0000","last_change":"2024-04-18T21:10:26.212269+0000","last_active":"2024-04-18T21:10:26.212269+0000","last_peered":"2024-04-18T21:10:26.212269+0000","last_clean":"2024-04-18T21:10:26.212269+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:10:26.212269+0000","last_undegraded":"2024-04-18T21:10:26.212269+0000","last_fullsized":"2024-04-18T21:10:26.212269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:48.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":569,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929263+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:25.929263+0000","last_peered":"2024-04-18T21:10:25.929263+0000","last_clean":"2024-04-18T21:10:25.929263+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:25.929263+0000","last_undegraded":"2024-04-18T21:10:25.929263+0000","last_fullsized":"2024-04-18T21:10:25.929263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":242,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926053+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:25.926053+0000","last_peered":"2024-04-18T21:10:25.926053+0000","last_clean":"2024-04-18T21:10:25.926053+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:25.926053+0000","last_undegraded":"2024-04-18T21:10:25.926053+0000","last_fullsized":"2024-04-18T21:10:25.926053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":266,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.205389+0000","last_change":"2024-04-18T21:10:26.205389+0000","last_active":"2024-04-18T21:10:26.205389+0000","last_peered":"2024-04-18T21:10:26.205389+0000","last_clean":"2024-04-18T21:10:26.205389+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:10:26.205389+0000","last_undegraded":"2024-04-18T21:10:26.205389+0000","last_fullsized":"2024-04-18T21:10:26.205389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:13.325246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":668,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927796+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:25.927796+0000","last_peered":"2024-04-18T21:10:25.927796+0000","last_clean":"2024-04-18T21:10:25.927796+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:25.927796+0000","last_undegraded":"2024-04-18T21:10:25.927796+0000","last_fullsized":"2024-04-18T21:10:25.927796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":228,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929949+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:25.929949+0000","last_peered":"2024-04-18T21:10:25.929949+0000","last_clean":"2024-04-18T21:10:25.929949+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:25.929949+0000","last_undegraded":"2024-04-18T21:10:25.929949+0000","last_fullsized":"2024-04-18T21:10:25.929949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":620,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928270+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:25.928270+0000","last_peered":"2024-04-18T21:10:25.928270+0000","last_clean":"2024-04-18T21:10:25.928270+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:25.928270+0000","last_undegraded":"2024-04-18T21:10:25.928270+0000","last_fullsized":"2024-04-18T21:10:25.928270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925894+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:25.925894+0000","last_peered":"2024-04-18T21:10:25.925894+0000","last_clean":"2024-04-18T21:10:25.925894+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:25.925894+0000","last_undegraded":"2024-04-18T21:10:25.925894+0000","last_fullsized":"2024-04-18T21:10:25.925894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":774,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929075+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:25.929075+0000","last_peered":"2024-04-18T21:10:25.929075+0000","last_clean":"2024-04-18T21:10:25.929075+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:25.929075+0000","last_undegraded":"2024-04-18T21:10:25.929075+0000","last_fullsized":"2024-04-18T21:10:25.929075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928898+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:25.928898+0000","last_peered":"2024-04-18T21:10:25.928898+0000","last_clean":"2024-04-18T21:10:25.928898+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:25.928898+0000","last_undegraded":"2024-04-18T21:10:25.928898+0000","last_fullsized":"2024-04-18T21:10:25.928898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":371,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928125+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:25.928125+0000","last_peered":"2024-04-18T21:10:25.928125+0000","last_clean":"2024-04-18T21:10:25.928125+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:25.928125+0000","last_undegraded":"2024-04-18T21:10:25.928125+0000","last_fullsized":"2024-04-18T21:10:25.928125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925068+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:25.925068+0000","last_peered":"2024-04-18T21:10:25.925068+0000","last_clean":"2024-04-18T21:10:25.925068+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:25.925068+0000","last_undegraded":"2024-04-18T21:10:25.925068+0000","last_fullsized":"2024-04-18T21:10:25.925068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":292,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924947+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:25.924947+0000","last_peered":"2024-04-18T21:10:25.924947+0000","last_clean":"2024-04-18T21:10:25.924947+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:25.924947+0000","last_undegraded":"2024-04-18T21:10:25.924947+0000","last_fullsized":"2024-04-18T21:10:25.924947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":563,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924552+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:25.924552+0000","last_peered":"2024-04-18T21:10:25.924552+0000","last_clean":"2024-04-18T21:10:25.924552+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:25.924552+0000","last_undegraded":"2024-04-18T21:10:25.924552+0000","last_fullsized":"2024-04-18T21:10:25.924552+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924602+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:25.924602+0000","last_peered":"2024-04-18T21:10:25.924602+0000","last_clean":"2024-04-18T21:10:25.924602+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:25.924602+0000","last_undegraded":"2024-04-18T21:10:25.924602+0000","last_fullsized":"2024-04-18T21:10:25.924602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232566+0000","last_change":"2024-04-18T21:10:26.232566+0000","last_active":"2024-04-18T21:10:26.232566+0000","last_peered":"2024-04-18T21:10:26.232566+0000","last_clean":"2024-04-18T21:10:26.232566+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:26.232566+0000","last_undegraded":"2024-04-18T21:10:26.232566+0000","last_fullsized":"2024-04-18T21:10:26.232566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:07.336018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":252,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211599+0000","last_change":"2024-04-18T21:10:26.211599+0000","last_active":"2024-04-18T21:10:26.211599+0000","last_peered":"2024-04-18T21:10:26.211599+0000","last_clean":"2024-04-18T21:10:26.211599+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:10:26.211599+0000","last_undegraded":"2024-04-18T21:10:26.211599+0000","last_fullsized":"2024-04-18T21:10:26.211599+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:05:13.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243246+0000","last_change":"2024-04-18T21:10:26.243246+0000","last_active":"2024-04-18T21:10:26.243246+0000","last_peered":"2024-04-18T21:10:26.243246+0000","last_clean":"2024-04-18T21:10:26.243246+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:26.243246+0000","last_undegraded":"2024-04-18T21:10:26.243246+0000","last_fullsized":"2024-04-18T21:10:26.243246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:27.471789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925518+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:25.925518+0000","last_peered":"2024-04-18T21:10:25.925518+0000","last_clean":"2024-04-18T21:10:25.925518+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:25.925518+0000","last_undegraded":"2024-04-18T21:10:25.925518+0000","last_fullsized":"2024-04-18T21:10:25.925518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924334+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:25.924334+0000","last_peered":"2024-04-18T21:10:25.924334+0000","last_clean":"2024-04-18T21:10:25.924334+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:25.924334+0000","last_undegraded":"2024-04-18T21:10:25.924334+0000","last_fullsized":"2024-04-18T21:10:25.924334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":330,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928940+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:25.928940+0000","last_peered":"2024-04-18T21:10:25.928940+0000","last_clean":"2024-04-18T21:10:25.928940+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:25.928940+0000","last_undegraded":"2024-04-18T21:10:25.928940+0000","last_fullsized":"2024-04-18T21:10:25.928940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247398+0000","last_change":"2024-04-18T21:10:26.247398+0000","last_active":"2024-04-18T21:10:26.247398+0000","last_peered":"2024-04-18T21:10:26.247398+0000","last_clean":"2024-04-18T21:10:26.247398+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:10:26.247398+0000","last_undegraded":"2024-04-18T21:10:26.247398+0000","last_fullsized":"2024-04-18T21:10:26.247398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:43.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":224,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929751+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:25.929751+0000","last_peered":"2024-04-18T21:10:25.929751+0000","last_clean":"2024-04-18T21:10:25.929751+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:25.929751+0000","last_undegraded":"2024-04-18T21:10:25.929751+0000","last_fullsized":"2024-04-18T21:10:25.929751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738440,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103552,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268288,"statfs":{"total":96636764160,"available":96530726912,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350982,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58540,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313300,"statfs":{"total":96636764160,"available":96576819200,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:35.916 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T21:10:35.916 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:36.244 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:36.246 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:36.261 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-04-18T21:10:35.737583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265756,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849764,"statfs":{"total":289910292480,"available":289638158336,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003571"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925304+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:25.925304+0000","last_peered":"2024-04-18T21:10:25.925304+0000","last_clean":"2024-04-18T21:10:25.925304+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:25.925304+0000","last_undegraded":"2024-04-18T21:10:25.925304+0000","last_fullsized":"2024-04-18T21:10:25.925304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925041+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:25.925041+0000","last_peered":"2024-04-18T21:10:25.925041+0000","last_clean":"2024-04-18T21:10:25.925041+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:25.925041+0000","last_undegraded":"2024-04-18T21:10:25.925041+0000","last_fullsized":"2024-04-18T21:10:25.925041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249269+0000","last_change":"2024-04-18T21:10:26.249269+0000","last_active":"2024-04-18T21:10:26.249269+0000","last_peered":"2024-04-18T21:10:26.249269+0000","last_clean":"2024-04-18T21:10:26.249269+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:10:26.249269+0000","last_undegraded":"2024-04-18T21:10:26.249269+0000","last_fullsized":"2024-04-18T21:10:26.249269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:15.741614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243242+0000","last_change":"2024-04-18T21:10:26.243242+0000","last_active":"2024-04-18T21:10:26.243242+0000","last_peered":"2024-04-18T21:10:26.243242+0000","last_clean":"2024-04-18T21:10:26.243242+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:26.243242+0000","last_undegraded":"2024-04-18T21:10:26.243242+0000","last_fullsized":"2024-04-18T21:10:26.243242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:39.920762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924299+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:25.924299+0000","last_peered":"2024-04-18T21:10:25.924299+0000","last_clean":"2024-04-18T21:10:25.924299+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:25.924299+0000","last_undegraded":"2024-04-18T21:10:25.924299+0000","last_fullsized":"2024-04-18T21:10:25.924299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":551,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244103+0000","last_change":"2024-04-18T21:10:26.244103+0000","last_active":"2024-04-18T21:10:26.244103+0000","last_peered":"2024-04-18T21:10:26.244103+0000","last_clean":"2024-04-18T21:10:26.244103+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:10:26.244103+0000","last_undegraded":"2024-04-18T21:10:26.244103+0000","last_fullsized":"2024-04-18T21:10:26.244103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:07.731233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.220897+0000","last_change":"2024-04-18T21:10:26.220897+0000","last_active":"2024-04-18T21:10:26.220897+0000","last_peered":"2024-04-18T21:10:26.220897+0000","last_clean":"2024-04-18T21:10:26.220897+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:26.220897+0000","last_undegraded":"2024-04-18T21:10:26.220897+0000","last_fullsized":"2024-04-18T21:10:26.220897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:54:32.599595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":530,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246695+0000","last_change":"2024-04-18T21:10:26.246695+0000","last_active":"2024-04-18T21:10:26.246695+0000","last_peered":"2024-04-18T21:10:26.246695+0000","last_clean":"2024-04-18T21:10:26.246695+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:26.246695+0000","last_undegraded":"2024-04-18T21:10:26.246695+0000","last_fullsized":"2024-04-18T21:10:26.246695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:16.203297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":661,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928706+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:25.928706+0000","last_peered":"2024-04-18T21:10:25.928706+0000","last_clean":"2024-04-18T21:10:25.928706+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:25.928706+0000","last_undegraded":"2024-04-18T21:10:25.928706+0000","last_fullsized":"2024-04-18T21:10:25.928706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925351+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:25.925351+0000","last_peered":"2024-04-18T21:10:25.925351+0000","last_clean":"2024-04-18T21:10:25.925351+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:25.925351+0000","last_undegraded":"2024-04-18T21:10:25.925351+0000","last_fullsized":"2024-04-18T21:10:25.925351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":523,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246170+0000","last_change":"2024-04-18T21:10:26.246170+0000","last_active":"2024-04-18T21:10:26.246170+0000","last_peered":"2024-04-18T21:10:26.246170+0000","last_clean":"2024-04-18T21:10:26.246170+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:26.246170+0000","last_undegraded":"2024-04-18T21:10:26.246170+0000","last_fullsized":"2024-04-18T21:10:26.246170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:15:25.555562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924042+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:25.924042+0000","last_peered":"2024-04-18T21:10:25.924042+0000","last_clean":"2024-04-18T21:10:25.924042+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:25.924042+0000","last_undegraded":"2024-04-18T21:10:25.924042+0000","last_fullsized":"2024-04-18T21:10:25.924042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924001+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:25.924001+0000","last_peered":"2024-04-18T21:10:25.924001+0000","last_clean":"2024-04-18T21:10:25.924001+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:25.924001+0000","last_undegraded":"2024-04-18T21:10:25.924001+0000","last_fullsized":"2024-04-18T21:10:25.924001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245509+0000","last_change":"2024-04-18T21:10:26.245509+0000","last_active":"2024-04-18T21:10:26.245509+0000","last_peered":"2024-04-18T21:10:26.245509+0000","last_clean":"2024-04-18T21:10:26.245509+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:26.245509+0000","last_undegraded":"2024-04-18T21:10:26.245509+0000","last_fullsized":"2024-04-18T21:10:26.245509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:39:57.418653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":653,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217549+0000","last_change":"2024-04-18T21:10:26.217549+0000","last_active":"2024-04-18T21:10:26.217549+0000","last_peered":"2024-04-18T21:10:26.217549+0000","last_clean":"2024-04-18T21:10:26.217549+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:26.217549+0000","last_undegraded":"2024-04-18T21:10:26.217549+0000","last_fullsized":"2024-04-18T21:10:26.217549+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:56.883654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247208+0000","last_change":"2024-04-18T21:10:26.247208+0000","last_active":"2024-04-18T21:10:26.247208+0000","last_peered":"2024-04-18T21:10:26.247208+0000","last_clean":"2024-04-18T21:10:26.247208+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:10:26.247208+0000","last_undegraded":"2024-04-18T21:10:26.247208+0000","last_fullsized":"2024-04-18T21:10:26.247208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:41:32.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":591,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929959+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:25.929959+0000","last_peered":"2024-04-18T21:10:25.929959+0000","last_clean":"2024-04-18T21:10:25.929959+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:25.929959+0000","last_undegraded":"2024-04-18T21:10:25.929959+0000","last_fullsized":"2024-04-18T21:10:25.929959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925499+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:25.925499+0000","last_peered":"2024-04-18T21:10:25.925499+0000","last_clean":"2024-04-18T21:10:25.925499+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:25.925499+0000","last_undegraded":"2024-04-18T21:10:25.925499+0000","last_fullsized":"2024-04-18T21:10:25.925499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928008+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:25.928008+0000","last_peered":"2024-04-18T21:10:25.928008+0000","last_clean":"2024-04-18T21:10:25.928008+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:25.928008+0000","last_undegraded":"2024-04-18T21:10:25.928008+0000","last_fullsized":"2024-04-18T21:10:25.928008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":587,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.236946+0000","last_change":"2024-04-18T21:10:26.236946+0000","last_active":"2024-04-18T21:10:26.236946+0000","last_peered":"2024-04-18T21:10:26.236946+0000","last_clean":"2024-04-18T21:10:26.236946+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:26.236946+0000","last_undegraded":"2024-04-18T21:10:26.236946+0000","last_fullsized":"2024-04-18T21:10:26.236946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:02.167729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":534,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240953+0000","last_change":"2024-04-18T21:10:26.240953+0000","last_active":"2024-04-18T21:10:26.240953+0000","last_peered":"2024-04-18T21:10:26.240953+0000","last_clean":"2024-04-18T21:10:26.240953+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:26.240953+0000","last_undegraded":"2024-04-18T21:10:26.240953+0000","last_fullsized":"2024-04-18T21:10:26.240953+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:34.504144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923664+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:25.923664+0000","last_peered":"2024-04-18T21:10:25.923664+0000","last_clean":"2024-04-18T21:10:25.923664+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:25.923664+0000","last_undegraded":"2024-04-18T21:10:25.923664+0000","last_fullsized":"2024-04-18T21:10:25.923664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927370+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:25.927370+0000","last_peered":"2024-04-18T21:10:25.927370+0000","last_clean":"2024-04-18T21:10:25.927370+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:25.927370+0000","last_undegraded":"2024-04-18T21:10:25.927370+0000","last_fullsized":"2024-04-18T21:10:25.927370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923000+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:25.923000+0000","last_peered":"2024-04-18T21:10:25.923000+0000","last_clean":"2024-04-18T21:10:25.923000+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:25.923000+0000","last_undegraded":"2024-04-18T21:10:25.923000+0000","last_fullsized":"2024-04-18T21:10:25.923000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925602+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:25.925602+0000","last_peered":"2024-04-18T21:10:25.925602+0000","last_clean":"2024-04-18T21:10:25.925602+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:25.925602+0000","last_undegraded":"2024-04-18T21:10:25.925602+0000","last_fullsized":"2024-04-18T21:10:25.925602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":742,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928662+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:25.928662+0000","last_peered":"2024-04-18T21:10:25.928662+0000","last_clean":"2024-04-18T21:10:25.928662+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:25.928662+0000","last_undegraded":"2024-04-18T21:10:25.928662+0000","last_fullsized":"2024-04-18T21:10:25.928662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":590,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249191+0000","last_change":"2024-04-18T21:10:26.249191+0000","last_active":"2024-04-18T21:10:26.249191+0000","last_peered":"2024-04-18T21:10:26.249191+0000","last_clean":"2024-04-18T21:10:26.249191+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:10:26.249191+0000","last_undegraded":"2024-04-18T21:10:26.249191+0000","last_fullsized":"2024-04-18T21:10:26.249191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:51.151882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925210+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:25.925210+0000","last_peered":"2024-04-18T21:10:25.925210+0000","last_clean":"2024-04-18T21:10:25.925210+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:25.925210+0000","last_undegraded":"2024-04-18T21:10:25.925210+0000","last_fullsized":"2024-04-18T21:10:25.925210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929537+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:25.929537+0000","last_peered":"2024-04-18T21:10:25.929537+0000","last_clean":"2024-04-18T21:10:25.929537+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:25.929537+0000","last_undegraded":"2024-04-18T21:10:25.929537+0000","last_fullsized":"2024-04-18T21:10:25.929537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":693,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924601+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:25.924601+0000","last_peered":"2024-04-18T21:10:25.924601+0000","last_clean":"2024-04-18T21:10:25.924601+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:25.924601+0000","last_undegraded":"2024-04-18T21:10:25.924601+0000","last_fullsized":"2024-04-18T21:10:25.924601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":663,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927670+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:25.927670+0000","last_peered":"2024-04-18T21:10:25.927670+0000","last_clean":"2024-04-18T21:10:25.927670+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:25.927670+0000","last_undegraded":"2024-04-18T21:10:25.927670+0000","last_fullsized":"2024-04-18T21:10:25.927670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":607,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246845+0000","last_change":"2024-04-18T21:10:26.246845+0000","last_active":"2024-04-18T21:10:26.246845+0000","last_peered":"2024-04-18T21:10:26.246845+0000","last_clean":"2024-04-18T21:10:26.246845+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:10:26.246845+0000","last_undegraded":"2024-04-18T21:10:26.246845+0000","last_fullsized":"2024-04-18T21:10:26.246845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:22:45.054487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924405+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:25.924405+0000","last_peered":"2024-04-18T21:10:25.924405+0000","last_clean":"2024-04-18T21:10:25.924405+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:25.924405+0000","last_undegraded":"2024-04-18T21:10:25.924405+0000","last_fullsized":"2024-04-18T21:10:25.924405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":628,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.210475+0000","last_change":"2024-04-18T21:10:26.210475+0000","last_active":"2024-04-18T21:10:26.210475+0000","last_peered":"2024-04-18T21:10:26.210475+0000","last_clean":"2024-04-18T21:10:26.210475+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:10:26.210475+0000","last_undegraded":"2024-04-18T21:10:26.210475+0000","last_fullsized":"2024-04-18T21:10:26.210475+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:55.667421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":585,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925203+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:25.925203+0000","last_peered":"2024-04-18T21:10:25.925203+0000","last_clean":"2024-04-18T21:10:25.925203+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:25.925203+0000","last_undegraded":"2024-04-18T21:10:25.925203+0000","last_fullsized":"2024-04-18T21:10:25.925203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":218,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929804+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:25.929804+0000","last_peered":"2024-04-18T21:10:25.929804+0000","last_clean":"2024-04-18T21:10:25.929804+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:25.929804+0000","last_undegraded":"2024-04-18T21:10:25.929804+0000","last_fullsized":"2024-04-18T21:10:25.929804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":622,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929193+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:25.929193+0000","last_peered":"2024-04-18T21:10:25.929193+0000","last_clean":"2024-04-18T21:10:25.929193+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:25.929193+0000","last_undegraded":"2024-04-18T21:10:25.929193+0000","last_fullsized":"2024-04-18T21:10:25.929193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923744+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:25.923744+0000","last_peered":"2024-04-18T21:10:25.923744+0000","last_clean":"2024-04-18T21:10:25.923744+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:25.923744+0000","last_undegraded":"2024-04-18T21:10:25.923744+0000","last_fullsized":"2024-04-18T21:10:25.923744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929063+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:25.929063+0000","last_peered":"2024-04-18T21:10:25.929063+0000","last_clean":"2024-04-18T21:10:25.929063+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:25.929063+0000","last_undegraded":"2024-04-18T21:10:25.929063+0000","last_fullsized":"2024-04-18T21:10:25.929063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247708+0000","last_change":"2024-04-18T21:10:26.247708+0000","last_active":"2024-04-18T21:10:26.247708+0000","last_peered":"2024-04-18T21:10:26.247708+0000","last_clean":"2024-04-18T21:10:26.247708+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:10:26.247708+0000","last_undegraded":"2024-04-18T21:10:26.247708+0000","last_fullsized":"2024-04-18T21:10:26.247708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:33.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.215608+0000","last_change":"2024-04-18T21:10:26.215608+0000","last_active":"2024-04-18T21:10:26.215608+0000","last_peered":"2024-04-18T21:10:26.215608+0000","last_clean":"2024-04-18T21:10:26.215608+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:26.215608+0000","last_undegraded":"2024-04-18T21:10:26.215608+0000","last_fullsized":"2024-04-18T21:10:26.215608+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:08.549962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":606,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923281+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:25.923281+0000","last_peered":"2024-04-18T21:10:25.923281+0000","last_clean":"2024-04-18T21:10:25.923281+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:25.923281+0000","last_undegraded":"2024-04-18T21:10:25.923281+0000","last_fullsized":"2024-04-18T21:10:25.923281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":449,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925960+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:25.925960+0000","last_peered":"2024-04-18T21:10:25.925960+0000","last_clean":"2024-04-18T21:10:25.925960+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:25.925960+0000","last_undegraded":"2024-04-18T21:10:25.925960+0000","last_fullsized":"2024-04-18T21:10:25.925960+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":646,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923351+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:25.923351+0000","last_peered":"2024-04-18T21:10:25.923351+0000","last_clean":"2024-04-18T21:10:25.923351+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:25.923351+0000","last_undegraded":"2024-04-18T21:10:25.923351+0000","last_fullsized":"2024-04-18T21:10:25.923351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241764+0000","last_change":"2024-04-18T21:10:26.241764+0000","last_active":"2024-04-18T21:10:26.241764+0000","last_peered":"2024-04-18T21:10:26.241764+0000","last_clean":"2024-04-18T21:10:26.241764+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:26.241764+0000","last_undegraded":"2024-04-18T21:10:26.241764+0000","last_fullsized":"2024-04-18T21:10:26.241764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:23.849579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":699,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244945+0000","last_change":"2024-04-18T21:10:26.244945+0000","last_active":"2024-04-18T21:10:26.244945+0000","last_peered":"2024-04-18T21:10:26.244945+0000","last_clean":"2024-04-18T21:10:26.244945+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:26.244945+0000","last_undegraded":"2024-04-18T21:10:26.244945+0000","last_fullsized":"2024-04-18T21:10:26.244945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:55:28.759810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232672+0000","last_change":"2024-04-18T21:10:26.232672+0000","last_active":"2024-04-18T21:10:26.232672+0000","last_peered":"2024-04-18T21:10:26.232672+0000","last_clean":"2024-04-18T21:10:26.232672+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:26.232672+0000","last_undegraded":"2024-04-18T21:10:26.232672+0000","last_fullsized":"2024-04-18T21:10:26.232672+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:05.720217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":700,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929763+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:25.929763+0000","last_peered":"2024-04-18T21:10:25.929763+0000","last_clean":"2024-04-18T21:10:25.929763+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:25.929763+0000","last_undegraded":"2024-04-18T21:10:25.929763+0000","last_fullsized":"2024-04-18T21:10:25.929763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":336,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930053+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:25.930053+0000","last_peered":"2024-04-18T21:10:25.930053+0000","last_clean":"2024-04-18T21:10:25.930053+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:25.930053+0000","last_undegraded":"2024-04-18T21:10:25.930053+0000","last_fullsized":"2024-04-18T21:10:25.930053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":625,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243532+0000","last_change":"2024-04-18T21:10:26.243532+0000","last_active":"2024-04-18T21:10:26.243532+0000","last_peered":"2024-04-18T21:10:26.243532+0000","last_clean":"2024-04-18T21:10:26.243532+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:26.243532+0000","last_undegraded":"2024-04-18T21:10:26.243532+0000","last_fullsized":"2024-04-18T21:10:26.243532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:33.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.242580+0000","last_change":"2024-04-18T21:10:26.242580+0000","last_active":"2024-04-18T21:10:26.242580+0000","last_peered":"2024-04-18T21:10:26.242580+0000","last_clean":"2024-04-18T21:10:26.242580+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:26.242580+0000","last_undegraded":"2024-04-18T21:10:26.242580+0000","last_fullsized":"2024-04-18T21:10:26.242580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:09.305905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244330+0000","last_change":"2024-04-18T21:10:26.244330+0000","last_active":"2024-04-18T21:10:26.244330+0000","last_peered":"2024-04-18T21:10:26.244330+0000","last_clean":"2024-04-18T21:10:26.244330+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:26.244330+0000","last_undegraded":"2024-04-18T21:10:26.244330+0000","last_fullsized":"2024-04-18T21:10:26.244330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:35.084780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924020+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:25.924020+0000","last_peered":"2024-04-18T21:10:25.924020+0000","last_clean":"2024-04-18T21:10:25.924020+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:25.924020+0000","last_undegraded":"2024-04-18T21:10:25.924020+0000","last_fullsized":"2024-04-18T21:10:25.924020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":524,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217877+0000","last_change":"2024-04-18T21:10:26.217877+0000","last_active":"2024-04-18T21:10:26.217877+0000","last_peered":"2024-04-18T21:10:26.217877+0000","last_clean":"2024-04-18T21:10:26.217877+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:26.217877+0000","last_undegraded":"2024-04-18T21:10:26.217877+0000","last_fullsized":"2024-04-18T21:10:26.217877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:04:08.598032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":556,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923265+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:25.923265+0000","last_peered":"2024-04-18T21:10:25.923265+0000","last_clean":"2024-04-18T21:10:25.923265+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:25.923265+0000","last_undegraded":"2024-04-18T21:10:25.923265+0000","last_fullsized":"2024-04-18T21:10:25.923265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":674,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929415+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:25.929415+0000","last_peered":"2024-04-18T21:10:25.929415+0000","last_clean":"2024-04-18T21:10:25.929415+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:25.929415+0000","last_undegraded":"2024-04-18T21:10:25.929415+0000","last_fullsized":"2024-04-18T21:10:25.929415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":326,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.200244+0000","last_change":"2024-04-18T21:10:26.200244+0000","last_active":"2024-04-18T21:10:26.200244+0000","last_peered":"2024-04-18T21:10:26.200244+0000","last_clean":"2024-04-18T21:10:26.200244+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:10:26.200244+0000","last_undegraded":"2024-04-18T21:10:26.200244+0000","last_fullsized":"2024-04-18T21:10:26.200244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:44.128206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.206570+0000","last_change":"2024-04-18T21:10:26.206570+0000","last_active":"2024-04-18T21:10:26.206570+0000","last_peered":"2024-04-18T21:10:26.206570+0000","last_clean":"2024-04-18T21:10:26.206570+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:10:26.206570+0000","last_undegraded":"2024-04-18T21:10:26.206570+0000","last_fullsized":"2024-04-18T21:10:26.206570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:30.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":504,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930412+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:25.930412+0000","last_peered":"2024-04-18T21:10:25.930412+0000","last_clean":"2024-04-18T21:10:25.930412+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:25.930412+0000","last_undegraded":"2024-04-18T21:10:25.930412+0000","last_fullsized":"2024-04-18T21:10:25.930412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245477+0000","last_change":"2024-04-18T21:10:26.245477+0000","last_active":"2024-04-18T21:10:26.245477+0000","last_peered":"2024-04-18T21:10:26.245477+0000","last_clean":"2024-04-18T21:10:26.245477+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:26.245477+0000","last_undegraded":"2024-04-18T21:10:26.245477+0000","last_fullsized":"2024-04-18T21:10:26.245477+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:49:33.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248163+0000","last_change":"2024-04-18T21:10:26.248163+0000","last_active":"2024-04-18T21:10:26.248163+0000","last_peered":"2024-04-18T21:10:26.248163+0000","last_clean":"2024-04-18T21:10:26.248163+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:10:26.248163+0000","last_undegraded":"2024-04-18T21:10:26.248163+0000","last_fullsized":"2024-04-18T21:10:26.248163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:13.436655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":353,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928209+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:25.928209+0000","last_peered":"2024-04-18T21:10:25.928209+0000","last_clean":"2024-04-18T21:10:25.928209+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:25.928209+0000","last_undegraded":"2024-04-18T21:10:25.928209+0000","last_fullsized":"2024-04-18T21:10:25.928209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":706,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925849+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:25.925849+0000","last_peered":"2024-04-18T21:10:25.925849+0000","last_clean":"2024-04-18T21:10:25.925849+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:25.925849+0000","last_undegraded":"2024-04-18T21:10:25.925849+0000","last_fullsized":"2024-04-18T21:10:25.925849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928973+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:25.928973+0000","last_peered":"2024-04-18T21:10:25.928973+0000","last_clean":"2024-04-18T21:10:25.928973+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:25.928973+0000","last_undegraded":"2024-04-18T21:10:25.928973+0000","last_fullsized":"2024-04-18T21:10:25.928973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":451,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923612+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:25.923612+0000","last_peered":"2024-04-18T21:10:25.923612+0000","last_clean":"2024-04-18T21:10:25.923612+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:25.923612+0000","last_undegraded":"2024-04-18T21:10:25.923612+0000","last_fullsized":"2024-04-18T21:10:25.923612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924329+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:25.924329+0000","last_peered":"2024-04-18T21:10:25.924329+0000","last_clean":"2024-04-18T21:10:25.924329+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:25.924329+0000","last_undegraded":"2024-04-18T21:10:25.924329+0000","last_fullsized":"2024-04-18T21:10:25.924329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.227561+0000","last_change":"2024-04-18T21:10:26.227561+0000","last_active":"2024-04-18T21:10:26.227561+0000","last_peered":"2024-04-18T21:10:26.227561+0000","last_clean":"2024-04-18T21:10:26.227561+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:26.227561+0000","last_undegraded":"2024-04-18T21:10:26.227561+0000","last_fullsized":"2024-04-18T21:10:26.227561+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:48.634607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211170+0000","last_change":"2024-04-18T21:10:26.211170+0000","last_active":"2024-04-18T21:10:26.211170+0000","last_peered":"2024-04-18T21:10:26.211170+0000","last_clean":"2024-04-18T21:10:26.211170+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:10:26.211170+0000","last_undegraded":"2024-04-18T21:10:26.211170+0000","last_fullsized":"2024-04-18T21:10:26.211170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:52.690052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928343+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:25.928343+0000","last_peered":"2024-04-18T21:10:25.928343+0000","last_clean":"2024-04-18T21:10:25.928343+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:25.928343+0000","last_undegraded":"2024-04-18T21:10:25.928343+0000","last_fullsized":"2024-04-18T21:10:25.928343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":293,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240855+0000","last_change":"2024-04-18T21:10:26.240855+0000","last_active":"2024-04-18T21:10:26.240855+0000","last_peered":"2024-04-18T21:10:26.240855+0000","last_clean":"2024-04-18T21:10:26.240855+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:26.240855+0000","last_undegraded":"2024-04-18T21:10:26.240855+0000","last_fullsized":"2024-04-18T21:10:26.240855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.992598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928666+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:25.928666+0000","last_peered":"2024-04-18T21:10:25.928666+0000","last_clean":"2024-04-18T21:10:25.928666+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:25.928666+0000","last_undegraded":"2024-04-18T21:10:25.928666+0000","last_fullsized":"2024-04-18T21:10:25.928666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924591+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:25.924591+0000","last_peered":"2024-04-18T21:10:25.924591+0000","last_clean":"2024-04-18T21:10:25.924591+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:25.924591+0000","last_undegraded":"2024-04-18T21:10:25.924591+0000","last_fullsized":"2024-04-18T21:10:25.924591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928454+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:25.928454+0000","last_peered":"2024-04-18T21:10:25.928454+0000","last_clean":"2024-04-18T21:10:25.928454+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:25.928454+0000","last_undegraded":"2024-04-18T21:10:25.928454+0000","last_fullsized":"2024-04-18T21:10:25.928454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926476+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:25.926476+0000","last_peered":"2024-04-18T21:10:25.926476+0000","last_clean":"2024-04-18T21:10:25.926476+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:25.926476+0000","last_undegraded":"2024-04-18T21:10:25.926476+0000","last_fullsized":"2024-04-18T21:10:25.926476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":589,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926856+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:25.926856+0000","last_peered":"2024-04-18T21:10:25.926856+0000","last_clean":"2024-04-18T21:10:25.926856+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:25.926856+0000","last_undegraded":"2024-04-18T21:10:25.926856+0000","last_fullsized":"2024-04-18T21:10:25.926856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930233+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:25.930233+0000","last_peered":"2024-04-18T21:10:25.930233+0000","last_clean":"2024-04-18T21:10:25.930233+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:25.930233+0000","last_undegraded":"2024-04-18T21:10:25.930233+0000","last_fullsized":"2024-04-18T21:10:25.930233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929500+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:25.929500+0000","last_peered":"2024-04-18T21:10:25.929500+0000","last_clean":"2024-04-18T21:10:25.929500+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:25.929500+0000","last_undegraded":"2024-04-18T21:10:25.929500+0000","last_fullsized":"2024-04-18T21:10:25.929500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":561,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928548+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:25.928548+0000","last_peered":"2024-04-18T21:10:25.928548+0000","last_clean":"2024-04-18T21:10:25.928548+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:25.928548+0000","last_undegraded":"2024-04-18T21:10:25.928548+0000","last_fullsized":"2024-04-18T21:10:25.928548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":241,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929493+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:25.929493+0000","last_peered":"2024-04-18T21:10:25.929493+0000","last_clean":"2024-04-18T21:10:25.929493+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:25.929493+0000","last_undegraded":"2024-04-18T21:10:25.929493+0000","last_fullsized":"2024-04-18T21:10:25.929493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.214755+0000","last_change":"2024-04-18T21:10:26.214755+0000","last_active":"2024-04-18T21:10:26.214755+0000","last_peered":"2024-04-18T21:10:26.214755+0000","last_clean":"2024-04-18T21:10:26.214755+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:10:26.214755+0000","last_undegraded":"2024-04-18T21:10:26.214755+0000","last_fullsized":"2024-04-18T21:10:26.214755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:19:13.072569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":616,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923453+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:25.923453+0000","last_peered":"2024-04-18T21:10:25.923453+0000","last_clean":"2024-04-18T21:10:25.923453+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:25.923453+0000","last_undegraded":"2024-04-18T21:10:25.923453+0000","last_fullsized":"2024-04-18T21:10:25.923453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":633,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241410+0000","last_change":"2024-04-18T21:10:26.241410+0000","last_active":"2024-04-18T21:10:26.241410+0000","last_peered":"2024-04-18T21:10:26.241410+0000","last_clean":"2024-04-18T21:10:26.241410+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:26.241410+0000","last_undegraded":"2024-04-18T21:10:26.241410+0000","last_fullsized":"2024-04-18T21:10:26.241410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:30.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":394,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.212269+0000","last_change":"2024-04-18T21:10:26.212269+0000","last_active":"2024-04-18T21:10:26.212269+0000","last_peered":"2024-04-18T21:10:26.212269+0000","last_clean":"2024-04-18T21:10:26.212269+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:10:26.212269+0000","last_undegraded":"2024-04-18T21:10:26.212269+0000","last_fullsized":"2024-04-18T21:10:26.212269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:48.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":569,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929263+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:25.929263+0000","last_peered":"2024-04-18T21:10:25.929263+0000","last_clean":"2024-04-18T21:10:25.929263+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:25.929263+0000","last_undegraded":"2024-04-18T21:10:25.929263+0000","last_fullsized":"2024-04-18T21:10:25.929263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":242,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926053+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:25.926053+0000","last_peered":"2024-04-18T21:10:25.926053+0000","last_clean":"2024-04-18T21:10:25.926053+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:25.926053+0000","last_undegraded":"2024-04-18T21:10:25.926053+0000","last_fullsized":"2024-04-18T21:10:25.926053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":266,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.205389+0000","last_change":"2024-04-18T21:10:26.205389+0000","last_active":"2024-04-18T21:10:26.205389+0000","last_peered":"2024-04-18T21:10:26.205389+0000","last_clean":"2024-04-18T21:10:26.205389+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:10:26.205389+0000","last_undegraded":"2024-04-18T21:10:26.205389+0000","last_fullsized":"2024-04-18T21:10:26.205389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:13.325246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":668,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927796+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:25.927796+0000","last_peered":"2024-04-18T21:10:25.927796+0000","last_clean":"2024-04-18T21:10:25.927796+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:25.927796+0000","last_undegraded":"2024-04-18T21:10:25.927796+0000","last_fullsized":"2024-04-18T21:10:25.927796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":228,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929949+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:25.929949+0000","last_peered":"2024-04-18T21:10:25.929949+0000","last_clean":"2024-04-18T21:10:25.929949+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:25.929949+0000","last_undegraded":"2024-04-18T21:10:25.929949+0000","last_fullsized":"2024-04-18T21:10:25.929949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":620,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928270+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:25.928270+0000","last_peered":"2024-04-18T21:10:25.928270+0000","last_clean":"2024-04-18T21:10:25.928270+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:25.928270+0000","last_undegraded":"2024-04-18T21:10:25.928270+0000","last_fullsized":"2024-04-18T21:10:25.928270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925894+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:25.925894+0000","last_peered":"2024-04-18T21:10:25.925894+0000","last_clean":"2024-04-18T21:10:25.925894+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:25.925894+0000","last_undegraded":"2024-04-18T21:10:25.925894+0000","last_fullsized":"2024-04-18T21:10:25.925894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":774,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929075+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:25.929075+0000","last_peered":"2024-04-18T21:10:25.929075+0000","last_clean":"2024-04-18T21:10:25.929075+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:25.929075+0000","last_undegraded":"2024-04-18T21:10:25.929075+0000","last_fullsized":"2024-04-18T21:10:25.929075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928898+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:25.928898+0000","last_peered":"2024-04-18T21:10:25.928898+0000","last_clean":"2024-04-18T21:10:25.928898+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:25.928898+0000","last_undegraded":"2024-04-18T21:10:25.928898+0000","last_fullsized":"2024-04-18T21:10:25.928898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":371,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928125+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:25.928125+0000","last_peered":"2024-04-18T21:10:25.928125+0000","last_clean":"2024-04-18T21:10:25.928125+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:25.928125+0000","last_undegraded":"2024-04-18T21:10:25.928125+0000","last_fullsized":"2024-04-18T21:10:25.928125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925068+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:25.925068+0000","last_peered":"2024-04-18T21:10:25.925068+0000","last_clean":"2024-04-18T21:10:25.925068+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:25.925068+0000","last_undegraded":"2024-04-18T21:10:25.925068+0000","last_fullsized":"2024-04-18T21:10:25.925068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":292,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924947+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:25.924947+0000","last_peered":"2024-04-18T21:10:25.924947+0000","last_clean":"2024-04-18T21:10:25.924947+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:25.924947+0000","last_undegraded":"2024-04-18T21:10:25.924947+0000","last_fullsized":"2024-04-18T21:10:25.924947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":563,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924552+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:25.924552+0000","last_peered":"2024-04-18T21:10:25.924552+0000","last_clean":"2024-04-18T21:10:25.924552+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:25.924552+0000","last_undegraded":"2024-04-18T21:10:25.924552+0000","last_fullsized":"2024-04-18T21:10:25.924552+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924602+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:25.924602+0000","last_peered":"2024-04-18T21:10:25.924602+0000","last_clean":"2024-04-18T21:10:25.924602+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:25.924602+0000","last_undegraded":"2024-04-18T21:10:25.924602+0000","last_fullsized":"2024-04-18T21:10:25.924602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232566+0000","last_change":"2024-04-18T21:10:26.232566+0000","last_active":"2024-04-18T21:10:26.232566+0000","last_peered":"2024-04-18T21:10:26.232566+0000","last_clean":"2024-04-18T21:10:26.232566+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:26.232566+0000","last_undegraded":"2024-04-18T21:10:26.232566+0000","last_fullsized":"2024-04-18T21:10:26.232566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:07.336018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":252,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211599+0000","last_change":"2024-04-18T21:10:26.211599+0000","last_active":"2024-04-18T21:10:26.211599+0000","last_peered":"2024-04-18T21:10:26.211599+0000","last_clean":"2024-04-18T21:10:26.211599+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:10:26.211599+0000","last_undegraded":"2024-04-18T21:10:26.211599+0000","last_fullsized":"2024-04-18T21:10:26.211599+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:05:13.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243246+0000","last_change":"2024-04-18T21:10:26.243246+0000","last_active":"2024-04-18T21:10:26.243246+0000","last_peered":"2024-04-18T21:10:26.243246+0000","last_clean":"2024-04-18T21:10:26.243246+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:26.243246+0000","last_undegraded":"2024-04-18T21:10:26.243246+0000","last_fullsized":"2024-04-18T21:10:26.243246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:27.471789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925518+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:25.925518+0000","last_peered":"2024-04-18T21:10:25.925518+0000","last_clean":"2024-04-18T21:10:25.925518+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:25.925518+0000","last_undegraded":"2024-04-18T21:10:25.925518+0000","last_fullsized":"2024-04-18T21:10:25.925518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924334+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:25.924334+0000","last_peered":"2024-04-18T21:10:25.924334+0000","last_clean":"2024-04-18T21:10:25.924334+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:25.924334+0000","last_undegraded":"2024-04-18T21:10:25.924334+0000","last_fullsized":"2024-04-18T21:10:25.924334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":330,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928940+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:25.928940+0000","last_peered":"2024-04-18T21:10:25.928940+0000","last_clean":"2024-04-18T21:10:25.928940+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:25.928940+0000","last_undegraded":"2024-04-18T21:10:25.928940+0000","last_fullsized":"2024-04-18T21:10:25.928940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247398+0000","last_change":"2024-04-18T21:10:26.247398+0000","last_active":"2024-04-18T21:10:26.247398+0000","last_peered":"2024-04-18T21:10:26.247398+0000","last_clean":"2024-04-18T21:10:26.247398+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:10:26.247398+0000","last_undegraded":"2024-04-18T21:10:26.247398+0000","last_fullsized":"2024-04-18T21:10:26.247398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:43.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":224,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929751+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:25.929751+0000","last_peered":"2024-04-18T21:10:25.929751+0000","last_clean":"2024-04-18T21:10:25.929751+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:25.929751+0000","last_undegraded":"2024-04-18T21:10:25.929751+0000","last_fullsized":"2024-04-18T21:10:25.929751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738440,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103552,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268288,"statfs":{"total":96636764160,"available":96530726912,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350982,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58540,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313300,"statfs":{"total":96636764160,"available":96576819200,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:36.265 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:10:36.591 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:36.592 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":89,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:10:25.915815+0000","last_up_change":"2024-04-18T21:10:15.841427+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":81,"up_thru":88,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6801","nonce":274608909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6803","nonce":274608909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6807","nonce":274608909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6805","nonce":274608909}]},"public_addr":"172.21.15.111:6801/274608909","cluster_addr":"172.21.15.111:6803/274608909","heartbeat_back_addr":"172.21.15.111:6807/274608909","heartbeat_front_addr":"172.21.15.111:6805/274608909","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3","osds":[1,2]},{"pgid":"4.7","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:10:37.610 INFO:tasks.ceph:Scrubbing osd.0 2024-04-18T21:10:37.610 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-18T21:10:37.773 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:10:37.773 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-18T21:10:37.774 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:10:37.789 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-18T21:10:38.062 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 0 to deep-scrub 2024-04-18T21:10:38.080 INFO:tasks.ceph:Scrubbing osd.1 2024-04-18T21:10:38.080 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-18T21:10:38.227 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:10:38.227 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T21:10:38.227 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:10:38.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-18T21:10:38.528 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 1 to deep-scrub 2024-04-18T21:10:38.546 INFO:tasks.ceph:Scrubbing osd.2 2024-04-18T21:10:38.547 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-18T21:10:38.690 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T21:10:38.690 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T21:10:38.690 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T21:10:38.705 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-18T21:10:38.987 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 2 to deep-scrub 2024-04-18T21:10:39.006 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:39.296 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:39.297 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:39.313 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-04-18T21:10:37.738017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32989,"ondisk_log_size":32989,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265756,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849764,"statfs":{"total":289910292480,"available":289638158336,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.817685"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925304+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:25.925304+0000","last_peered":"2024-04-18T21:10:25.925304+0000","last_clean":"2024-04-18T21:10:25.925304+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:25.925304+0000","last_undegraded":"2024-04-18T21:10:25.925304+0000","last_fullsized":"2024-04-18T21:10:25.925304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:58.535408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925041+0000","last_change":"2024-04-18T21:10:23.928491+0000","last_active":"2024-04-18T21:10:25.925041+0000","last_peered":"2024-04-18T21:10:25.925041+0000","last_clean":"2024-04-18T21:10:25.925041+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:25.925041+0000","last_undegraded":"2024-04-18T21:10:25.925041+0000","last_fullsized":"2024-04-18T21:10:25.925041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:14.770268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249269+0000","last_change":"2024-04-18T21:10:26.249269+0000","last_active":"2024-04-18T21:10:26.249269+0000","last_peered":"2024-04-18T21:10:26.249269+0000","last_clean":"2024-04-18T21:10:26.249269+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:10:26.249269+0000","last_undegraded":"2024-04-18T21:10:26.249269+0000","last_fullsized":"2024-04-18T21:10:26.249269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:15.741614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243242+0000","last_change":"2024-04-18T21:10:26.243242+0000","last_active":"2024-04-18T21:10:26.243242+0000","last_peered":"2024-04-18T21:10:26.243242+0000","last_clean":"2024-04-18T21:10:26.243242+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:26.243242+0000","last_undegraded":"2024-04-18T21:10:26.243242+0000","last_fullsized":"2024-04-18T21:10:26.243242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:39.920762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924299+0000","last_change":"2024-04-18T21:10:23.925585+0000","last_active":"2024-04-18T21:10:25.924299+0000","last_peered":"2024-04-18T21:10:25.924299+0000","last_clean":"2024-04-18T21:10:25.924299+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:25.924299+0000","last_undegraded":"2024-04-18T21:10:25.924299+0000","last_fullsized":"2024-04-18T21:10:25.924299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:49.102543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":551,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244103+0000","last_change":"2024-04-18T21:10:26.244103+0000","last_active":"2024-04-18T21:10:26.244103+0000","last_peered":"2024-04-18T21:10:26.244103+0000","last_clean":"2024-04-18T21:10:26.244103+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:10:26.244103+0000","last_undegraded":"2024-04-18T21:10:26.244103+0000","last_fullsized":"2024-04-18T21:10:26.244103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:07.731233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.220897+0000","last_change":"2024-04-18T21:10:26.220897+0000","last_active":"2024-04-18T21:10:26.220897+0000","last_peered":"2024-04-18T21:10:26.220897+0000","last_clean":"2024-04-18T21:10:26.220897+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:26.220897+0000","last_undegraded":"2024-04-18T21:10:26.220897+0000","last_fullsized":"2024-04-18T21:10:26.220897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:54:32.599595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":530,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246695+0000","last_change":"2024-04-18T21:10:26.246695+0000","last_active":"2024-04-18T21:10:26.246695+0000","last_peered":"2024-04-18T21:10:26.246695+0000","last_clean":"2024-04-18T21:10:26.246695+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:26.246695+0000","last_undegraded":"2024-04-18T21:10:26.246695+0000","last_fullsized":"2024-04-18T21:10:26.246695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:16.203297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":661,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928706+0000","last_change":"2024-04-18T21:05:08.605743+0000","last_active":"2024-04-18T21:10:25.928706+0000","last_peered":"2024-04-18T21:10:25.928706+0000","last_clean":"2024-04-18T21:10:25.928706+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:25.928706+0000","last_undegraded":"2024-04-18T21:10:25.928706+0000","last_fullsized":"2024-04-18T21:10:25.928706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:16.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925351+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:25.925351+0000","last_peered":"2024-04-18T21:10:25.925351+0000","last_clean":"2024-04-18T21:10:25.925351+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:25.925351+0000","last_undegraded":"2024-04-18T21:10:25.925351+0000","last_fullsized":"2024-04-18T21:10:25.925351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:52.915809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":523,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246170+0000","last_change":"2024-04-18T21:10:26.246170+0000","last_active":"2024-04-18T21:10:26.246170+0000","last_peered":"2024-04-18T21:10:26.246170+0000","last_clean":"2024-04-18T21:10:26.246170+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:26.246170+0000","last_undegraded":"2024-04-18T21:10:26.246170+0000","last_fullsized":"2024-04-18T21:10:26.246170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:15:25.555562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924042+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:25.924042+0000","last_peered":"2024-04-18T21:10:25.924042+0000","last_clean":"2024-04-18T21:10:25.924042+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:25.924042+0000","last_undegraded":"2024-04-18T21:10:25.924042+0000","last_fullsized":"2024-04-18T21:10:25.924042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:13:05.593760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924001+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:25.924001+0000","last_peered":"2024-04-18T21:10:25.924001+0000","last_clean":"2024-04-18T21:10:25.924001+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:25.924001+0000","last_undegraded":"2024-04-18T21:10:25.924001+0000","last_fullsized":"2024-04-18T21:10:25.924001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:10.806750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245509+0000","last_change":"2024-04-18T21:10:26.245509+0000","last_active":"2024-04-18T21:10:26.245509+0000","last_peered":"2024-04-18T21:10:26.245509+0000","last_clean":"2024-04-18T21:10:26.245509+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:26.245509+0000","last_undegraded":"2024-04-18T21:10:26.245509+0000","last_fullsized":"2024-04-18T21:10:26.245509+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:39:57.418653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":653,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217549+0000","last_change":"2024-04-18T21:10:26.217549+0000","last_active":"2024-04-18T21:10:26.217549+0000","last_peered":"2024-04-18T21:10:26.217549+0000","last_clean":"2024-04-18T21:10:26.217549+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:26.217549+0000","last_undegraded":"2024-04-18T21:10:26.217549+0000","last_fullsized":"2024-04-18T21:10:26.217549+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:56.883654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247208+0000","last_change":"2024-04-18T21:10:26.247208+0000","last_active":"2024-04-18T21:10:26.247208+0000","last_peered":"2024-04-18T21:10:26.247208+0000","last_clean":"2024-04-18T21:10:26.247208+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:10:26.247208+0000","last_undegraded":"2024-04-18T21:10:26.247208+0000","last_fullsized":"2024-04-18T21:10:26.247208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:41:32.330659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":591,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929959+0000","last_change":"2024-04-18T21:05:08.606926+0000","last_active":"2024-04-18T21:10:25.929959+0000","last_peered":"2024-04-18T21:10:25.929959+0000","last_clean":"2024-04-18T21:10:25.929959+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:25.929959+0000","last_undegraded":"2024-04-18T21:10:25.929959+0000","last_fullsized":"2024-04-18T21:10:25.929959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925499+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:25.925499+0000","last_peered":"2024-04-18T21:10:25.925499+0000","last_clean":"2024-04-18T21:10:25.925499+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:25.925499+0000","last_undegraded":"2024-04-18T21:10:25.925499+0000","last_fullsized":"2024-04-18T21:10:25.925499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:46.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928008+0000","last_change":"2024-04-18T21:05:08.604724+0000","last_active":"2024-04-18T21:10:25.928008+0000","last_peered":"2024-04-18T21:10:25.928008+0000","last_clean":"2024-04-18T21:10:25.928008+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:25.928008+0000","last_undegraded":"2024-04-18T21:10:25.928008+0000","last_fullsized":"2024-04-18T21:10:25.928008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:31.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":587,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.236946+0000","last_change":"2024-04-18T21:10:26.236946+0000","last_active":"2024-04-18T21:10:26.236946+0000","last_peered":"2024-04-18T21:10:26.236946+0000","last_clean":"2024-04-18T21:10:26.236946+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:26.236946+0000","last_undegraded":"2024-04-18T21:10:26.236946+0000","last_fullsized":"2024-04-18T21:10:26.236946+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:02.167729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":534,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240953+0000","last_change":"2024-04-18T21:10:26.240953+0000","last_active":"2024-04-18T21:10:26.240953+0000","last_peered":"2024-04-18T21:10:26.240953+0000","last_clean":"2024-04-18T21:10:26.240953+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:26.240953+0000","last_undegraded":"2024-04-18T21:10:26.240953+0000","last_fullsized":"2024-04-18T21:10:26.240953+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:34.504144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923664+0000","last_change":"2024-04-18T21:10:16.898195+0000","last_active":"2024-04-18T21:10:25.923664+0000","last_peered":"2024-04-18T21:10:25.923664+0000","last_clean":"2024-04-18T21:10:25.923664+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:25.923664+0000","last_undegraded":"2024-04-18T21:10:25.923664+0000","last_fullsized":"2024-04-18T21:10:25.923664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:23:01.706652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927370+0000","last_change":"2024-04-18T21:10:16.886848+0000","last_active":"2024-04-18T21:10:25.927370+0000","last_peered":"2024-04-18T21:10:25.927370+0000","last_clean":"2024-04-18T21:10:25.927370+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:25.927370+0000","last_undegraded":"2024-04-18T21:10:25.927370+0000","last_fullsized":"2024-04-18T21:10:25.927370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:19.106878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923000+0000","last_change":"2024-04-18T21:10:23.936177+0000","last_active":"2024-04-18T21:10:25.923000+0000","last_peered":"2024-04-18T21:10:25.923000+0000","last_clean":"2024-04-18T21:10:25.923000+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:25.923000+0000","last_undegraded":"2024-04-18T21:10:25.923000+0000","last_fullsized":"2024-04-18T21:10:25.923000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925602+0000","last_change":"2024-04-18T21:10:16.880278+0000","last_active":"2024-04-18T21:10:25.925602+0000","last_peered":"2024-04-18T21:10:25.925602+0000","last_clean":"2024-04-18T21:10:25.925602+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:25.925602+0000","last_undegraded":"2024-04-18T21:10:25.925602+0000","last_fullsized":"2024-04-18T21:10:25.925602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:06.948311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":742,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928662+0000","last_change":"2024-04-18T21:10:16.880064+0000","last_active":"2024-04-18T21:10:25.928662+0000","last_peered":"2024-04-18T21:10:25.928662+0000","last_clean":"2024-04-18T21:10:25.928662+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:25.928662+0000","last_undegraded":"2024-04-18T21:10:25.928662+0000","last_fullsized":"2024-04-18T21:10:25.928662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:49:53.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":590,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249191+0000","last_change":"2024-04-18T21:10:26.249191+0000","last_active":"2024-04-18T21:10:26.249191+0000","last_peered":"2024-04-18T21:10:26.249191+0000","last_clean":"2024-04-18T21:10:26.249191+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:10:26.249191+0000","last_undegraded":"2024-04-18T21:10:26.249191+0000","last_fullsized":"2024-04-18T21:10:26.249191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:51.151882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":649,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925210+0000","last_change":"2024-04-18T21:10:16.878934+0000","last_active":"2024-04-18T21:10:25.925210+0000","last_peered":"2024-04-18T21:10:25.925210+0000","last_clean":"2024-04-18T21:10:25.925210+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:25.925210+0000","last_undegraded":"2024-04-18T21:10:25.925210+0000","last_fullsized":"2024-04-18T21:10:25.925210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:36.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929537+0000","last_change":"2024-04-18T21:05:08.601488+0000","last_active":"2024-04-18T21:10:25.929537+0000","last_peered":"2024-04-18T21:10:25.929537+0000","last_clean":"2024-04-18T21:10:25.929537+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:25.929537+0000","last_undegraded":"2024-04-18T21:10:25.929537+0000","last_fullsized":"2024-04-18T21:10:25.929537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:36:55.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":693,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924601+0000","last_change":"2024-04-18T21:10:16.898451+0000","last_active":"2024-04-18T21:10:25.924601+0000","last_peered":"2024-04-18T21:10:25.924601+0000","last_clean":"2024-04-18T21:10:25.924601+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:25.924601+0000","last_undegraded":"2024-04-18T21:10:25.924601+0000","last_fullsized":"2024-04-18T21:10:25.924601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:35:05.034682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":663,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927670+0000","last_change":"2024-04-18T21:05:08.602947+0000","last_active":"2024-04-18T21:10:25.927670+0000","last_peered":"2024-04-18T21:10:25.927670+0000","last_clean":"2024-04-18T21:10:25.927670+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:25.927670+0000","last_undegraded":"2024-04-18T21:10:25.927670+0000","last_fullsized":"2024-04-18T21:10:25.927670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:51:15.534361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":607,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246845+0000","last_change":"2024-04-18T21:10:26.246845+0000","last_active":"2024-04-18T21:10:26.246845+0000","last_peered":"2024-04-18T21:10:26.246845+0000","last_clean":"2024-04-18T21:10:26.246845+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:10:26.246845+0000","last_undegraded":"2024-04-18T21:10:26.246845+0000","last_fullsized":"2024-04-18T21:10:26.246845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:22:45.054487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924405+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:25.924405+0000","last_peered":"2024-04-18T21:10:25.924405+0000","last_clean":"2024-04-18T21:10:25.924405+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:25.924405+0000","last_undegraded":"2024-04-18T21:10:25.924405+0000","last_fullsized":"2024-04-18T21:10:25.924405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.707885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":628,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.210475+0000","last_change":"2024-04-18T21:10:26.210475+0000","last_active":"2024-04-18T21:10:26.210475+0000","last_peered":"2024-04-18T21:10:26.210475+0000","last_clean":"2024-04-18T21:10:26.210475+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:10:26.210475+0000","last_undegraded":"2024-04-18T21:10:26.210475+0000","last_fullsized":"2024-04-18T21:10:26.210475+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:55.667421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":585,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925203+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:25.925203+0000","last_peered":"2024-04-18T21:10:25.925203+0000","last_clean":"2024-04-18T21:10:25.925203+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:25.925203+0000","last_undegraded":"2024-04-18T21:10:25.925203+0000","last_fullsized":"2024-04-18T21:10:25.925203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:45:24.638448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":218,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929804+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:25.929804+0000","last_peered":"2024-04-18T21:10:25.929804+0000","last_clean":"2024-04-18T21:10:25.929804+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:25.929804+0000","last_undegraded":"2024-04-18T21:10:25.929804+0000","last_fullsized":"2024-04-18T21:10:25.929804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:37.458198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":622,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929193+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:25.929193+0000","last_peered":"2024-04-18T21:10:25.929193+0000","last_clean":"2024-04-18T21:10:25.929193+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:25.929193+0000","last_undegraded":"2024-04-18T21:10:25.929193+0000","last_fullsized":"2024-04-18T21:10:25.929193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:17.343519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923744+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:25.923744+0000","last_peered":"2024-04-18T21:10:25.923744+0000","last_clean":"2024-04-18T21:10:25.923744+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:25.923744+0000","last_undegraded":"2024-04-18T21:10:25.923744+0000","last_fullsized":"2024-04-18T21:10:25.923744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:47.742037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":614,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929063+0000","last_change":"2024-04-18T21:10:16.881834+0000","last_active":"2024-04-18T21:10:25.929063+0000","last_peered":"2024-04-18T21:10:25.929063+0000","last_clean":"2024-04-18T21:10:25.929063+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:25.929063+0000","last_undegraded":"2024-04-18T21:10:25.929063+0000","last_fullsized":"2024-04-18T21:10:25.929063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:42.089576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247708+0000","last_change":"2024-04-18T21:10:26.247708+0000","last_active":"2024-04-18T21:10:26.247708+0000","last_peered":"2024-04-18T21:10:26.247708+0000","last_clean":"2024-04-18T21:10:26.247708+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:10:26.247708+0000","last_undegraded":"2024-04-18T21:10:26.247708+0000","last_fullsized":"2024-04-18T21:10:26.247708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:33.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.215608+0000","last_change":"2024-04-18T21:10:26.215608+0000","last_active":"2024-04-18T21:10:26.215608+0000","last_peered":"2024-04-18T21:10:26.215608+0000","last_clean":"2024-04-18T21:10:26.215608+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:26.215608+0000","last_undegraded":"2024-04-18T21:10:26.215608+0000","last_fullsized":"2024-04-18T21:10:26.215608+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:08.549962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":606,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923281+0000","last_change":"2024-04-18T21:10:16.888020+0000","last_active":"2024-04-18T21:10:25.923281+0000","last_peered":"2024-04-18T21:10:25.923281+0000","last_clean":"2024-04-18T21:10:25.923281+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:25.923281+0000","last_undegraded":"2024-04-18T21:10:25.923281+0000","last_fullsized":"2024-04-18T21:10:25.923281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:28.103987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":449,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925960+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:25.925960+0000","last_peered":"2024-04-18T21:10:25.925960+0000","last_clean":"2024-04-18T21:10:25.925960+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:25.925960+0000","last_undegraded":"2024-04-18T21:10:25.925960+0000","last_fullsized":"2024-04-18T21:10:25.925960+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:35.702695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":646,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923351+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:25.923351+0000","last_peered":"2024-04-18T21:10:25.923351+0000","last_clean":"2024-04-18T21:10:25.923351+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:25.923351+0000","last_undegraded":"2024-04-18T21:10:25.923351+0000","last_fullsized":"2024-04-18T21:10:25.923351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:10.207151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'558","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241764+0000","last_change":"2024-04-18T21:10:26.241764+0000","last_active":"2024-04-18T21:10:26.241764+0000","last_peered":"2024-04-18T21:10:26.241764+0000","last_clean":"2024-04-18T21:10:26.241764+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:26.241764+0000","last_undegraded":"2024-04-18T21:10:26.241764+0000","last_fullsized":"2024-04-18T21:10:26.241764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:23.849579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":699,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244945+0000","last_change":"2024-04-18T21:10:26.244945+0000","last_active":"2024-04-18T21:10:26.244945+0000","last_peered":"2024-04-18T21:10:26.244945+0000","last_clean":"2024-04-18T21:10:26.244945+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:26.244945+0000","last_undegraded":"2024-04-18T21:10:26.244945+0000","last_fullsized":"2024-04-18T21:10:26.244945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:55:28.759810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232672+0000","last_change":"2024-04-18T21:10:26.232672+0000","last_active":"2024-04-18T21:10:26.232672+0000","last_peered":"2024-04-18T21:10:26.232672+0000","last_clean":"2024-04-18T21:10:26.232672+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:26.232672+0000","last_undegraded":"2024-04-18T21:10:26.232672+0000","last_fullsized":"2024-04-18T21:10:26.232672+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:05.720217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":700,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929763+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:25.929763+0000","last_peered":"2024-04-18T21:10:25.929763+0000","last_clean":"2024-04-18T21:10:25.929763+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:25.929763+0000","last_undegraded":"2024-04-18T21:10:25.929763+0000","last_fullsized":"2024-04-18T21:10:25.929763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:45.678317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":336,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930053+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:25.930053+0000","last_peered":"2024-04-18T21:10:25.930053+0000","last_clean":"2024-04-18T21:10:25.930053+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:25.930053+0000","last_undegraded":"2024-04-18T21:10:25.930053+0000","last_fullsized":"2024-04-18T21:10:25.930053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:28.842868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":625,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243532+0000","last_change":"2024-04-18T21:10:26.243532+0000","last_active":"2024-04-18T21:10:26.243532+0000","last_peered":"2024-04-18T21:10:26.243532+0000","last_clean":"2024-04-18T21:10:26.243532+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:26.243532+0000","last_undegraded":"2024-04-18T21:10:26.243532+0000","last_fullsized":"2024-04-18T21:10:26.243532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:33.927803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"72'111","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.242580+0000","last_change":"2024-04-18T21:10:26.242580+0000","last_active":"2024-04-18T21:10:26.242580+0000","last_peered":"2024-04-18T21:10:26.242580+0000","last_clean":"2024-04-18T21:10:26.242580+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:26.242580+0000","last_undegraded":"2024-04-18T21:10:26.242580+0000","last_fullsized":"2024-04-18T21:10:26.242580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:09.305905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.244330+0000","last_change":"2024-04-18T21:10:26.244330+0000","last_active":"2024-04-18T21:10:26.244330+0000","last_peered":"2024-04-18T21:10:26.244330+0000","last_clean":"2024-04-18T21:10:26.244330+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:26.244330+0000","last_undegraded":"2024-04-18T21:10:26.244330+0000","last_fullsized":"2024-04-18T21:10:26.244330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:35.084780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924020+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:25.924020+0000","last_peered":"2024-04-18T21:10:25.924020+0000","last_clean":"2024-04-18T21:10:25.924020+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:25.924020+0000","last_undegraded":"2024-04-18T21:10:25.924020+0000","last_fullsized":"2024-04-18T21:10:25.924020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:20.386639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":524,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.217877+0000","last_change":"2024-04-18T21:10:26.217877+0000","last_active":"2024-04-18T21:10:26.217877+0000","last_peered":"2024-04-18T21:10:26.217877+0000","last_clean":"2024-04-18T21:10:26.217877+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:26.217877+0000","last_undegraded":"2024-04-18T21:10:26.217877+0000","last_fullsized":"2024-04-18T21:10:26.217877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:04:08.598032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"72'470","reported_seq":556,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923265+0000","last_change":"2024-04-18T21:10:23.934354+0000","last_active":"2024-04-18T21:10:25.923265+0000","last_peered":"2024-04-18T21:10:25.923265+0000","last_clean":"2024-04-18T21:10:25.923265+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:25.923265+0000","last_undegraded":"2024-04-18T21:10:25.923265+0000","last_fullsized":"2024-04-18T21:10:25.923265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:41.080121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":674,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929415+0000","last_change":"2024-04-18T21:05:08.606385+0000","last_active":"2024-04-18T21:10:25.929415+0000","last_peered":"2024-04-18T21:10:25.929415+0000","last_clean":"2024-04-18T21:10:25.929415+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:25.929415+0000","last_undegraded":"2024-04-18T21:10:25.929415+0000","last_fullsized":"2024-04-18T21:10:25.929415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:38.323398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":326,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.200244+0000","last_change":"2024-04-18T21:10:26.200244+0000","last_active":"2024-04-18T21:10:26.200244+0000","last_peered":"2024-04-18T21:10:26.200244+0000","last_clean":"2024-04-18T21:10:26.200244+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:10:26.200244+0000","last_undegraded":"2024-04-18T21:10:26.200244+0000","last_fullsized":"2024-04-18T21:10:26.200244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:44.128206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.206570+0000","last_change":"2024-04-18T21:10:26.206570+0000","last_active":"2024-04-18T21:10:26.206570+0000","last_peered":"2024-04-18T21:10:26.206570+0000","last_clean":"2024-04-18T21:10:26.206570+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:10:26.206570+0000","last_undegraded":"2024-04-18T21:10:26.206570+0000","last_fullsized":"2024-04-18T21:10:26.206570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:30.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":504,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930412+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:25.930412+0000","last_peered":"2024-04-18T21:10:25.930412+0000","last_clean":"2024-04-18T21:10:25.930412+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:25.930412+0000","last_undegraded":"2024-04-18T21:10:25.930412+0000","last_fullsized":"2024-04-18T21:10:25.930412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:27.901820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":609,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245477+0000","last_change":"2024-04-18T21:10:26.245477+0000","last_active":"2024-04-18T21:10:26.245477+0000","last_peered":"2024-04-18T21:10:26.245477+0000","last_clean":"2024-04-18T21:10:26.245477+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:26.245477+0000","last_undegraded":"2024-04-18T21:10:26.245477+0000","last_fullsized":"2024-04-18T21:10:26.245477+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:49:33.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248163+0000","last_change":"2024-04-18T21:10:26.248163+0000","last_active":"2024-04-18T21:10:26.248163+0000","last_peered":"2024-04-18T21:10:26.248163+0000","last_clean":"2024-04-18T21:10:26.248163+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:10:26.248163+0000","last_undegraded":"2024-04-18T21:10:26.248163+0000","last_fullsized":"2024-04-18T21:10:26.248163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:38:13.436655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":353,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928209+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:25.928209+0000","last_peered":"2024-04-18T21:10:25.928209+0000","last_clean":"2024-04-18T21:10:25.928209+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:25.928209+0000","last_undegraded":"2024-04-18T21:10:25.928209+0000","last_fullsized":"2024-04-18T21:10:25.928209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:43:15.011999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":706,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925849+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:25.925849+0000","last_peered":"2024-04-18T21:10:25.925849+0000","last_clean":"2024-04-18T21:10:25.925849+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:25.925849+0000","last_undegraded":"2024-04-18T21:10:25.925849+0000","last_fullsized":"2024-04-18T21:10:25.925849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:05.807939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928973+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:25.928973+0000","last_peered":"2024-04-18T21:10:25.928973+0000","last_clean":"2024-04-18T21:10:25.928973+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:25.928973+0000","last_undegraded":"2024-04-18T21:10:25.928973+0000","last_fullsized":"2024-04-18T21:10:25.928973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:31.386453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"72'286","reported_seq":451,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923612+0000","last_change":"2024-04-18T21:10:16.887408+0000","last_active":"2024-04-18T21:10:25.923612+0000","last_peered":"2024-04-18T21:10:25.923612+0000","last_clean":"2024-04-18T21:10:25.923612+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:25.923612+0000","last_undegraded":"2024-04-18T21:10:25.923612+0000","last_fullsized":"2024-04-18T21:10:25.923612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:17:19.019204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924329+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:25.924329+0000","last_peered":"2024-04-18T21:10:25.924329+0000","last_clean":"2024-04-18T21:10:25.924329+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:25.924329+0000","last_undegraded":"2024-04-18T21:10:25.924329+0000","last_fullsized":"2024-04-18T21:10:25.924329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:49.393891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.227561+0000","last_change":"2024-04-18T21:10:26.227561+0000","last_active":"2024-04-18T21:10:26.227561+0000","last_peered":"2024-04-18T21:10:26.227561+0000","last_clean":"2024-04-18T21:10:26.227561+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:26.227561+0000","last_undegraded":"2024-04-18T21:10:26.227561+0000","last_fullsized":"2024-04-18T21:10:26.227561+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:48.634607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211170+0000","last_change":"2024-04-18T21:10:26.211170+0000","last_active":"2024-04-18T21:10:26.211170+0000","last_peered":"2024-04-18T21:10:26.211170+0000","last_clean":"2024-04-18T21:10:26.211170+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:10:26.211170+0000","last_undegraded":"2024-04-18T21:10:26.211170+0000","last_fullsized":"2024-04-18T21:10:26.211170+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:52.690052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928343+0000","last_change":"2024-04-18T21:05:08.605765+0000","last_active":"2024-04-18T21:10:25.928343+0000","last_peered":"2024-04-18T21:10:25.928343+0000","last_clean":"2024-04-18T21:10:25.928343+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:25.928343+0000","last_undegraded":"2024-04-18T21:10:25.928343+0000","last_fullsized":"2024-04-18T21:10:25.928343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:52.787137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"72'252","reported_seq":293,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.240855+0000","last_change":"2024-04-18T21:10:26.240855+0000","last_active":"2024-04-18T21:10:26.240855+0000","last_peered":"2024-04-18T21:10:26.240855+0000","last_clean":"2024-04-18T21:10:26.240855+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:26.240855+0000","last_undegraded":"2024-04-18T21:10:26.240855+0000","last_fullsized":"2024-04-18T21:10:26.240855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.992598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928666+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:25.928666+0000","last_peered":"2024-04-18T21:10:25.928666+0000","last_clean":"2024-04-18T21:10:25.928666+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:25.928666+0000","last_undegraded":"2024-04-18T21:10:25.928666+0000","last_fullsized":"2024-04-18T21:10:25.928666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:17:16.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924591+0000","last_change":"2024-04-18T21:10:16.896913+0000","last_active":"2024-04-18T21:10:25.924591+0000","last_peered":"2024-04-18T21:10:25.924591+0000","last_clean":"2024-04-18T21:10:25.924591+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:25.924591+0000","last_undegraded":"2024-04-18T21:10:25.924591+0000","last_fullsized":"2024-04-18T21:10:25.924591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:37.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928454+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:25.928454+0000","last_peered":"2024-04-18T21:10:25.928454+0000","last_clean":"2024-04-18T21:10:25.928454+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:25.928454+0000","last_undegraded":"2024-04-18T21:10:25.928454+0000","last_fullsized":"2024-04-18T21:10:25.928454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:32.024443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926476+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:25.926476+0000","last_peered":"2024-04-18T21:10:25.926476+0000","last_clean":"2024-04-18T21:10:25.926476+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:25.926476+0000","last_undegraded":"2024-04-18T21:10:25.926476+0000","last_fullsized":"2024-04-18T21:10:25.926476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:56.258389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":589,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926856+0000","last_change":"2024-04-18T21:06:57.675242+0000","last_active":"2024-04-18T21:10:25.926856+0000","last_peered":"2024-04-18T21:10:25.926856+0000","last_clean":"2024-04-18T21:10:25.926856+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:25.926856+0000","last_undegraded":"2024-04-18T21:10:25.926856+0000","last_fullsized":"2024-04-18T21:10:25.926856+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:46.463311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":221,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930233+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:25.930233+0000","last_peered":"2024-04-18T21:10:25.930233+0000","last_clean":"2024-04-18T21:10:25.930233+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:25.930233+0000","last_undegraded":"2024-04-18T21:10:25.930233+0000","last_fullsized":"2024-04-18T21:10:25.930233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:50:24.712694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929500+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:25.929500+0000","last_peered":"2024-04-18T21:10:25.929500+0000","last_clean":"2024-04-18T21:10:25.929500+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:25.929500+0000","last_undegraded":"2024-04-18T21:10:25.929500+0000","last_fullsized":"2024-04-18T21:10:25.929500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:04.241230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":561,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928548+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:25.928548+0000","last_peered":"2024-04-18T21:10:25.928548+0000","last_clean":"2024-04-18T21:10:25.928548+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:25.928548+0000","last_undegraded":"2024-04-18T21:10:25.928548+0000","last_fullsized":"2024-04-18T21:10:25.928548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:25:51.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"74'109","reported_seq":241,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929493+0000","last_change":"2024-04-18T21:10:16.881696+0000","last_active":"2024-04-18T21:10:25.929493+0000","last_peered":"2024-04-18T21:10:25.929493+0000","last_clean":"2024-04-18T21:10:25.929493+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:25.929493+0000","last_undegraded":"2024-04-18T21:10:25.929493+0000","last_fullsized":"2024-04-18T21:10:25.929493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:51.906355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.214755+0000","last_change":"2024-04-18T21:10:26.214755+0000","last_active":"2024-04-18T21:10:26.214755+0000","last_peered":"2024-04-18T21:10:26.214755+0000","last_clean":"2024-04-18T21:10:26.214755+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:10:26.214755+0000","last_undegraded":"2024-04-18T21:10:26.214755+0000","last_fullsized":"2024-04-18T21:10:26.214755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:19:13.072569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":616,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923453+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:25.923453+0000","last_peered":"2024-04-18T21:10:25.923453+0000","last_clean":"2024-04-18T21:10:25.923453+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:25.923453+0000","last_undegraded":"2024-04-18T21:10:25.923453+0000","last_fullsized":"2024-04-18T21:10:25.923453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:58.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":633,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.241410+0000","last_change":"2024-04-18T21:10:26.241410+0000","last_active":"2024-04-18T21:10:26.241410+0000","last_peered":"2024-04-18T21:10:26.241410+0000","last_clean":"2024-04-18T21:10:26.241410+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:26.241410+0000","last_undegraded":"2024-04-18T21:10:26.241410+0000","last_fullsized":"2024-04-18T21:10:26.241410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:30.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":394,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.212269+0000","last_change":"2024-04-18T21:10:26.212269+0000","last_active":"2024-04-18T21:10:26.212269+0000","last_peered":"2024-04-18T21:10:26.212269+0000","last_clean":"2024-04-18T21:10:26.212269+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:10:26.212269+0000","last_undegraded":"2024-04-18T21:10:26.212269+0000","last_fullsized":"2024-04-18T21:10:26.212269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:48.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":569,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929263+0000","last_change":"2024-04-18T21:05:08.602453+0000","last_active":"2024-04-18T21:10:25.929263+0000","last_peered":"2024-04-18T21:10:25.929263+0000","last_clean":"2024-04-18T21:10:25.929263+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:25.929263+0000","last_undegraded":"2024-04-18T21:10:25.929263+0000","last_fullsized":"2024-04-18T21:10:25.929263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:36:52.185080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'77","reported_seq":242,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926053+0000","last_change":"2024-04-18T21:10:16.894192+0000","last_active":"2024-04-18T21:10:25.926053+0000","last_peered":"2024-04-18T21:10:25.926053+0000","last_clean":"2024-04-18T21:10:25.926053+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:25.926053+0000","last_undegraded":"2024-04-18T21:10:25.926053+0000","last_fullsized":"2024-04-18T21:10:25.926053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:32.048270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":266,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.205389+0000","last_change":"2024-04-18T21:10:26.205389+0000","last_active":"2024-04-18T21:10:26.205389+0000","last_peered":"2024-04-18T21:10:26.205389+0000","last_clean":"2024-04-18T21:10:26.205389+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:10:26.205389+0000","last_undegraded":"2024-04-18T21:10:26.205389+0000","last_fullsized":"2024-04-18T21:10:26.205389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:13.325246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":668,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927796+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:25.927796+0000","last_peered":"2024-04-18T21:10:25.927796+0000","last_clean":"2024-04-18T21:10:25.927796+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:25.927796+0000","last_undegraded":"2024-04-18T21:10:25.927796+0000","last_fullsized":"2024-04-18T21:10:25.927796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":228,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929949+0000","last_change":"2024-04-18T21:10:16.875606+0000","last_active":"2024-04-18T21:10:25.929949+0000","last_peered":"2024-04-18T21:10:25.929949+0000","last_clean":"2024-04-18T21:10:25.929949+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:25.929949+0000","last_undegraded":"2024-04-18T21:10:25.929949+0000","last_fullsized":"2024-04-18T21:10:25.929949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:13.760813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":620,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928270+0000","last_change":"2024-04-18T21:05:08.604528+0000","last_active":"2024-04-18T21:10:25.928270+0000","last_peered":"2024-04-18T21:10:25.928270+0000","last_clean":"2024-04-18T21:10:25.928270+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:25.928270+0000","last_undegraded":"2024-04-18T21:10:25.928270+0000","last_fullsized":"2024-04-18T21:10:25.928270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:07.649892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925894+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:25.925894+0000","last_peered":"2024-04-18T21:10:25.925894+0000","last_clean":"2024-04-18T21:10:25.925894+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:25.925894+0000","last_undegraded":"2024-04-18T21:10:25.925894+0000","last_fullsized":"2024-04-18T21:10:25.925894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:46:13.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":774,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929075+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:25.929075+0000","last_peered":"2024-04-18T21:10:25.929075+0000","last_clean":"2024-04-18T21:10:25.929075+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:25.929075+0000","last_undegraded":"2024-04-18T21:10:25.929075+0000","last_fullsized":"2024-04-18T21:10:25.929075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:15.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":583,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928898+0000","last_change":"2024-04-18T21:10:16.882325+0000","last_active":"2024-04-18T21:10:25.928898+0000","last_peered":"2024-04-18T21:10:25.928898+0000","last_clean":"2024-04-18T21:10:25.928898+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:25.928898+0000","last_undegraded":"2024-04-18T21:10:25.928898+0000","last_fullsized":"2024-04-18T21:10:25.928898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:35:14.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":371,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928125+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:25.928125+0000","last_peered":"2024-04-18T21:10:25.928125+0000","last_clean":"2024-04-18T21:10:25.928125+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:25.928125+0000","last_undegraded":"2024-04-18T21:10:25.928125+0000","last_fullsized":"2024-04-18T21:10:25.928125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:48.952185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925068+0000","last_change":"2024-04-18T21:10:16.894529+0000","last_active":"2024-04-18T21:10:25.925068+0000","last_peered":"2024-04-18T21:10:25.925068+0000","last_clean":"2024-04-18T21:10:25.925068+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:25.925068+0000","last_undegraded":"2024-04-18T21:10:25.925068+0000","last_fullsized":"2024-04-18T21:10:25.925068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:59:21.002316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"74'186","reported_seq":292,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924947+0000","last_change":"2024-04-18T21:10:23.925929+0000","last_active":"2024-04-18T21:10:25.924947+0000","last_peered":"2024-04-18T21:10:25.924947+0000","last_clean":"2024-04-18T21:10:25.924947+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:25.924947+0000","last_undegraded":"2024-04-18T21:10:25.924947+0000","last_fullsized":"2024-04-18T21:10:25.924947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:31.838984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":563,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924552+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:25.924552+0000","last_peered":"2024-04-18T21:10:25.924552+0000","last_clean":"2024-04-18T21:10:25.924552+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:25.924552+0000","last_undegraded":"2024-04-18T21:10:25.924552+0000","last_fullsized":"2024-04-18T21:10:25.924552+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:16.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'57","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924602+0000","last_change":"2024-04-18T21:10:16.887977+0000","last_active":"2024-04-18T21:10:25.924602+0000","last_peered":"2024-04-18T21:10:25.924602+0000","last_clean":"2024-04-18T21:10:25.924602+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:25.924602+0000","last_undegraded":"2024-04-18T21:10:25.924602+0000","last_fullsized":"2024-04-18T21:10:25.924602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:32:00.227576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":528,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.232566+0000","last_change":"2024-04-18T21:10:26.232566+0000","last_active":"2024-04-18T21:10:26.232566+0000","last_peered":"2024-04-18T21:10:26.232566+0000","last_clean":"2024-04-18T21:10:26.232566+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:26.232566+0000","last_undegraded":"2024-04-18T21:10:26.232566+0000","last_fullsized":"2024-04-18T21:10:26.232566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:07.336018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":252,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.211599+0000","last_change":"2024-04-18T21:10:26.211599+0000","last_active":"2024-04-18T21:10:26.211599+0000","last_peered":"2024-04-18T21:10:26.211599+0000","last_clean":"2024-04-18T21:10:26.211599+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:10:26.211599+0000","last_undegraded":"2024-04-18T21:10:26.211599+0000","last_fullsized":"2024-04-18T21:10:26.211599+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:05:13.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.243246+0000","last_change":"2024-04-18T21:10:26.243246+0000","last_active":"2024-04-18T21:10:26.243246+0000","last_peered":"2024-04-18T21:10:26.243246+0000","last_clean":"2024-04-18T21:10:26.243246+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:26.243246+0000","last_undegraded":"2024-04-18T21:10:26.243246+0000","last_fullsized":"2024-04-18T21:10:26.243246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:27.471789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"72'191","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925518+0000","last_change":"2024-04-18T21:10:16.892079+0000","last_active":"2024-04-18T21:10:25.925518+0000","last_peered":"2024-04-18T21:10:25.925518+0000","last_clean":"2024-04-18T21:10:25.925518+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:25.925518+0000","last_undegraded":"2024-04-18T21:10:25.925518+0000","last_fullsized":"2024-04-18T21:10:25.925518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:47:42.225039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924334+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:25.924334+0000","last_peered":"2024-04-18T21:10:25.924334+0000","last_clean":"2024-04-18T21:10:25.924334+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:25.924334+0000","last_undegraded":"2024-04-18T21:10:25.924334+0000","last_fullsized":"2024-04-18T21:10:25.924334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:39.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":330,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928940+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:25.928940+0000","last_peered":"2024-04-18T21:10:25.928940+0000","last_clean":"2024-04-18T21:10:25.928940+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:25.928940+0000","last_undegraded":"2024-04-18T21:10:25.928940+0000","last_fullsized":"2024-04-18T21:10:25.928940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:11.294469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":603,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.247398+0000","last_change":"2024-04-18T21:10:26.247398+0000","last_active":"2024-04-18T21:10:26.247398+0000","last_peered":"2024-04-18T21:10:26.247398+0000","last_clean":"2024-04-18T21:10:26.247398+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:10:26.247398+0000","last_undegraded":"2024-04-18T21:10:26.247398+0000","last_fullsized":"2024-04-18T21:10:26.247398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:43.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"72'59","reported_seq":224,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929751+0000","last_change":"2024-04-18T21:10:16.873503+0000","last_active":"2024-04-18T21:10:25.929751+0000","last_peered":"2024-04-18T21:10:25.929751+0000","last_clean":"2024-04-18T21:10:25.929751+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:25.929751+0000","last_undegraded":"2024-04-18T21:10:25.929751+0000","last_fullsized":"2024-04-18T21:10:25.929751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:11:48.093089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103664,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268176,"statfs":{"total":96636764160,"available":96530612224,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738441,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103552,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268288,"statfs":{"total":96636764160,"available":96530726912,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350982,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58540,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313300,"statfs":{"total":96636764160,"available":96576819200,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:39.321 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.322 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.323 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.324 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.325 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.326 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.327 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.327 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.327 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.327 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.327 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.327 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.327 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T21:04:56.492371+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=56, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.328 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.329 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.330 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.331 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.332 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.333 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.334 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:39.334 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T21:10:59.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:59.645 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:10:59.649 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:10:59.663 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-04-18T21:10:57.745054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33010,"ondisk_log_size":33010,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265728,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849792,"statfs":{"total":289910292480,"available":289638187008,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004241"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":584,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925431+0000","last_change":"2024-04-18T21:10:23.940549+0000","last_active":"2024-04-18T21:10:25.925431+0000","last_peered":"2024-04-18T21:10:25.925431+0000","last_clean":"2024-04-18T21:10:25.925431+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:10:25.925431+0000","last_undegraded":"2024-04-18T21:10:25.925431+0000","last_fullsized":"2024-04-18T21:10:25.925431+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":619,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.148595+0000","last_change":"2024-04-18T21:10:54.148662+0000","last_active":"2024-04-18T21:10:54.148595+0000","last_peered":"2024-04-18T21:10:54.148595+0000","last_clean":"2024-04-18T21:10:54.148595+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:54.148595+0000","last_undegraded":"2024-04-18T21:10:54.148595+0000","last_fullsized":"2024-04-18T21:10:54.148595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'430","last_scrub_stamp":"2024-04-18T21:10:54.148404+0000","last_deep_scrub":"74'430","last_deep_scrub_stamp":"2024-04-18T21:10:54.148404+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.148404+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:09:54.547034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249910+0000","last_change":"2024-04-18T21:10:26.249269+0000","last_active":"2024-04-18T21:10:26.249910+0000","last_peered":"2024-04-18T21:10:26.249910+0000","last_clean":"2024-04-18T21:10:26.249910+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:10:26.249910+0000","last_undegraded":"2024-04-18T21:10:26.249910+0000","last_fullsized":"2024-04-18T21:10:26.249910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245877+0000","last_change":"2024-04-18T21:10:26.243242+0000","last_active":"2024-04-18T21:10:26.245877+0000","last_peered":"2024-04-18T21:10:26.245877+0000","last_clean":"2024-04-18T21:10:26.245877+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:26.245877+0000","last_undegraded":"2024-04-18T21:10:26.245877+0000","last_fullsized":"2024-04-18T21:10:26.245877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":621,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.096084+0000","last_change":"2024-04-18T21:10:50.096147+0000","last_active":"2024-04-18T21:10:50.096084+0000","last_peered":"2024-04-18T21:10:50.096084+0000","last_clean":"2024-04-18T21:10:50.096084+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:50.096084+0000","last_undegraded":"2024-04-18T21:10:50.096084+0000","last_fullsized":"2024-04-18T21:10:50.096084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'445","last_scrub_stamp":"2024-04-18T21:10:50.095884+0000","last_deep_scrub":"74'445","last_deep_scrub_stamp":"2024-04-18T21:10:50.095884+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.095884+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:39.544011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":552,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.246004+0000","last_change":"2024-04-18T21:10:26.244103+0000","last_active":"2024-04-18T21:10:26.246004+0000","last_peered":"2024-04-18T21:10:26.246004+0000","last_clean":"2024-04-18T21:10:26.246004+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:10:26.246004+0000","last_undegraded":"2024-04-18T21:10:26.246004+0000","last_fullsized":"2024-04-18T21:10:26.246004+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":605,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.438733+0000","last_change":"2024-04-18T21:10:53.438860+0000","last_active":"2024-04-18T21:10:53.438733+0000","last_peered":"2024-04-18T21:10:53.438733+0000","last_clean":"2024-04-18T21:10:53.438733+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:53.438733+0000","last_undegraded":"2024-04-18T21:10:53.438733+0000","last_fullsized":"2024-04-18T21:10:53.438733+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'414","last_scrub_stamp":"2024-04-18T21:10:53.438520+0000","last_deep_scrub":"74'414","last_deep_scrub_stamp":"2024-04-18T21:10:53.438520+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.438520+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:26.410323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.547439+0000","last_change":"2024-04-18T21:10:42.547623+0000","last_active":"2024-04-18T21:10:42.547439+0000","last_peered":"2024-04-18T21:10:42.547439+0000","last_clean":"2024-04-18T21:10:42.547439+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:42.547439+0000","last_undegraded":"2024-04-18T21:10:42.547439+0000","last_fullsized":"2024-04-18T21:10:42.547439+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'371","last_scrub_stamp":"2024-04-18T21:10:42.547204+0000","last_deep_scrub":"74'371","last_deep_scrub_stamp":"2024-04-18T21:10:42.547204+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.547204+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:22.049656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":670,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.975806+0000","last_change":"2024-04-18T21:10:44.975956+0000","last_active":"2024-04-18T21:10:44.975806+0000","last_peered":"2024-04-18T21:10:44.975806+0000","last_clean":"2024-04-18T21:10:44.975806+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:44.975806+0000","last_undegraded":"2024-04-18T21:10:44.975806+0000","last_fullsized":"2024-04-18T21:10:44.975806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'447","last_scrub_stamp":"2024-04-18T21:10:44.975572+0000","last_deep_scrub":"74'447","last_deep_scrub_stamp":"2024-04-18T21:10:44.975572+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.975572+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:51.968653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":572,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925479+0000","last_change":"2024-04-18T21:10:23.934201+0000","last_active":"2024-04-18T21:10:25.925479+0000","last_peered":"2024-04-18T21:10:25.925479+0000","last_clean":"2024-04-18T21:10:25.925479+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:10:25.925479+0000","last_undegraded":"2024-04-18T21:10:25.925479+0000","last_fullsized":"2024-04-18T21:10:25.925479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":532,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.550773+0000","last_change":"2024-04-18T21:10:38.550838+0000","last_active":"2024-04-18T21:10:38.550773+0000","last_peered":"2024-04-18T21:10:38.550773+0000","last_clean":"2024-04-18T21:10:38.550773+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:38.550773+0000","last_undegraded":"2024-04-18T21:10:38.550773+0000","last_fullsized":"2024-04-18T21:10:38.550773+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'363","last_scrub_stamp":"2024-04-18T21:10:38.550569+0000","last_deep_scrub":"74'363","last_deep_scrub_stamp":"2024-04-18T21:10:38.550569+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.550569+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:26:33.879921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":567,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924178+0000","last_change":"2024-04-18T21:10:16.878490+0000","last_active":"2024-04-18T21:10:25.924178+0000","last_peered":"2024-04-18T21:10:25.924178+0000","last_clean":"2024-04-18T21:10:25.924178+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:10:25.924178+0000","last_undegraded":"2024-04-18T21:10:25.924178+0000","last_fullsized":"2024-04-18T21:10:25.924178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924144+0000","last_change":"2024-04-18T21:10:23.937991+0000","last_active":"2024-04-18T21:10:25.924144+0000","last_peered":"2024-04-18T21:10:25.924144+0000","last_clean":"2024-04-18T21:10:25.924144+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:10:25.924144+0000","last_undegraded":"2024-04-18T21:10:25.924144+0000","last_fullsized":"2024-04-18T21:10:25.924144+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":658,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.583492+0000","last_change":"2024-04-18T21:10:39.583556+0000","last_active":"2024-04-18T21:10:39.583492+0000","last_peered":"2024-04-18T21:10:39.583492+0000","last_clean":"2024-04-18T21:10:39.583492+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:39.583492+0000","last_undegraded":"2024-04-18T21:10:39.583492+0000","last_fullsized":"2024-04-18T21:10:39.583492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'447","last_scrub_stamp":"2024-04-18T21:10:39.583297+0000","last_deep_scrub":"74'447","last_deep_scrub_stamp":"2024-04-18T21:10:39.583297+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.583297+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:49.385471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":654,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.226300+0000","last_change":"2024-04-18T21:10:26.217549+0000","last_active":"2024-04-18T21:10:26.226300+0000","last_peered":"2024-04-18T21:10:26.226300+0000","last_clean":"2024-04-18T21:10:26.226300+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:26.226300+0000","last_undegraded":"2024-04-18T21:10:26.226300+0000","last_fullsized":"2024-04-18T21:10:26.226300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":635,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248408+0000","last_change":"2024-04-18T21:10:26.247208+0000","last_active":"2024-04-18T21:10:26.248408+0000","last_peered":"2024-04-18T21:10:26.248408+0000","last_clean":"2024-04-18T21:10:26.248408+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:10:26.248408+0000","last_undegraded":"2024-04-18T21:10:26.248408+0000","last_fullsized":"2024-04-18T21:10:26.248408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":600,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.003368+0000","last_change":"2024-04-18T21:10:40.003492+0000","last_active":"2024-04-18T21:10:40.003368+0000","last_peered":"2024-04-18T21:10:40.003368+0000","last_clean":"2024-04-18T21:10:40.003368+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:40.003368+0000","last_undegraded":"2024-04-18T21:10:40.003368+0000","last_fullsized":"2024-04-18T21:10:40.003368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'406","last_scrub_stamp":"2024-04-18T21:10:40.003117+0000","last_deep_scrub":"74'406","last_deep_scrub_stamp":"2024-04-18T21:10:40.003117+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.003117+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:44:57.788059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":600,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925647+0000","last_change":"2024-04-18T21:05:08.612904+0000","last_active":"2024-04-18T21:10:25.925647+0000","last_peered":"2024-04-18T21:10:25.925647+0000","last_clean":"2024-04-18T21:10:25.925647+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:25.925647+0000","last_undegraded":"2024-04-18T21:10:25.925647+0000","last_fullsized":"2024-04-18T21:10:25.925647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.930678+0000","last_change":"2024-04-18T21:10:46.930846+0000","last_active":"2024-04-18T21:10:46.930678+0000","last_peered":"2024-04-18T21:10:46.930678+0000","last_clean":"2024-04-18T21:10:46.930678+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:46.930678+0000","last_undegraded":"2024-04-18T21:10:46.930678+0000","last_fullsized":"2024-04-18T21:10:46.930678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'433","last_scrub_stamp":"2024-04-18T21:10:46.930433+0000","last_deep_scrub":"74'433","last_deep_scrub_stamp":"2024-04-18T21:10:46.930433+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.930433+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:50.595324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.526639+0000","last_change":"2024-04-18T21:10:45.526699+0000","last_active":"2024-04-18T21:10:45.526639+0000","last_peered":"2024-04-18T21:10:45.526639+0000","last_clean":"2024-04-18T21:10:45.526639+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:45.526639+0000","last_undegraded":"2024-04-18T21:10:45.526639+0000","last_fullsized":"2024-04-18T21:10:45.526639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'428","last_scrub_stamp":"2024-04-18T21:10:45.526444+0000","last_deep_scrub":"74'428","last_deep_scrub_stamp":"2024-04-18T21:10:45.526444+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.526444+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:43.905072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":543,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.568891+0000","last_change":"2024-04-18T21:10:46.569086+0000","last_active":"2024-04-18T21:10:46.568891+0000","last_peered":"2024-04-18T21:10:46.568891+0000","last_clean":"2024-04-18T21:10:46.568891+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:46.568891+0000","last_undegraded":"2024-04-18T21:10:46.568891+0000","last_fullsized":"2024-04-18T21:10:46.568891+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'394","last_scrub_stamp":"2024-04-18T21:10:46.568669+0000","last_deep_scrub":"74'394","last_deep_scrub_stamp":"2024-04-18T21:10:46.568669+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.568669+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:31.635467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":648,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.041366+0000","last_change":"2024-04-18T21:10:46.041430+0000","last_active":"2024-04-18T21:10:46.041366+0000","last_peered":"2024-04-18T21:10:46.041366+0000","last_clean":"2024-04-18T21:10:46.041366+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:46.041366+0000","last_undegraded":"2024-04-18T21:10:46.041366+0000","last_fullsized":"2024-04-18T21:10:46.041366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'438","last_scrub_stamp":"2024-04-18T21:10:46.041169+0000","last_deep_scrub":"74'438","last_deep_scrub_stamp":"2024-04-18T21:10:46.041169+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.041169+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:37:35.518757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":602,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.973027+0000","last_change":"2024-04-18T21:10:38.973088+0000","last_active":"2024-04-18T21:10:38.973027+0000","last_peered":"2024-04-18T21:10:38.973027+0000","last_clean":"2024-04-18T21:10:38.973027+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:38.973027+0000","last_undegraded":"2024-04-18T21:10:38.973027+0000","last_fullsized":"2024-04-18T21:10:38.973027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'409","last_scrub_stamp":"2024-04-18T21:10:38.972829+0000","last_deep_scrub":"74'409","last_deep_scrub_stamp":"2024-04-18T21:10:38.972829+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.972829+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:38:45.609509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.965485+0000","last_change":"2024-04-18T21:10:39.965566+0000","last_active":"2024-04-18T21:10:39.965485+0000","last_peered":"2024-04-18T21:10:39.965485+0000","last_clean":"2024-04-18T21:10:39.965485+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:39.965485+0000","last_undegraded":"2024-04-18T21:10:39.965485+0000","last_fullsized":"2024-04-18T21:10:39.965485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'439","last_scrub_stamp":"2024-04-18T21:10:39.965281+0000","last_deep_scrub":"74'439","last_deep_scrub_stamp":"2024-04-18T21:10:39.965281+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.965281+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:33.165098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.142702+0000","last_change":"2024-04-18T21:10:53.142770+0000","last_active":"2024-04-18T21:10:53.142702+0000","last_peered":"2024-04-18T21:10:53.142702+0000","last_clean":"2024-04-18T21:10:53.142702+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:53.142702+0000","last_undegraded":"2024-04-18T21:10:53.142702+0000","last_fullsized":"2024-04-18T21:10:53.142702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'423","last_scrub_stamp":"2024-04-18T21:10:53.142504+0000","last_deep_scrub":"74'423","last_deep_scrub_stamp":"2024-04-18T21:10:53.142504+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.142504+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:58.615614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":751,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.915238+0000","last_change":"2024-04-18T21:10:47.915305+0000","last_active":"2024-04-18T21:10:47.915238+0000","last_peered":"2024-04-18T21:10:47.915238+0000","last_clean":"2024-04-18T21:10:47.915238+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:47.915238+0000","last_undegraded":"2024-04-18T21:10:47.915238+0000","last_fullsized":"2024-04-18T21:10:47.915238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'493","last_scrub_stamp":"2024-04-18T21:10:47.915034+0000","last_deep_scrub":"74'493","last_deep_scrub_stamp":"2024-04-18T21:10:47.915034+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.915034+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:52:37.937061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":591,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249692+0000","last_change":"2024-04-18T21:10:26.249191+0000","last_active":"2024-04-18T21:10:26.249692+0000","last_peered":"2024-04-18T21:10:26.249692+0000","last_clean":"2024-04-18T21:10:26.249692+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:10:26.249692+0000","last_undegraded":"2024-04-18T21:10:26.249692+0000","last_fullsized":"2024-04-18T21:10:26.249692+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":658,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.194577+0000","last_change":"2024-04-18T21:10:55.194639+0000","last_active":"2024-04-18T21:10:55.194577+0000","last_peered":"2024-04-18T21:10:55.194577+0000","last_clean":"2024-04-18T21:10:55.194577+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:55.194577+0000","last_undegraded":"2024-04-18T21:10:55.194577+0000","last_fullsized":"2024-04-18T21:10:55.194577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:55.194373+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:55.194373+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.194373+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:19.827646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.104857+0000","last_change":"2024-04-18T21:10:55.104925+0000","last_active":"2024-04-18T21:10:55.104857+0000","last_peered":"2024-04-18T21:10:55.104857+0000","last_clean":"2024-04-18T21:10:55.104857+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:55.104857+0000","last_undegraded":"2024-04-18T21:10:55.104857+0000","last_fullsized":"2024-04-18T21:10:55.104857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'400","last_scrub_stamp":"2024-04-18T21:10:55.104654+0000","last_deep_scrub":"74'400","last_deep_scrub_stamp":"2024-04-18T21:10:55.104654+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.104654+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:33.637116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":702,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.062652+0000","last_change":"2024-04-18T21:10:48.062795+0000","last_active":"2024-04-18T21:10:48.062652+0000","last_peered":"2024-04-18T21:10:48.062652+0000","last_clean":"2024-04-18T21:10:48.062652+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:48.062652+0000","last_undegraded":"2024-04-18T21:10:48.062652+0000","last_fullsized":"2024-04-18T21:10:48.062652+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'472","last_scrub_stamp":"2024-04-18T21:10:48.062345+0000","last_deep_scrub":"74'472","last_deep_scrub_stamp":"2024-04-18T21:10:48.062345+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.062345+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:17:20.407753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":672,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.008960+0000","last_change":"2024-04-18T21:10:51.009025+0000","last_active":"2024-04-18T21:10:51.008960+0000","last_peered":"2024-04-18T21:10:51.008960+0000","last_clean":"2024-04-18T21:10:51.008960+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:51.008960+0000","last_undegraded":"2024-04-18T21:10:51.008960+0000","last_fullsized":"2024-04-18T21:10:51.008960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-04-18T21:10:51.008759+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-04-18T21:10:51.008759+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.008759+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:15.642032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":608,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248168+0000","last_change":"2024-04-18T21:10:26.246845+0000","last_active":"2024-04-18T21:10:26.248168+0000","last_peered":"2024-04-18T21:10:26.248168+0000","last_clean":"2024-04-18T21:10:26.248168+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:10:26.248168+0000","last_undegraded":"2024-04-18T21:10:26.248168+0000","last_fullsized":"2024-04-18T21:10:26.248168+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":581,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924857+0000","last_change":"2024-04-18T21:10:23.943225+0000","last_active":"2024-04-18T21:10:25.924857+0000","last_peered":"2024-04-18T21:10:25.924857+0000","last_clean":"2024-04-18T21:10:25.924857+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:10:25.924857+0000","last_undegraded":"2024-04-18T21:10:25.924857+0000","last_fullsized":"2024-04-18T21:10:25.924857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'642","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.231570+0000","last_change":"2024-04-18T21:10:26.210475+0000","last_active":"2024-04-18T21:10:26.231570+0000","last_peered":"2024-04-18T21:10:26.231570+0000","last_clean":"2024-04-18T21:10:26.231570+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:10:26.231570+0000","last_undegraded":"2024-04-18T21:10:26.231570+0000","last_fullsized":"2024-04-18T21:10:26.231570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":586,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925345+0000","last_change":"2024-04-18T21:10:23.930624+0000","last_active":"2024-04-18T21:10:25.925345+0000","last_peered":"2024-04-18T21:10:25.925345+0000","last_clean":"2024-04-18T21:10:25.925345+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:25.925345+0000","last_undegraded":"2024-04-18T21:10:25.925345+0000","last_fullsized":"2024-04-18T21:10:25.925345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":219,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929937+0000","last_change":"2024-04-18T21:10:16.902645+0000","last_active":"2024-04-18T21:10:25.929937+0000","last_peered":"2024-04-18T21:10:25.929937+0000","last_clean":"2024-04-18T21:10:25.929937+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:10:25.929937+0000","last_undegraded":"2024-04-18T21:10:25.929937+0000","last_fullsized":"2024-04-18T21:10:25.929937+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929305+0000","last_change":"2024-04-18T21:10:16.883096+0000","last_active":"2024-04-18T21:10:25.929305+0000","last_peered":"2024-04-18T21:10:25.929305+0000","last_clean":"2024-04-18T21:10:25.929305+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:10:25.929305+0000","last_undegraded":"2024-04-18T21:10:25.929305+0000","last_fullsized":"2024-04-18T21:10:25.929305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923877+0000","last_change":"2024-04-18T21:10:16.872735+0000","last_active":"2024-04-18T21:10:25.923877+0000","last_peered":"2024-04-18T21:10:25.923877+0000","last_clean":"2024-04-18T21:10:25.923877+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:10:25.923877+0000","last_undegraded":"2024-04-18T21:10:25.923877+0000","last_fullsized":"2024-04-18T21:10:25.923877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.040333+0000","last_change":"2024-04-18T21:10:52.040390+0000","last_active":"2024-04-18T21:10:52.040333+0000","last_peered":"2024-04-18T21:10:52.040333+0000","last_clean":"2024-04-18T21:10:52.040333+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:52.040333+0000","last_undegraded":"2024-04-18T21:10:52.040333+0000","last_fullsized":"2024-04-18T21:10:52.040333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'393","last_scrub_stamp":"2024-04-18T21:10:52.040136+0000","last_deep_scrub":"74'393","last_deep_scrub_stamp":"2024-04-18T21:10:52.040136+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.040136+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:43.808436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"72'64","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248498+0000","last_change":"2024-04-18T21:10:26.247708+0000","last_active":"2024-04-18T21:10:26.248498+0000","last_peered":"2024-04-18T21:10:26.248498+0000","last_clean":"2024-04-18T21:10:26.248498+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:10:26.248498+0000","last_undegraded":"2024-04-18T21:10:26.248498+0000","last_fullsized":"2024-04-18T21:10:26.248498+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"72'165","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.219207+0000","last_change":"2024-04-18T21:10:26.215608+0000","last_active":"2024-04-18T21:10:26.219207+0000","last_peered":"2024-04-18T21:10:26.219207+0000","last_clean":"2024-04-18T21:10:26.219207+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:26.219207+0000","last_undegraded":"2024-04-18T21:10:26.219207+0000","last_fullsized":"2024-04-18T21:10:26.219207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":615,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.071510+0000","last_change":"2024-04-18T21:10:49.071636+0000","last_active":"2024-04-18T21:10:49.071510+0000","last_peered":"2024-04-18T21:10:49.071510+0000","last_clean":"2024-04-18T21:10:49.071510+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:49.071510+0000","last_undegraded":"2024-04-18T21:10:49.071510+0000","last_fullsized":"2024-04-18T21:10:49.071510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'417","last_scrub_stamp":"2024-04-18T21:10:49.071274+0000","last_deep_scrub":"74'417","last_deep_scrub_stamp":"2024-04-18T21:10:49.071274+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.071274+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:56.434174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"72'284","reported_seq":450,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926097+0000","last_change":"2024-04-18T21:10:16.871883+0000","last_active":"2024-04-18T21:10:25.926097+0000","last_peered":"2024-04-18T21:10:25.926097+0000","last_clean":"2024-04-18T21:10:25.926097+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:10:25.926097+0000","last_undegraded":"2024-04-18T21:10:25.926097+0000","last_fullsized":"2024-04-18T21:10:25.926097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":647,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923484+0000","last_change":"2024-04-18T21:10:23.945271+0000","last_active":"2024-04-18T21:10:25.923484+0000","last_peered":"2024-04-18T21:10:25.923484+0000","last_clean":"2024-04-18T21:10:25.923484+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:10:25.923484+0000","last_undegraded":"2024-04-18T21:10:25.923484+0000","last_fullsized":"2024-04-18T21:10:25.923484+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"89'560","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.523223+0000","last_change":"2024-04-18T21:10:50.523296+0000","last_active":"2024-04-18T21:10:50.523223+0000","last_peered":"2024-04-18T21:10:50.523223+0000","last_clean":"2024-04-18T21:10:50.523223+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:50.523223+0000","last_undegraded":"2024-04-18T21:10:50.523223+0000","last_fullsized":"2024-04-18T21:10:50.523223+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'560","last_scrub_stamp":"2024-04-18T21:10:50.523027+0000","last_deep_scrub":"89'560","last_deep_scrub_stamp":"2024-04-18T21:10:50.523027+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.523027+0000","objects_scrubbed":2,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:23:32.729636+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":708,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.543014+0000","last_change":"2024-04-18T21:10:41.543149+0000","last_active":"2024-04-18T21:10:41.543014+0000","last_peered":"2024-04-18T21:10:41.543014+0000","last_clean":"2024-04-18T21:10:41.543014+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:41.543014+0000","last_undegraded":"2024-04-18T21:10:41.543014+0000","last_fullsized":"2024-04-18T21:10:41.543014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'475","last_scrub_stamp":"2024-04-18T21:10:41.542789+0000","last_deep_scrub":"74'475","last_deep_scrub_stamp":"2024-04-18T21:10:41.542789+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.542789+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:28:54.188274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.539591+0000","last_change":"2024-04-18T21:10:47.539653+0000","last_active":"2024-04-18T21:10:47.539591+0000","last_peered":"2024-04-18T21:10:47.539591+0000","last_clean":"2024-04-18T21:10:47.539591+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:47.539591+0000","last_undegraded":"2024-04-18T21:10:47.539591+0000","last_fullsized":"2024-04-18T21:10:47.539591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'52","last_scrub_stamp":"2024-04-18T21:10:47.539398+0000","last_deep_scrub":"72'52","last_deep_scrub_stamp":"2024-04-18T21:10:47.539398+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.539398+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:57.377253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":701,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929902+0000","last_change":"2024-04-18T21:10:16.903655+0000","last_active":"2024-04-18T21:10:25.929902+0000","last_peered":"2024-04-18T21:10:25.929902+0000","last_clean":"2024-04-18T21:10:25.929902+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:10:25.929902+0000","last_undegraded":"2024-04-18T21:10:25.929902+0000","last_fullsized":"2024-04-18T21:10:25.929902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'171","reported_seq":337,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930190+0000","last_change":"2024-04-18T21:10:16.901755+0000","last_active":"2024-04-18T21:10:25.930190+0000","last_peered":"2024-04-18T21:10:25.930190+0000","last_clean":"2024-04-18T21:10:25.930190+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:10:25.930190+0000","last_undegraded":"2024-04-18T21:10:25.930190+0000","last_fullsized":"2024-04-18T21:10:25.930190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":626,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.245921+0000","last_change":"2024-04-18T21:10:26.243532+0000","last_active":"2024-04-18T21:10:26.245921+0000","last_peered":"2024-04-18T21:10:26.245921+0000","last_clean":"2024-04-18T21:10:26.245921+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:26.245921+0000","last_undegraded":"2024-04-18T21:10:26.245921+0000","last_fullsized":"2024-04-18T21:10:26.245921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"89'112","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.459818+0000","last_change":"2024-04-18T21:10:52.459963+0000","last_active":"2024-04-18T21:10:52.459818+0000","last_peered":"2024-04-18T21:10:52.459818+0000","last_clean":"2024-04-18T21:10:52.459818+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:52.459818+0000","last_undegraded":"2024-04-18T21:10:52.459818+0000","last_fullsized":"2024-04-18T21:10:52.459818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'112","last_scrub_stamp":"2024-04-18T21:10:52.459590+0000","last_deep_scrub":"89'112","last_deep_scrub_stamp":"2024-04-18T21:10:52.459590+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.459590+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:15.629219+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":618,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.548220+0000","last_change":"2024-04-18T21:10:43.548287+0000","last_active":"2024-04-18T21:10:43.548220+0000","last_peered":"2024-04-18T21:10:43.548220+0000","last_clean":"2024-04-18T21:10:43.548220+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:43.548220+0000","last_undegraded":"2024-04-18T21:10:43.548220+0000","last_fullsized":"2024-04-18T21:10:43.548220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'420","last_scrub_stamp":"2024-04-18T21:10:43.548042+0000","last_deep_scrub":"74'420","last_deep_scrub_stamp":"2024-04-18T21:10:43.548042+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.548042+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:49.418674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":223,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924162+0000","last_change":"2024-04-18T21:10:16.876076+0000","last_active":"2024-04-18T21:10:25.924162+0000","last_peered":"2024-04-18T21:10:25.924162+0000","last_clean":"2024-04-18T21:10:25.924162+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:10:25.924162+0000","last_undegraded":"2024-04-18T21:10:25.924162+0000","last_fullsized":"2024-04-18T21:10:25.924162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":525,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.225907+0000","last_change":"2024-04-18T21:10:26.217877+0000","last_active":"2024-04-18T21:10:26.225907+0000","last_peered":"2024-04-18T21:10:26.225907+0000","last_clean":"2024-04-18T21:10:26.225907+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:26.225907+0000","last_undegraded":"2024-04-18T21:10:26.225907+0000","last_fullsized":"2024-04-18T21:10:26.225907+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"89'471","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.013442+0000","last_change":"2024-04-18T21:10:41.013618+0000","last_active":"2024-04-18T21:10:41.013442+0000","last_peered":"2024-04-18T21:10:41.013442+0000","last_clean":"2024-04-18T21:10:41.013442+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:41.013442+0000","last_undegraded":"2024-04-18T21:10:41.013442+0000","last_fullsized":"2024-04-18T21:10:41.013442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'471","last_scrub_stamp":"2024-04-18T21:10:41.013171+0000","last_deep_scrub":"89'471","last_deep_scrub_stamp":"2024-04-18T21:10:41.013171+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.013171+0000","objects_scrubbed":1,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:41.021777+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":683,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.010904+0000","last_change":"2024-04-18T21:10:41.010966+0000","last_active":"2024-04-18T21:10:41.010904+0000","last_peered":"2024-04-18T21:10:41.010904+0000","last_clean":"2024-04-18T21:10:41.010904+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:41.010904+0000","last_undegraded":"2024-04-18T21:10:41.010904+0000","last_fullsized":"2024-04-18T21:10:41.010904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'424","last_scrub_stamp":"2024-04-18T21:10:41.010667+0000","last_deep_scrub":"74'424","last_deep_scrub_stamp":"2024-04-18T21:10:41.010667+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.010667+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:11.233039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":327,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.227864+0000","last_change":"2024-04-18T21:10:26.200244+0000","last_active":"2024-04-18T21:10:26.227864+0000","last_peered":"2024-04-18T21:10:26.227864+0000","last_clean":"2024-04-18T21:10:26.227864+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:10:26.227864+0000","last_undegraded":"2024-04-18T21:10:26.227864+0000","last_fullsized":"2024-04-18T21:10:26.227864+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:56.492371+0000","last_clean_scrub_stamp":"2024-04-18T21:04:56.492371+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.231497+0000","last_change":"2024-04-18T21:10:26.206570+0000","last_active":"2024-04-18T21:10:26.231497+0000","last_peered":"2024-04-18T21:10:26.231497+0000","last_clean":"2024-04-18T21:10:26.231497+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:10:26.231497+0000","last_undegraded":"2024-04-18T21:10:26.231497+0000","last_fullsized":"2024-04-18T21:10:26.231497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"72'346","reported_seq":505,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930564+0000","last_change":"2024-04-18T21:05:07.583214+0000","last_active":"2024-04-18T21:10:25.930564+0000","last_peered":"2024-04-18T21:10:25.930564+0000","last_clean":"2024-04-18T21:10:25.930564+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:10:25.930564+0000","last_undegraded":"2024-04-18T21:10:25.930564+0000","last_fullsized":"2024-04-18T21:10:25.930564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":618,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.564701+0000","last_change":"2024-04-18T21:10:40.564767+0000","last_active":"2024-04-18T21:10:40.564701+0000","last_peered":"2024-04-18T21:10:40.564701+0000","last_clean":"2024-04-18T21:10:40.564701+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:40.564701+0000","last_undegraded":"2024-04-18T21:10:40.564701+0000","last_fullsized":"2024-04-18T21:10:40.564701+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'429","last_scrub_stamp":"2024-04-18T21:10:40.564515+0000","last_deep_scrub":"74'429","last_deep_scrub_stamp":"2024-04-18T21:10:40.564515+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.564515+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:11.565225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248571+0000","last_change":"2024-04-18T21:10:26.248163+0000","last_active":"2024-04-18T21:10:26.248571+0000","last_peered":"2024-04-18T21:10:26.248571+0000","last_clean":"2024-04-18T21:10:26.248571+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:10:26.248571+0000","last_undegraded":"2024-04-18T21:10:26.248571+0000","last_fullsized":"2024-04-18T21:10:26.248571+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'126","reported_seq":354,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928345+0000","last_change":"2024-04-18T21:10:16.888314+0000","last_active":"2024-04-18T21:10:25.928345+0000","last_peered":"2024-04-18T21:10:25.928345+0000","last_clean":"2024-04-18T21:10:25.928345+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:10:25.928345+0000","last_undegraded":"2024-04-18T21:10:25.928345+0000","last_fullsized":"2024-04-18T21:10:25.928345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":707,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925989+0000","last_change":"2024-04-18T21:05:08.613025+0000","last_active":"2024-04-18T21:10:25.925989+0000","last_peered":"2024-04-18T21:10:25.925989+0000","last_clean":"2024-04-18T21:10:25.925989+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:25.925989+0000","last_undegraded":"2024-04-18T21:10:25.925989+0000","last_fullsized":"2024-04-18T21:10:25.925989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929085+0000","last_change":"2024-04-18T21:05:03.547826+0000","last_active":"2024-04-18T21:10:25.929085+0000","last_peered":"2024-04-18T21:10:25.929085+0000","last_clean":"2024-04-18T21:10:25.929085+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:25.929085+0000","last_undegraded":"2024-04-18T21:10:25.929085+0000","last_fullsized":"2024-04-18T21:10:25.929085+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"89'288","reported_seq":462,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.190710+0000","last_change":"2024-04-18T21:10:51.190778+0000","last_active":"2024-04-18T21:10:51.190710+0000","last_peered":"2024-04-18T21:10:51.190710+0000","last_clean":"2024-04-18T21:10:51.190710+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:51.190710+0000","last_undegraded":"2024-04-18T21:10:51.190710+0000","last_fullsized":"2024-04-18T21:10:51.190710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'288","last_scrub_stamp":"2024-04-18T21:10:51.190517+0000","last_deep_scrub":"89'288","last_deep_scrub_stamp":"2024-04-18T21:10:51.190517+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.190517+0000","objects_scrubbed":2,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:48.012726+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":537,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.925143+0000","last_change":"2024-04-18T21:07:24.959144+0000","last_active":"2024-04-18T21:10:25.925143+0000","last_peered":"2024-04-18T21:10:25.925143+0000","last_clean":"2024-04-18T21:10:25.925143+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:10:25.925143+0000","last_undegraded":"2024-04-18T21:10:25.925143+0000","last_fullsized":"2024-04-18T21:10:25.925143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.447133+0000","last_change":"2024-04-18T21:10:51.447264+0000","last_active":"2024-04-18T21:10:51.447133+0000","last_peered":"2024-04-18T21:10:51.447133+0000","last_clean":"2024-04-18T21:10:51.447133+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:51.447133+0000","last_undegraded":"2024-04-18T21:10:51.447133+0000","last_fullsized":"2024-04-18T21:10:51.447133+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:51.446814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:51.446814+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.446814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:45:51.001777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":93,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.231631+0000","last_change":"2024-04-18T21:10:26.211170+0000","last_active":"2024-04-18T21:10:26.231631+0000","last_peered":"2024-04-18T21:10:26.231631+0000","last_clean":"2024-04-18T21:10:26.231631+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:10:26.231631+0000","last_undegraded":"2024-04-18T21:10:26.231631+0000","last_fullsized":"2024-04-18T21:10:26.231631+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.036697+0000","last_change":"2024-04-18T21:10:43.036815+0000","last_active":"2024-04-18T21:10:43.036697+0000","last_peered":"2024-04-18T21:10:43.036697+0000","last_clean":"2024-04-18T21:10:43.036697+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:43.036697+0000","last_undegraded":"2024-04-18T21:10:43.036697+0000","last_fullsized":"2024-04-18T21:10:43.036697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'397","last_scrub_stamp":"2024-04-18T21:10:43.036408+0000","last_deep_scrub":"74'397","last_deep_scrub_stamp":"2024-04-18T21:10:43.036408+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.036408+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:17:15.381816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'253","reported_seq":303,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.544896+0000","last_change":"2024-04-18T21:10:44.544976+0000","last_active":"2024-04-18T21:10:44.544896+0000","last_peered":"2024-04-18T21:10:44.544896+0000","last_clean":"2024-04-18T21:10:44.544896+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:44.544896+0000","last_undegraded":"2024-04-18T21:10:44.544896+0000","last_fullsized":"2024-04-18T21:10:44.544896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'253","last_scrub_stamp":"2024-04-18T21:10:44.544697+0000","last_deep_scrub":"89'253","last_deep_scrub_stamp":"2024-04-18T21:10:44.544697+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.544697+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:07:32.731155+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928775+0000","last_change":"2024-04-18T21:05:03.547789+0000","last_active":"2024-04-18T21:10:25.928775+0000","last_peered":"2024-04-18T21:10:25.928775+0000","last_clean":"2024-04-18T21:10:25.928775+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:25.928775+0000","last_undegraded":"2024-04-18T21:10:25.928775+0000","last_fullsized":"2024-04-18T21:10:25.928775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":586,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.008640+0000","last_change":"2024-04-18T21:10:44.008705+0000","last_active":"2024-04-18T21:10:44.008640+0000","last_peered":"2024-04-18T21:10:44.008640+0000","last_clean":"2024-04-18T21:10:44.008640+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:44.008640+0000","last_undegraded":"2024-04-18T21:10:44.008640+0000","last_fullsized":"2024-04-18T21:10:44.008640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'376","last_scrub_stamp":"2024-04-18T21:10:44.008446+0000","last_deep_scrub":"74'376","last_deep_scrub_stamp":"2024-04-18T21:10:44.008446+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.008446+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:36.590534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928599+0000","last_change":"2024-04-18T21:05:07.582687+0000","last_active":"2024-04-18T21:10:25.928599+0000","last_peered":"2024-04-18T21:10:25.928599+0000","last_clean":"2024-04-18T21:10:25.928599+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:25.928599+0000","last_undegraded":"2024-04-18T21:10:25.928599+0000","last_fullsized":"2024-04-18T21:10:25.928599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926537+0000","last_change":"2024-04-18T21:10:23.947442+0000","last_active":"2024-04-18T21:10:25.926537+0000","last_peered":"2024-04-18T21:10:25.926537+0000","last_clean":"2024-04-18T21:10:25.926537+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:10:25.926537+0000","last_undegraded":"2024-04-18T21:10:25.926537+0000","last_fullsized":"2024-04-18T21:10:25.926537+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":598,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.994653+0000","last_change":"2024-04-18T21:10:41.994715+0000","last_active":"2024-04-18T21:10:41.994653+0000","last_peered":"2024-04-18T21:10:41.994653+0000","last_clean":"2024-04-18T21:10:41.994653+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:41.994653+0000","last_undegraded":"2024-04-18T21:10:41.994653+0000","last_fullsized":"2024-04-18T21:10:41.994653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'402","last_scrub_stamp":"2024-04-18T21:10:41.994461+0000","last_deep_scrub":"74'402","last_deep_scrub_stamp":"2024-04-18T21:10:41.994461+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.994461+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:56.353553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'63","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930383+0000","last_change":"2024-04-18T21:05:07.583337+0000","last_active":"2024-04-18T21:10:25.930383+0000","last_peered":"2024-04-18T21:10:25.930383+0000","last_clean":"2024-04-18T21:10:25.930383+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:10:25.930383+0000","last_undegraded":"2024-04-18T21:10:25.930383+0000","last_fullsized":"2024-04-18T21:10:25.930383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.930046+0000","last_change":"2024-04-18T21:05:03.547854+0000","last_active":"2024-04-18T21:10:25.930046+0000","last_peered":"2024-04-18T21:10:25.930046+0000","last_clean":"2024-04-18T21:10:25.930046+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:25.930046+0000","last_undegraded":"2024-04-18T21:10:25.930046+0000","last_fullsized":"2024-04-18T21:10:25.930046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":562,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928683+0000","last_change":"2024-04-18T21:10:16.898818+0000","last_active":"2024-04-18T21:10:25.928683+0000","last_peered":"2024-04-18T21:10:25.928683+0000","last_clean":"2024-04-18T21:10:25.928683+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:10:25.928683+0000","last_undegraded":"2024-04-18T21:10:25.928683+0000","last_fullsized":"2024-04-18T21:10:25.928683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"89'110","reported_seq":251,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.993904+0000","last_change":"2024-04-18T21:10:49.993970+0000","last_active":"2024-04-18T21:10:49.993904+0000","last_peered":"2024-04-18T21:10:49.993904+0000","last_clean":"2024-04-18T21:10:49.993904+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:49.993904+0000","last_undegraded":"2024-04-18T21:10:49.993904+0000","last_fullsized":"2024-04-18T21:10:49.993904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'110","last_scrub_stamp":"2024-04-18T21:10:49.993694+0000","last_deep_scrub":"89'110","last_deep_scrub_stamp":"2024-04-18T21:10:49.993694+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.993694+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.920224+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.218976+0000","last_change":"2024-04-18T21:10:26.214755+0000","last_active":"2024-04-18T21:10:26.218976+0000","last_peered":"2024-04-18T21:10:26.218976+0000","last_clean":"2024-04-18T21:10:26.218976+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:10:26.218976+0000","last_undegraded":"2024-04-18T21:10:26.218976+0000","last_fullsized":"2024-04-18T21:10:26.218976+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:02.525695+0000","last_clean_scrub_stamp":"2024-04-18T21:05:02.525695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":617,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.923601+0000","last_change":"2024-04-18T21:10:16.876309+0000","last_active":"2024-04-18T21:10:25.923601+0000","last_peered":"2024-04-18T21:10:25.923601+0000","last_clean":"2024-04-18T21:10:25.923601+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:10:25.923601+0000","last_undegraded":"2024-04-18T21:10:25.923601+0000","last_fullsized":"2024-04-18T21:10:25.923601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":642,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.501930+0000","last_change":"2024-04-18T21:10:48.501989+0000","last_active":"2024-04-18T21:10:48.501930+0000","last_peered":"2024-04-18T21:10:48.501930+0000","last_clean":"2024-04-18T21:10:48.501930+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:48.501930+0000","last_undegraded":"2024-04-18T21:10:48.501930+0000","last_fullsized":"2024-04-18T21:10:48.501930+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'418","last_scrub_stamp":"2024-04-18T21:10:48.501732+0000","last_deep_scrub":"74'418","last_deep_scrub_stamp":"2024-04-18T21:10:48.501732+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.501732+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:30.654262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'250","reported_seq":395,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.236026+0000","last_change":"2024-04-18T21:10:26.212269+0000","last_active":"2024-04-18T21:10:26.236026+0000","last_peered":"2024-04-18T21:10:26.236026+0000","last_clean":"2024-04-18T21:10:26.236026+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:10:26.236026+0000","last_undegraded":"2024-04-18T21:10:26.236026+0000","last_fullsized":"2024-04-18T21:10:26.236026+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":578,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.086614+0000","last_change":"2024-04-18T21:10:53.086683+0000","last_active":"2024-04-18T21:10:53.086614+0000","last_peered":"2024-04-18T21:10:53.086614+0000","last_clean":"2024-04-18T21:10:53.086614+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:53.086614+0000","last_undegraded":"2024-04-18T21:10:53.086614+0000","last_fullsized":"2024-04-18T21:10:53.086614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'398","last_scrub_stamp":"2024-04-18T21:10:53.086251+0000","last_deep_scrub":"74'398","last_deep_scrub_stamp":"2024-04-18T21:10:53.086251+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.086251+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:05.595545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'79","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.018963+0000","last_change":"2024-04-18T21:10:43.019130+0000","last_active":"2024-04-18T21:10:43.018963+0000","last_peered":"2024-04-18T21:10:43.018963+0000","last_clean":"2024-04-18T21:10:43.018963+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:43.018963+0000","last_undegraded":"2024-04-18T21:10:43.018963+0000","last_fullsized":"2024-04-18T21:10:43.018963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'79","last_scrub_stamp":"2024-04-18T21:10:43.018744+0000","last_deep_scrub":"89'79","last_deep_scrub_stamp":"2024-04-18T21:10:43.018744+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.018744+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:26.019419+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"72'242","reported_seq":267,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.218897+0000","last_change":"2024-04-18T21:10:26.205389+0000","last_active":"2024-04-18T21:10:26.218897+0000","last_peered":"2024-04-18T21:10:26.218897+0000","last_clean":"2024-04-18T21:10:26.218897+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:10:26.218897+0000","last_undegraded":"2024-04-18T21:10:26.218897+0000","last_fullsized":"2024-04-18T21:10:26.218897+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":669,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.927950+0000","last_change":"2024-04-18T21:10:16.890146+0000","last_active":"2024-04-18T21:10:25.927950+0000","last_peered":"2024-04-18T21:10:25.927950+0000","last_clean":"2024-04-18T21:10:25.927950+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:10:25.927950+0000","last_undegraded":"2024-04-18T21:10:25.927950+0000","last_fullsized":"2024-04-18T21:10:25.927950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":237,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.954768+0000","last_change":"2024-04-18T21:10:45.954906+0000","last_active":"2024-04-18T21:10:45.954768+0000","last_peered":"2024-04-18T21:10:45.954768+0000","last_clean":"2024-04-18T21:10:45.954768+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:45.954768+0000","last_undegraded":"2024-04-18T21:10:45.954768+0000","last_fullsized":"2024-04-18T21:10:45.954768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'63","last_scrub_stamp":"2024-04-18T21:10:45.954547+0000","last_deep_scrub":"72'63","last_deep_scrub_stamp":"2024-04-18T21:10:45.954547+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.954547+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:29.545083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.934454+0000","last_change":"2024-04-18T21:10:48.934518+0000","last_active":"2024-04-18T21:10:48.934454+0000","last_peered":"2024-04-18T21:10:48.934454+0000","last_clean":"2024-04-18T21:10:48.934454+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:48.934454+0000","last_undegraded":"2024-04-18T21:10:48.934454+0000","last_fullsized":"2024-04-18T21:10:48.934454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'446","last_scrub_stamp":"2024-04-18T21:10:48.934255+0000","last_deep_scrub":"74'446","last_deep_scrub_stamp":"2024-04-18T21:10:48.934255+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.934255+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.407364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":529,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.926053+0000","last_change":"2024-04-18T21:10:16.878747+0000","last_active":"2024-04-18T21:10:25.926053+0000","last_peered":"2024-04-18T21:10:25.926053+0000","last_clean":"2024-04-18T21:10:25.926053+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:25.926053+0000","last_undegraded":"2024-04-18T21:10:25.926053+0000","last_fullsized":"2024-04-18T21:10:25.926053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"72'616","reported_seq":775,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929247+0000","last_change":"2024-04-18T21:05:07.583360+0000","last_active":"2024-04-18T21:10:25.929247+0000","last_peered":"2024-04-18T21:10:25.929247+0000","last_clean":"2024-04-18T21:10:25.929247+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:10:25.929247+0000","last_undegraded":"2024-04-18T21:10:25.929247+0000","last_fullsized":"2024-04-18T21:10:25.929247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":592,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.058656+0000","last_change":"2024-04-18T21:10:54.058717+0000","last_active":"2024-04-18T21:10:54.058656+0000","last_peered":"2024-04-18T21:10:54.058656+0000","last_clean":"2024-04-18T21:10:54.058656+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:54.058656+0000","last_undegraded":"2024-04-18T21:10:54.058656+0000","last_fullsized":"2024-04-18T21:10:54.058656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:54.058451+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:54.058451+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.058451+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:43.113325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"72'206","reported_seq":372,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.928266+0000","last_change":"2024-04-18T21:10:16.887646+0000","last_active":"2024-04-18T21:10:25.928266+0000","last_peered":"2024-04-18T21:10:25.928266+0000","last_clean":"2024-04-18T21:10:25.928266+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:10:25.928266+0000","last_undegraded":"2024-04-18T21:10:25.928266+0000","last_fullsized":"2024-04-18T21:10:25.928266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.964831+0000","last_change":"2024-04-18T21:10:41.964977+0000","last_active":"2024-04-18T21:10:41.964831+0000","last_peered":"2024-04-18T21:10:41.964831+0000","last_clean":"2024-04-18T21:10:41.964831+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:41.964831+0000","last_undegraded":"2024-04-18T21:10:41.964831+0000","last_fullsized":"2024-04-18T21:10:41.964831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:41.964596+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:41.964596+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.964596+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:44:13.418017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"89'189","reported_seq":304,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.175813+0000","last_change":"2024-04-18T21:10:52.175887+0000","last_active":"2024-04-18T21:10:52.175813+0000","last_peered":"2024-04-18T21:10:52.175813+0000","last_clean":"2024-04-18T21:10:52.175813+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:52.175813+0000","last_undegraded":"2024-04-18T21:10:52.175813+0000","last_fullsized":"2024-04-18T21:10:52.175813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'189","last_scrub_stamp":"2024-04-18T21:10:52.175618+0000","last_deep_scrub":"89'189","last_deep_scrub_stamp":"2024-04-18T21:10:52.175618+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.175618+0000","objects_scrubbed":3,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:29.442474+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":564,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924687+0000","last_change":"2024-04-18T21:10:23.943212+0000","last_active":"2024-04-18T21:10:25.924687+0000","last_peered":"2024-04-18T21:10:25.924687+0000","last_clean":"2024-04-18T21:10:25.924687+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:10:25.924687+0000","last_undegraded":"2024-04-18T21:10:25.924687+0000","last_fullsized":"2024-04-18T21:10:25.924687+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"89'58","reported_seq":232,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.043350+0000","last_change":"2024-04-18T21:10:47.043413+0000","last_active":"2024-04-18T21:10:47.043350+0000","last_peered":"2024-04-18T21:10:47.043350+0000","last_clean":"2024-04-18T21:10:47.043350+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:47.043350+0000","last_undegraded":"2024-04-18T21:10:47.043350+0000","last_fullsized":"2024-04-18T21:10:47.043350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'58","last_scrub_stamp":"2024-04-18T21:10:47.043155+0000","last_deep_scrub":"89'58","last_deep_scrub_stamp":"2024-04-18T21:10:47.043155+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.043155+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:01.402247+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":537,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.508770+0000","last_change":"2024-04-18T21:10:49.508837+0000","last_active":"2024-04-18T21:10:49.508770+0000","last_peered":"2024-04-18T21:10:49.508770+0000","last_clean":"2024-04-18T21:10:49.508770+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:49.508770+0000","last_undegraded":"2024-04-18T21:10:49.508770+0000","last_fullsized":"2024-04-18T21:10:49.508770+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'368","last_scrub_stamp":"2024-04-18T21:10:49.508563+0000","last_deep_scrub":"74'368","last_deep_scrub_stamp":"2024-04-18T21:10:49.508563+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.508563+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:16.454033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"72'178","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.235955+0000","last_change":"2024-04-18T21:10:26.211599+0000","last_active":"2024-04-18T21:10:26.235955+0000","last_peered":"2024-04-18T21:10:26.235955+0000","last_clean":"2024-04-18T21:10:26.235955+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:10:26.235955+0000","last_undegraded":"2024-04-18T21:10:26.235955+0000","last_fullsized":"2024-04-18T21:10:26.235955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.421016+0000","last_change":"2024-04-18T21:10:54.421161+0000","last_active":"2024-04-18T21:10:54.421016+0000","last_peered":"2024-04-18T21:10:54.421016+0000","last_clean":"2024-04-18T21:10:54.421016+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:54.421016+0000","last_undegraded":"2024-04-18T21:10:54.421016+0000","last_fullsized":"2024-04-18T21:10:54.421016+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'402","last_scrub_stamp":"2024-04-18T21:10:54.420766+0000","last_deep_scrub":"74'402","last_deep_scrub_stamp":"2024-04-18T21:10:54.420766+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.420766+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:27:28.968229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"89'195","reported_seq":369,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.096115+0000","last_change":"2024-04-18T21:10:45.096295+0000","last_active":"2024-04-18T21:10:45.096115+0000","last_peered":"2024-04-18T21:10:45.096115+0000","last_clean":"2024-04-18T21:10:45.096115+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:45.096115+0000","last_undegraded":"2024-04-18T21:10:45.096115+0000","last_fullsized":"2024-04-18T21:10:45.096115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'195","last_scrub_stamp":"2024-04-18T21:10:45.095889+0000","last_deep_scrub":"89'195","last_deep_scrub_stamp":"2024-04-18T21:10:45.095889+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.095889+0000","objects_scrubbed":4,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:38:46.648098+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":563,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.924521+0000","last_change":"2024-04-18T21:10:23.945002+0000","last_active":"2024-04-18T21:10:25.924521+0000","last_peered":"2024-04-18T21:10:25.924521+0000","last_clean":"2024-04-18T21:10:25.924521+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:10:25.924521+0000","last_undegraded":"2024-04-18T21:10:25.924521+0000","last_fullsized":"2024-04-18T21:10:25.924521+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"72'172","reported_seq":331,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:25.929076+0000","last_change":"2024-04-18T21:05:07.582935+0000","last_active":"2024-04-18T21:10:25.929076+0000","last_peered":"2024-04-18T21:10:25.929076+0000","last_clean":"2024-04-18T21:10:25.929076+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:10:25.929076+0000","last_undegraded":"2024-04-18T21:10:25.929076+0000","last_fullsized":"2024-04-18T21:10:25.929076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:06.550148+0000","last_clean_scrub_stamp":"2024-04-18T21:05:06.550148+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":604,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.248455+0000","last_change":"2024-04-18T21:10:26.247398+0000","last_active":"2024-04-18T21:10:26.248455+0000","last_peered":"2024-04-18T21:10:26.248455+0000","last_clean":"2024-04-18T21:10:26.248455+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:10:26.248455+0000","last_undegraded":"2024-04-18T21:10:26.248455+0000","last_fullsized":"2024-04-18T21:10:26.248455+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"89'62","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.028888+0000","last_change":"2024-04-18T21:10:44.028955+0000","last_active":"2024-04-18T21:10:44.028888+0000","last_peered":"2024-04-18T21:10:44.028888+0000","last_clean":"2024-04-18T21:10:44.028888+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:44.028888+0000","last_undegraded":"2024-04-18T21:10:44.028888+0000","last_fullsized":"2024-04-18T21:10:44.028888+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'62","last_scrub_stamp":"2024-04-18T21:10:44.028700+0000","last_deep_scrub":"89'62","last_deep_scrub_stamp":"2024-04-18T21:10:44.028700+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.028700+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:51.391600+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6333,"ondisk_log_size":6333,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738445,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103660,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268180,"statfs":{"total":96636764160,"available":96530616320,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738445,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103540,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268300,"statfs":{"total":96636764160,"available":96530739200,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350986,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:59.668 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.669 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.669 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.669 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.669 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.669 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.669 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.670 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.670 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.670 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.670 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.670 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.670 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.670 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.671 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.671 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.671 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.671 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.671 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.671 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.671 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.672 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.672 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.672 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.672 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.672 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.672 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.673 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T21:04:56.492371+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=56, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.673 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.673 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.673 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.674 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.674 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.674 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.675 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.675 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.675 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.675 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.675 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.676 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.676 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.676 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.676 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T21:05:02.525695+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=2, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.676 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.676 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.676 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.677 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.677 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.677 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.677 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.677 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.678 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.678 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.678 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T21:05:06.550148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.678 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:59.678 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T21:11:19.680 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:11:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:11:20.002 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:11:20.019 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-04-18T21:11:19.753110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33043,"ondisk_log_size":33043,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265728,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849792,"statfs":{"total":289910292480,"available":289638187008,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004515"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":592,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:08.373177+0000","last_change":"2024-04-18T21:11:08.373237+0000","last_active":"2024-04-18T21:11:08.373177+0000","last_peered":"2024-04-18T21:11:08.373177+0000","last_clean":"2024-04-18T21:11:08.373177+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:11:08.373177+0000","last_undegraded":"2024-04-18T21:11:08.373177+0000","last_fullsized":"2024-04-18T21:11:08.373177+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'396","last_scrub_stamp":"2024-04-18T21:11:08.372977+0000","last_deep_scrub":"74'396","last_deep_scrub_stamp":"2024-04-18T21:11:08.372977+0000","last_clean_scrub_stamp":"2024-04-18T21:11:08.372977+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:50.367244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":619,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.148595+0000","last_change":"2024-04-18T21:10:54.148662+0000","last_active":"2024-04-18T21:10:54.148595+0000","last_peered":"2024-04-18T21:10:54.148595+0000","last_clean":"2024-04-18T21:10:54.148595+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:54.148595+0000","last_undegraded":"2024-04-18T21:10:54.148595+0000","last_fullsized":"2024-04-18T21:10:54.148595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'430","last_scrub_stamp":"2024-04-18T21:10:54.148404+0000","last_deep_scrub":"74'430","last_deep_scrub_stamp":"2024-04-18T21:10:54.148404+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.148404+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:09:54.547034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:26.249910+0000","last_change":"2024-04-18T21:10:26.249269+0000","last_active":"2024-04-18T21:10:26.249910+0000","last_peered":"2024-04-18T21:10:26.249910+0000","last_clean":"2024-04-18T21:10:26.249910+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:10:26.249910+0000","last_undegraded":"2024-04-18T21:10:26.249910+0000","last_fullsized":"2024-04-18T21:10:26.249910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:07.559603+0000","last_clean_scrub_stamp":"2024-04-18T21:05:07.559603+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":547,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.413433+0000","last_change":"2024-04-18T21:10:56.413498+0000","last_active":"2024-04-18T21:10:56.413433+0000","last_peered":"2024-04-18T21:10:56.413433+0000","last_clean":"2024-04-18T21:10:56.413433+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:56.413433+0000","last_undegraded":"2024-04-18T21:10:56.413433+0000","last_fullsized":"2024-04-18T21:10:56.413433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'388","last_scrub_stamp":"2024-04-18T21:10:56.413249+0000","last_deep_scrub":"74'388","last_deep_scrub_stamp":"2024-04-18T21:10:56.413249+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.413249+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:55:45.634198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":621,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.096084+0000","last_change":"2024-04-18T21:10:50.096147+0000","last_active":"2024-04-18T21:10:50.096084+0000","last_peered":"2024-04-18T21:10:50.096084+0000","last_clean":"2024-04-18T21:10:50.096084+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:50.096084+0000","last_undegraded":"2024-04-18T21:10:50.096084+0000","last_fullsized":"2024-04-18T21:10:50.096084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'445","last_scrub_stamp":"2024-04-18T21:10:50.095884+0000","last_deep_scrub":"74'445","last_deep_scrub_stamp":"2024-04-18T21:10:50.095884+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.095884+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:39.544011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":560,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:08.364774+0000","last_change":"2024-04-18T21:11:08.364838+0000","last_active":"2024-04-18T21:11:08.364774+0000","last_peered":"2024-04-18T21:11:08.364774+0000","last_clean":"2024-04-18T21:11:08.364774+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:11:08.364774+0000","last_undegraded":"2024-04-18T21:11:08.364774+0000","last_fullsized":"2024-04-18T21:11:08.364774+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'394","last_scrub_stamp":"2024-04-18T21:11:08.364587+0000","last_deep_scrub":"74'394","last_deep_scrub_stamp":"2024-04-18T21:11:08.364587+0000","last_clean_scrub_stamp":"2024-04-18T21:11:08.364587+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:59.469731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":605,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.438733+0000","last_change":"2024-04-18T21:10:53.438860+0000","last_active":"2024-04-18T21:10:53.438733+0000","last_peered":"2024-04-18T21:10:53.438733+0000","last_clean":"2024-04-18T21:10:53.438733+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:53.438733+0000","last_undegraded":"2024-04-18T21:10:53.438733+0000","last_fullsized":"2024-04-18T21:10:53.438733+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'414","last_scrub_stamp":"2024-04-18T21:10:53.438520+0000","last_deep_scrub":"74'414","last_deep_scrub_stamp":"2024-04-18T21:10:53.438520+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.438520+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:26.410323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.547439+0000","last_change":"2024-04-18T21:10:42.547623+0000","last_active":"2024-04-18T21:10:42.547439+0000","last_peered":"2024-04-18T21:10:42.547439+0000","last_clean":"2024-04-18T21:10:42.547439+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:42.547439+0000","last_undegraded":"2024-04-18T21:10:42.547439+0000","last_fullsized":"2024-04-18T21:10:42.547439+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'371","last_scrub_stamp":"2024-04-18T21:10:42.547204+0000","last_deep_scrub":"74'371","last_deep_scrub_stamp":"2024-04-18T21:10:42.547204+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.547204+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:22.049656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":670,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.975806+0000","last_change":"2024-04-18T21:10:44.975956+0000","last_active":"2024-04-18T21:10:44.975806+0000","last_peered":"2024-04-18T21:10:44.975806+0000","last_clean":"2024-04-18T21:10:44.975806+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:44.975806+0000","last_undegraded":"2024-04-18T21:10:44.975806+0000","last_fullsized":"2024-04-18T21:10:44.975806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'447","last_scrub_stamp":"2024-04-18T21:10:44.975572+0000","last_deep_scrub":"74'447","last_deep_scrub_stamp":"2024-04-18T21:10:44.975572+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.975572+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:51.968653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:06.376363+0000","last_change":"2024-04-18T21:11:06.376461+0000","last_active":"2024-04-18T21:11:06.376363+0000","last_peered":"2024-04-18T21:11:06.376363+0000","last_clean":"2024-04-18T21:11:06.376363+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:11:06.376363+0000","last_undegraded":"2024-04-18T21:11:06.376363+0000","last_fullsized":"2024-04-18T21:11:06.376363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'415","last_scrub_stamp":"2024-04-18T21:11:06.376154+0000","last_deep_scrub":"74'415","last_deep_scrub_stamp":"2024-04-18T21:11:06.376154+0000","last_clean_scrub_stamp":"2024-04-18T21:11:06.376154+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:54:11.774141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":532,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.550773+0000","last_change":"2024-04-18T21:10:38.550838+0000","last_active":"2024-04-18T21:10:38.550773+0000","last_peered":"2024-04-18T21:10:38.550773+0000","last_clean":"2024-04-18T21:10:38.550773+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:38.550773+0000","last_undegraded":"2024-04-18T21:10:38.550773+0000","last_fullsized":"2024-04-18T21:10:38.550773+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'363","last_scrub_stamp":"2024-04-18T21:10:38.550569+0000","last_deep_scrub":"74'363","last_deep_scrub_stamp":"2024-04-18T21:10:38.550569+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.550569+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:26:33.879921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:05.397124+0000","last_change":"2024-04-18T21:11:05.397185+0000","last_active":"2024-04-18T21:11:05.397124+0000","last_peered":"2024-04-18T21:11:05.397124+0000","last_clean":"2024-04-18T21:11:05.397124+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:11:05.397124+0000","last_undegraded":"2024-04-18T21:11:05.397124+0000","last_fullsized":"2024-04-18T21:11:05.397124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'344","last_scrub_stamp":"2024-04-18T21:11:05.396921+0000","last_deep_scrub":"74'344","last_deep_scrub_stamp":"2024-04-18T21:11:05.396921+0000","last_clean_scrub_stamp":"2024-04-18T21:11:05.396921+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:20.772902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":607,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:07.390292+0000","last_change":"2024-04-18T21:11:07.390350+0000","last_active":"2024-04-18T21:11:07.390292+0000","last_peered":"2024-04-18T21:11:07.390292+0000","last_clean":"2024-04-18T21:11:07.390292+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:11:07.390292+0000","last_undegraded":"2024-04-18T21:11:07.390292+0000","last_fullsized":"2024-04-18T21:11:07.390292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'411","last_scrub_stamp":"2024-04-18T21:11:07.390100+0000","last_deep_scrub":"74'411","last_deep_scrub_stamp":"2024-04-18T21:11:07.390100+0000","last_clean_scrub_stamp":"2024-04-18T21:11:07.390100+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:50.762473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":658,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.583492+0000","last_change":"2024-04-18T21:10:39.583556+0000","last_active":"2024-04-18T21:10:39.583492+0000","last_peered":"2024-04-18T21:10:39.583492+0000","last_clean":"2024-04-18T21:10:39.583492+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:39.583492+0000","last_undegraded":"2024-04-18T21:10:39.583492+0000","last_fullsized":"2024-04-18T21:10:39.583492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'447","last_scrub_stamp":"2024-04-18T21:10:39.583297+0000","last_deep_scrub":"74'447","last_deep_scrub_stamp":"2024-04-18T21:10:39.583297+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.583297+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:49.385471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":662,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.389733+0000","last_change":"2024-04-18T21:10:55.389798+0000","last_active":"2024-04-18T21:10:55.389733+0000","last_peered":"2024-04-18T21:10:55.389733+0000","last_clean":"2024-04-18T21:10:55.389733+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:55.389733+0000","last_undegraded":"2024-04-18T21:10:55.389733+0000","last_fullsized":"2024-04-18T21:10:55.389733+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'410","last_scrub_stamp":"2024-04-18T21:10:55.389545+0000","last_deep_scrub":"74'410","last_deep_scrub_stamp":"2024-04-18T21:10:55.389545+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.389545+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:07:52.856824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":643,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:10.404377+0000","last_change":"2024-04-18T21:11:10.404440+0000","last_active":"2024-04-18T21:11:10.404377+0000","last_peered":"2024-04-18T21:11:10.404377+0000","last_clean":"2024-04-18T21:11:10.404377+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:11:10.404377+0000","last_undegraded":"2024-04-18T21:11:10.404377+0000","last_fullsized":"2024-04-18T21:11:10.404377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-04-18T21:11:10.404181+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-04-18T21:11:10.404181+0000","last_clean_scrub_stamp":"2024-04-18T21:11:10.404181+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:14.925736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":600,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.003368+0000","last_change":"2024-04-18T21:10:40.003492+0000","last_active":"2024-04-18T21:10:40.003368+0000","last_peered":"2024-04-18T21:10:40.003368+0000","last_clean":"2024-04-18T21:10:40.003368+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:40.003368+0000","last_undegraded":"2024-04-18T21:10:40.003368+0000","last_fullsized":"2024-04-18T21:10:40.003368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'406","last_scrub_stamp":"2024-04-18T21:10:40.003117+0000","last_deep_scrub":"74'406","last_deep_scrub_stamp":"2024-04-18T21:10:40.003117+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.003117+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:44:57.788059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":608,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.253171+0000","last_change":"2024-04-18T21:10:58.253235+0000","last_active":"2024-04-18T21:10:58.253171+0000","last_peered":"2024-04-18T21:10:58.253171+0000","last_clean":"2024-04-18T21:10:58.253171+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:58.253171+0000","last_undegraded":"2024-04-18T21:10:58.253171+0000","last_fullsized":"2024-04-18T21:10:58.253171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'409","last_scrub_stamp":"2024-04-18T21:10:58.252969+0000","last_deep_scrub":"74'409","last_deep_scrub_stamp":"2024-04-18T21:10:58.252969+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.252969+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:47.307843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.930678+0000","last_change":"2024-04-18T21:10:46.930846+0000","last_active":"2024-04-18T21:10:46.930678+0000","last_peered":"2024-04-18T21:10:46.930678+0000","last_clean":"2024-04-18T21:10:46.930678+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:46.930678+0000","last_undegraded":"2024-04-18T21:10:46.930678+0000","last_fullsized":"2024-04-18T21:10:46.930678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'433","last_scrub_stamp":"2024-04-18T21:10:46.930433+0000","last_deep_scrub":"74'433","last_deep_scrub_stamp":"2024-04-18T21:10:46.930433+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.930433+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:50.595324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.526639+0000","last_change":"2024-04-18T21:10:45.526699+0000","last_active":"2024-04-18T21:10:45.526639+0000","last_peered":"2024-04-18T21:10:45.526639+0000","last_clean":"2024-04-18T21:10:45.526639+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:45.526639+0000","last_undegraded":"2024-04-18T21:10:45.526639+0000","last_fullsized":"2024-04-18T21:10:45.526639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'428","last_scrub_stamp":"2024-04-18T21:10:45.526444+0000","last_deep_scrub":"74'428","last_deep_scrub_stamp":"2024-04-18T21:10:45.526444+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.526444+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:43.905072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":543,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.568891+0000","last_change":"2024-04-18T21:10:46.569086+0000","last_active":"2024-04-18T21:10:46.568891+0000","last_peered":"2024-04-18T21:10:46.568891+0000","last_clean":"2024-04-18T21:10:46.568891+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:46.568891+0000","last_undegraded":"2024-04-18T21:10:46.568891+0000","last_fullsized":"2024-04-18T21:10:46.568891+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'394","last_scrub_stamp":"2024-04-18T21:10:46.568669+0000","last_deep_scrub":"74'394","last_deep_scrub_stamp":"2024-04-18T21:10:46.568669+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.568669+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:31.635467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":648,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.041366+0000","last_change":"2024-04-18T21:10:46.041430+0000","last_active":"2024-04-18T21:10:46.041366+0000","last_peered":"2024-04-18T21:10:46.041366+0000","last_clean":"2024-04-18T21:10:46.041366+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:46.041366+0000","last_undegraded":"2024-04-18T21:10:46.041366+0000","last_fullsized":"2024-04-18T21:10:46.041366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'438","last_scrub_stamp":"2024-04-18T21:10:46.041169+0000","last_deep_scrub":"74'438","last_deep_scrub_stamp":"2024-04-18T21:10:46.041169+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.041169+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:37:35.518757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":602,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.973027+0000","last_change":"2024-04-18T21:10:38.973088+0000","last_active":"2024-04-18T21:10:38.973027+0000","last_peered":"2024-04-18T21:10:38.973027+0000","last_clean":"2024-04-18T21:10:38.973027+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:38.973027+0000","last_undegraded":"2024-04-18T21:10:38.973027+0000","last_fullsized":"2024-04-18T21:10:38.973027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'409","last_scrub_stamp":"2024-04-18T21:10:38.972829+0000","last_deep_scrub":"74'409","last_deep_scrub_stamp":"2024-04-18T21:10:38.972829+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.972829+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:38:45.609509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.965485+0000","last_change":"2024-04-18T21:10:39.965566+0000","last_active":"2024-04-18T21:10:39.965485+0000","last_peered":"2024-04-18T21:10:39.965485+0000","last_clean":"2024-04-18T21:10:39.965485+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:39.965485+0000","last_undegraded":"2024-04-18T21:10:39.965485+0000","last_fullsized":"2024-04-18T21:10:39.965485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'439","last_scrub_stamp":"2024-04-18T21:10:39.965281+0000","last_deep_scrub":"74'439","last_deep_scrub_stamp":"2024-04-18T21:10:39.965281+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.965281+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:33.165098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.142702+0000","last_change":"2024-04-18T21:10:53.142770+0000","last_active":"2024-04-18T21:10:53.142702+0000","last_peered":"2024-04-18T21:10:53.142702+0000","last_clean":"2024-04-18T21:10:53.142702+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:53.142702+0000","last_undegraded":"2024-04-18T21:10:53.142702+0000","last_fullsized":"2024-04-18T21:10:53.142702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'423","last_scrub_stamp":"2024-04-18T21:10:53.142504+0000","last_deep_scrub":"74'423","last_deep_scrub_stamp":"2024-04-18T21:10:53.142504+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.142504+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:58.615614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":751,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.915238+0000","last_change":"2024-04-18T21:10:47.915305+0000","last_active":"2024-04-18T21:10:47.915238+0000","last_peered":"2024-04-18T21:10:47.915238+0000","last_clean":"2024-04-18T21:10:47.915238+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:47.915238+0000","last_undegraded":"2024-04-18T21:10:47.915238+0000","last_fullsized":"2024-04-18T21:10:47.915238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'493","last_scrub_stamp":"2024-04-18T21:10:47.915034+0000","last_deep_scrub":"74'493","last_deep_scrub_stamp":"2024-04-18T21:10:47.915034+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.915034+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:52:37.937061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:14.357271+0000","last_change":"2024-04-18T21:11:14.357331+0000","last_active":"2024-04-18T21:11:14.357271+0000","last_peered":"2024-04-18T21:11:14.357271+0000","last_clean":"2024-04-18T21:11:14.357271+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:11:14.357271+0000","last_undegraded":"2024-04-18T21:11:14.357271+0000","last_fullsized":"2024-04-18T21:11:14.357271+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'394","last_scrub_stamp":"2024-04-18T21:11:14.357035+0000","last_deep_scrub":"74'394","last_deep_scrub_stamp":"2024-04-18T21:11:14.357035+0000","last_clean_scrub_stamp":"2024-04-18T21:11:14.357035+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:30.920926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":658,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.194577+0000","last_change":"2024-04-18T21:10:55.194639+0000","last_active":"2024-04-18T21:10:55.194577+0000","last_peered":"2024-04-18T21:10:55.194577+0000","last_clean":"2024-04-18T21:10:55.194577+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:55.194577+0000","last_undegraded":"2024-04-18T21:10:55.194577+0000","last_fullsized":"2024-04-18T21:10:55.194577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:55.194373+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:55.194373+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.194373+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:19.827646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.104857+0000","last_change":"2024-04-18T21:10:55.104925+0000","last_active":"2024-04-18T21:10:55.104857+0000","last_peered":"2024-04-18T21:10:55.104857+0000","last_clean":"2024-04-18T21:10:55.104857+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:55.104857+0000","last_undegraded":"2024-04-18T21:10:55.104857+0000","last_fullsized":"2024-04-18T21:10:55.104857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'400","last_scrub_stamp":"2024-04-18T21:10:55.104654+0000","last_deep_scrub":"74'400","last_deep_scrub_stamp":"2024-04-18T21:10:55.104654+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.104654+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:33.637116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":702,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.062652+0000","last_change":"2024-04-18T21:10:48.062795+0000","last_active":"2024-04-18T21:10:48.062652+0000","last_peered":"2024-04-18T21:10:48.062652+0000","last_clean":"2024-04-18T21:10:48.062652+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:48.062652+0000","last_undegraded":"2024-04-18T21:10:48.062652+0000","last_fullsized":"2024-04-18T21:10:48.062652+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'472","last_scrub_stamp":"2024-04-18T21:10:48.062345+0000","last_deep_scrub":"74'472","last_deep_scrub_stamp":"2024-04-18T21:10:48.062345+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.062345+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:17:20.407753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":672,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.008960+0000","last_change":"2024-04-18T21:10:51.009025+0000","last_active":"2024-04-18T21:10:51.008960+0000","last_peered":"2024-04-18T21:10:51.008960+0000","last_clean":"2024-04-18T21:10:51.008960+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:51.008960+0000","last_undegraded":"2024-04-18T21:10:51.008960+0000","last_fullsized":"2024-04-18T21:10:51.008960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-04-18T21:10:51.008759+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-04-18T21:10:51.008759+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.008759+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:15.642032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":616,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:09.391468+0000","last_change":"2024-04-18T21:11:09.391529+0000","last_active":"2024-04-18T21:11:09.391468+0000","last_peered":"2024-04-18T21:11:09.391468+0000","last_clean":"2024-04-18T21:11:09.391468+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:11:09.391468+0000","last_undegraded":"2024-04-18T21:11:09.391468+0000","last_fullsized":"2024-04-18T21:11:09.391468+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'443","last_scrub_stamp":"2024-04-18T21:11:09.391267+0000","last_deep_scrub":"74'443","last_deep_scrub_stamp":"2024-04-18T21:11:09.391267+0000","last_clean_scrub_stamp":"2024-04-18T21:11:09.391267+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:52:23.343994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":589,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:09.401415+0000","last_change":"2024-04-18T21:11:09.401539+0000","last_active":"2024-04-18T21:11:09.401415+0000","last_peered":"2024-04-18T21:11:09.401415+0000","last_clean":"2024-04-18T21:11:09.401415+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:11:09.401415+0000","last_undegraded":"2024-04-18T21:11:09.401415+0000","last_fullsized":"2024-04-18T21:11:09.401415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'405","last_scrub_stamp":"2024-04-18T21:11:09.401115+0000","last_deep_scrub":"74'405","last_deep_scrub_stamp":"2024-04-18T21:11:09.401115+0000","last_clean_scrub_stamp":"2024-04-18T21:11:09.401115+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:30.830268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"89'646","reported_seq":641,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:03.536961+0000","last_change":"2024-04-18T21:11:03.537036+0000","last_active":"2024-04-18T21:11:03.536961+0000","last_peered":"2024-04-18T21:11:03.536961+0000","last_clean":"2024-04-18T21:11:03.536961+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:11:03.536961+0000","last_undegraded":"2024-04-18T21:11:03.536961+0000","last_fullsized":"2024-04-18T21:11:03.536961+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'646","last_scrub_stamp":"2024-04-18T21:11:03.536777+0000","last_deep_scrub":"89'646","last_deep_scrub_stamp":"2024-04-18T21:11:03.536777+0000","last_clean_scrub_stamp":"2024-04-18T21:11:03.536777+0000","objects_scrubbed":4,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:21.990601+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":594,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.234527+0000","last_change":"2024-04-18T21:10:56.234588+0000","last_active":"2024-04-18T21:10:56.234527+0000","last_peered":"2024-04-18T21:10:56.234527+0000","last_clean":"2024-04-18T21:10:56.234527+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:56.234527+0000","last_undegraded":"2024-04-18T21:10:56.234527+0000","last_fullsized":"2024-04-18T21:10:56.234527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'420","last_scrub_stamp":"2024-04-18T21:10:56.234335+0000","last_deep_scrub":"74'420","last_deep_scrub_stamp":"2024-04-18T21:10:56.234335+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.234335+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:48.002634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":227,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:10.262889+0000","last_change":"2024-04-18T21:11:10.262951+0000","last_active":"2024-04-18T21:11:10.262889+0000","last_peered":"2024-04-18T21:11:10.262889+0000","last_clean":"2024-04-18T21:11:10.262889+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:11:10.262889+0000","last_undegraded":"2024-04-18T21:11:10.262889+0000","last_fullsized":"2024-04-18T21:11:10.262889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'53","last_scrub_stamp":"2024-04-18T21:11:10.262674+0000","last_deep_scrub":"72'53","last_deep_scrub_stamp":"2024-04-18T21:11:10.262674+0000","last_clean_scrub_stamp":"2024-04-18T21:11:10.262674+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:25.927468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":631,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:04.235547+0000","last_change":"2024-04-18T21:11:04.235607+0000","last_active":"2024-04-18T21:11:04.235547+0000","last_peered":"2024-04-18T21:11:04.235547+0000","last_clean":"2024-04-18T21:11:04.235547+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:11:04.235547+0000","last_undegraded":"2024-04-18T21:11:04.235547+0000","last_fullsized":"2024-04-18T21:11:04.235547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'412","last_scrub_stamp":"2024-04-18T21:11:04.235335+0000","last_deep_scrub":"74'412","last_deep_scrub_stamp":"2024-04-18T21:11:04.235335+0000","last_clean_scrub_stamp":"2024-04-18T21:11:04.235335+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:25.664489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":255,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.348616+0000","last_change":"2024-04-18T21:11:02.348740+0000","last_active":"2024-04-18T21:11:02.348616+0000","last_peered":"2024-04-18T21:11:02.348616+0000","last_clean":"2024-04-18T21:11:02.348616+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:11:02.348616+0000","last_undegraded":"2024-04-18T21:11:02.348616+0000","last_fullsized":"2024-04-18T21:11:02.348616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'81","last_scrub_stamp":"2024-04-18T21:11:02.348394+0000","last_deep_scrub":"72'81","last_deep_scrub_stamp":"2024-04-18T21:11:02.348394+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.348394+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:31.454039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.040333+0000","last_change":"2024-04-18T21:10:52.040390+0000","last_active":"2024-04-18T21:10:52.040333+0000","last_peered":"2024-04-18T21:10:52.040333+0000","last_clean":"2024-04-18T21:10:52.040333+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:52.040333+0000","last_undegraded":"2024-04-18T21:10:52.040333+0000","last_fullsized":"2024-04-18T21:10:52.040333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'393","last_scrub_stamp":"2024-04-18T21:10:52.040136+0000","last_deep_scrub":"74'393","last_deep_scrub_stamp":"2024-04-18T21:10:52.040136+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.040136+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:43.808436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"89'68","reported_seq":182,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:12.347986+0000","last_change":"2024-04-18T21:11:12.348072+0000","last_active":"2024-04-18T21:11:12.347986+0000","last_peered":"2024-04-18T21:11:12.347986+0000","last_clean":"2024-04-18T21:11:12.347986+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:11:12.347986+0000","last_undegraded":"2024-04-18T21:11:12.347986+0000","last_fullsized":"2024-04-18T21:11:12.347986+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'68","last_scrub_stamp":"2024-04-18T21:11:12.347785+0000","last_deep_scrub":"89'68","last_deep_scrub_stamp":"2024-04-18T21:11:12.347785+0000","last_clean_scrub_stamp":"2024-04-18T21:11:12.347785+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:44:55.674070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'167","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.451971+0000","last_change":"2024-04-18T21:10:59.452143+0000","last_active":"2024-04-18T21:10:59.451971+0000","last_peered":"2024-04-18T21:10:59.451971+0000","last_clean":"2024-04-18T21:10:59.451971+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:59.451971+0000","last_undegraded":"2024-04-18T21:10:59.451971+0000","last_fullsized":"2024-04-18T21:10:59.451971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'167","last_scrub_stamp":"2024-04-18T21:10:59.451742+0000","last_deep_scrub":"89'167","last_deep_scrub_stamp":"2024-04-18T21:10:59.451742+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.451742+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:00.584623+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":615,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.071510+0000","last_change":"2024-04-18T21:10:49.071636+0000","last_active":"2024-04-18T21:10:49.071510+0000","last_peered":"2024-04-18T21:10:49.071510+0000","last_clean":"2024-04-18T21:10:49.071510+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:49.071510+0000","last_undegraded":"2024-04-18T21:10:49.071510+0000","last_fullsized":"2024-04-18T21:10:49.071510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'417","last_scrub_stamp":"2024-04-18T21:10:49.071274+0000","last_deep_scrub":"74'417","last_deep_scrub_stamp":"2024-04-18T21:10:49.071274+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.071274+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:56.434174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"89'286","reported_seq":460,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.430211+0000","last_change":"2024-04-18T21:11:01.430284+0000","last_active":"2024-04-18T21:11:01.430211+0000","last_peered":"2024-04-18T21:11:01.430211+0000","last_clean":"2024-04-18T21:11:01.430211+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:11:01.430211+0000","last_undegraded":"2024-04-18T21:11:01.430211+0000","last_fullsized":"2024-04-18T21:11:01.430211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'286","last_scrub_stamp":"2024-04-18T21:11:01.430015+0000","last_deep_scrub":"89'286","last_deep_scrub_stamp":"2024-04-18T21:11:01.430015+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.430015+0000","objects_scrubbed":2,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:52.036683+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":655,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:12.457215+0000","last_change":"2024-04-18T21:11:12.457273+0000","last_active":"2024-04-18T21:11:12.457215+0000","last_peered":"2024-04-18T21:11:12.457215+0000","last_clean":"2024-04-18T21:11:12.457215+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:11:12.457215+0000","last_undegraded":"2024-04-18T21:11:12.457215+0000","last_fullsized":"2024-04-18T21:11:12.457215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'455","last_scrub_stamp":"2024-04-18T21:11:12.457017+0000","last_deep_scrub":"74'455","last_deep_scrub_stamp":"2024-04-18T21:11:12.457017+0000","last_clean_scrub_stamp":"2024-04-18T21:11:12.457017+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:37:39.409364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"89'560","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.523223+0000","last_change":"2024-04-18T21:10:50.523296+0000","last_active":"2024-04-18T21:10:50.523223+0000","last_peered":"2024-04-18T21:10:50.523223+0000","last_clean":"2024-04-18T21:10:50.523223+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:50.523223+0000","last_undegraded":"2024-04-18T21:10:50.523223+0000","last_fullsized":"2024-04-18T21:10:50.523223+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'560","last_scrub_stamp":"2024-04-18T21:10:50.523027+0000","last_deep_scrub":"89'560","last_deep_scrub_stamp":"2024-04-18T21:10:50.523027+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.523027+0000","objects_scrubbed":2,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:23:32.729636+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":708,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.543014+0000","last_change":"2024-04-18T21:10:41.543149+0000","last_active":"2024-04-18T21:10:41.543014+0000","last_peered":"2024-04-18T21:10:41.543014+0000","last_clean":"2024-04-18T21:10:41.543014+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:41.543014+0000","last_undegraded":"2024-04-18T21:10:41.543014+0000","last_fullsized":"2024-04-18T21:10:41.543014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'475","last_scrub_stamp":"2024-04-18T21:10:41.542789+0000","last_deep_scrub":"74'475","last_deep_scrub_stamp":"2024-04-18T21:10:41.542789+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.542789+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:28:54.188274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.539591+0000","last_change":"2024-04-18T21:10:47.539653+0000","last_active":"2024-04-18T21:10:47.539591+0000","last_peered":"2024-04-18T21:10:47.539591+0000","last_clean":"2024-04-18T21:10:47.539591+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:47.539591+0000","last_undegraded":"2024-04-18T21:10:47.539591+0000","last_fullsized":"2024-04-18T21:10:47.539591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'52","last_scrub_stamp":"2024-04-18T21:10:47.539398+0000","last_deep_scrub":"72'52","last_deep_scrub_stamp":"2024-04-18T21:10:47.539398+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.539398+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:57.377253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":709,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:11.215329+0000","last_change":"2024-04-18T21:11:11.215392+0000","last_active":"2024-04-18T21:11:11.215329+0000","last_peered":"2024-04-18T21:11:11.215329+0000","last_clean":"2024-04-18T21:11:11.215329+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:11:11.215329+0000","last_undegraded":"2024-04-18T21:11:11.215329+0000","last_fullsized":"2024-04-18T21:11:11.215329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'449","last_scrub_stamp":"2024-04-18T21:11:11.215132+0000","last_deep_scrub":"74'449","last_deep_scrub_stamp":"2024-04-18T21:11:11.215132+0000","last_clean_scrub_stamp":"2024-04-18T21:11:11.215132+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:50:12.124722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"89'174","reported_seq":348,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:09.271526+0000","last_change":"2024-04-18T21:11:09.271605+0000","last_active":"2024-04-18T21:11:09.271526+0000","last_peered":"2024-04-18T21:11:09.271526+0000","last_clean":"2024-04-18T21:11:09.271526+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:11:09.271526+0000","last_undegraded":"2024-04-18T21:11:09.271526+0000","last_fullsized":"2024-04-18T21:11:09.271526+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'174","last_scrub_stamp":"2024-04-18T21:11:09.271335+0000","last_deep_scrub":"89'174","last_deep_scrub_stamp":"2024-04-18T21:11:09.271335+0000","last_clean_scrub_stamp":"2024-04-18T21:11:09.271335+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:34.329460+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.470712+0000","last_change":"2024-04-18T21:10:58.470847+0000","last_active":"2024-04-18T21:10:58.470712+0000","last_peered":"2024-04-18T21:10:58.470712+0000","last_clean":"2024-04-18T21:10:58.470712+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:58.470712+0000","last_undegraded":"2024-04-18T21:10:58.470712+0000","last_fullsized":"2024-04-18T21:10:58.470712+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'462","last_scrub_stamp":"2024-04-18T21:10:58.470476+0000","last_deep_scrub":"74'462","last_deep_scrub_stamp":"2024-04-18T21:10:58.470476+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.470476+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:30.165777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"89'112","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.459818+0000","last_change":"2024-04-18T21:10:52.459963+0000","last_active":"2024-04-18T21:10:52.459818+0000","last_peered":"2024-04-18T21:10:52.459818+0000","last_clean":"2024-04-18T21:10:52.459818+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:52.459818+0000","last_undegraded":"2024-04-18T21:10:52.459818+0000","last_fullsized":"2024-04-18T21:10:52.459818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'112","last_scrub_stamp":"2024-04-18T21:10:52.459590+0000","last_deep_scrub":"89'112","last_deep_scrub_stamp":"2024-04-18T21:10:52.459590+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.459590+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:15.629219+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":618,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.548220+0000","last_change":"2024-04-18T21:10:43.548287+0000","last_active":"2024-04-18T21:10:43.548220+0000","last_peered":"2024-04-18T21:10:43.548220+0000","last_clean":"2024-04-18T21:10:43.548220+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:43.548220+0000","last_undegraded":"2024-04-18T21:10:43.548220+0000","last_fullsized":"2024-04-18T21:10:43.548220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'420","last_scrub_stamp":"2024-04-18T21:10:43.548042+0000","last_deep_scrub":"74'420","last_deep_scrub_stamp":"2024-04-18T21:10:43.548042+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.548042+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:49.418674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":231,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:03.363843+0000","last_change":"2024-04-18T21:11:03.363908+0000","last_active":"2024-04-18T21:11:03.363843+0000","last_peered":"2024-04-18T21:11:03.363843+0000","last_clean":"2024-04-18T21:11:03.363843+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:11:03.363843+0000","last_undegraded":"2024-04-18T21:11:03.363843+0000","last_fullsized":"2024-04-18T21:11:03.363843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'57","last_scrub_stamp":"2024-04-18T21:11:03.363634+0000","last_deep_scrub":"72'57","last_deep_scrub_stamp":"2024-04-18T21:11:03.363634+0000","last_clean_scrub_stamp":"2024-04-18T21:11:03.363634+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:27:20.405525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":533,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.453444+0000","last_change":"2024-04-18T21:10:57.453507+0000","last_active":"2024-04-18T21:10:57.453444+0000","last_peered":"2024-04-18T21:10:57.453444+0000","last_clean":"2024-04-18T21:10:57.453444+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:57.453444+0000","last_undegraded":"2024-04-18T21:10:57.453444+0000","last_fullsized":"2024-04-18T21:10:57.453444+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'371","last_scrub_stamp":"2024-04-18T21:10:57.453252+0000","last_deep_scrub":"74'371","last_deep_scrub_stamp":"2024-04-18T21:10:57.453252+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.453252+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:40.962115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"89'471","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.013442+0000","last_change":"2024-04-18T21:10:41.013618+0000","last_active":"2024-04-18T21:10:41.013442+0000","last_peered":"2024-04-18T21:10:41.013442+0000","last_clean":"2024-04-18T21:10:41.013442+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:41.013442+0000","last_undegraded":"2024-04-18T21:10:41.013442+0000","last_fullsized":"2024-04-18T21:10:41.013442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'471","last_scrub_stamp":"2024-04-18T21:10:41.013171+0000","last_deep_scrub":"89'471","last_deep_scrub_stamp":"2024-04-18T21:10:41.013171+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.013171+0000","objects_scrubbed":1,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:41.021777+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":683,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.010904+0000","last_change":"2024-04-18T21:10:41.010966+0000","last_active":"2024-04-18T21:10:41.010904+0000","last_peered":"2024-04-18T21:10:41.010904+0000","last_clean":"2024-04-18T21:10:41.010904+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:41.010904+0000","last_undegraded":"2024-04-18T21:10:41.010904+0000","last_fullsized":"2024-04-18T21:10:41.010904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'424","last_scrub_stamp":"2024-04-18T21:10:41.010667+0000","last_deep_scrub":"74'424","last_deep_scrub_stamp":"2024-04-18T21:10:41.010667+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.010667+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:11.233039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"89'159","reported_seq":337,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.435195+0000","last_change":"2024-04-18T21:11:00.435269+0000","last_active":"2024-04-18T21:11:00.435195+0000","last_peered":"2024-04-18T21:11:00.435195+0000","last_clean":"2024-04-18T21:11:00.435195+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:11:00.435195+0000","last_undegraded":"2024-04-18T21:11:00.435195+0000","last_fullsized":"2024-04-18T21:11:00.435195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'159","last_scrub_stamp":"2024-04-18T21:11:00.434987+0000","last_deep_scrub":"89'159","last_deep_scrub_stamp":"2024-04-18T21:11:00.434987+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.434987+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:32:07.664185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.436020+0000","last_change":"2024-04-18T21:11:02.436072+0000","last_active":"2024-04-18T21:11:02.436020+0000","last_peered":"2024-04-18T21:11:02.436020+0000","last_clean":"2024-04-18T21:11:02.436020+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:11:02.436020+0000","last_undegraded":"2024-04-18T21:11:02.436020+0000","last_fullsized":"2024-04-18T21:11:02.436020+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:02.435834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:02.435834+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.435834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:21:53.944208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"89'348","reported_seq":515,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.185519+0000","last_change":"2024-04-18T21:11:01.185586+0000","last_active":"2024-04-18T21:11:01.185519+0000","last_peered":"2024-04-18T21:11:01.185519+0000","last_clean":"2024-04-18T21:11:01.185519+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:11:01.185519+0000","last_undegraded":"2024-04-18T21:11:01.185519+0000","last_fullsized":"2024-04-18T21:11:01.185519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'348","last_scrub_stamp":"2024-04-18T21:11:01.185326+0000","last_deep_scrub":"89'348","last_deep_scrub_stamp":"2024-04-18T21:11:01.185326+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.185326+0000","objects_scrubbed":2,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:54:06.583314+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":618,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.564701+0000","last_change":"2024-04-18T21:10:40.564767+0000","last_active":"2024-04-18T21:10:40.564701+0000","last_peered":"2024-04-18T21:10:40.564701+0000","last_clean":"2024-04-18T21:10:40.564701+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:40.564701+0000","last_undegraded":"2024-04-18T21:10:40.564701+0000","last_fullsized":"2024-04-18T21:10:40.564701+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'429","last_scrub_stamp":"2024-04-18T21:10:40.564515+0000","last_deep_scrub":"74'429","last_deep_scrub_stamp":"2024-04-18T21:10:40.564515+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.564515+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:11.565225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:13.311281+0000","last_change":"2024-04-18T21:11:13.311340+0000","last_active":"2024-04-18T21:11:13.311281+0000","last_peered":"2024-04-18T21:11:13.311281+0000","last_clean":"2024-04-18T21:11:13.311281+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:11:13.311281+0000","last_undegraded":"2024-04-18T21:11:13.311281+0000","last_fullsized":"2024-04-18T21:11:13.311281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:13.311093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:13.311093+0000","last_clean_scrub_stamp":"2024-04-18T21:11:13.311093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:52.208813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"89'127","reported_seq":363,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:07.236081+0000","last_change":"2024-04-18T21:11:07.236226+0000","last_active":"2024-04-18T21:11:07.236081+0000","last_peered":"2024-04-18T21:11:07.236081+0000","last_clean":"2024-04-18T21:11:07.236081+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:11:07.236081+0000","last_undegraded":"2024-04-18T21:11:07.236081+0000","last_fullsized":"2024-04-18T21:11:07.236081+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'127","last_scrub_stamp":"2024-04-18T21:11:07.235838+0000","last_deep_scrub":"89'127","last_deep_scrub_stamp":"2024-04-18T21:11:07.235838+0000","last_clean_scrub_stamp":"2024-04-18T21:11:07.235838+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:37:34.188184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":715,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.300667+0000","last_change":"2024-04-18T21:10:59.300728+0000","last_active":"2024-04-18T21:10:59.300667+0000","last_peered":"2024-04-18T21:10:59.300667+0000","last_clean":"2024-04-18T21:10:59.300667+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:59.300667+0000","last_undegraded":"2024-04-18T21:10:59.300667+0000","last_fullsized":"2024-04-18T21:10:59.300667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'462","last_scrub_stamp":"2024-04-18T21:10:59.300475+0000","last_deep_scrub":"74'462","last_deep_scrub_stamp":"2024-04-18T21:10:59.300475+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.300475+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:43.051646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":173,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.127721+0000","last_change":"2024-04-18T21:10:57.127773+0000","last_active":"2024-04-18T21:10:57.127721+0000","last_peered":"2024-04-18T21:10:57.127721+0000","last_clean":"2024-04-18T21:10:57.127721+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:57.127721+0000","last_undegraded":"2024-04-18T21:10:57.127721+0000","last_fullsized":"2024-04-18T21:10:57.127721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:57.127483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:57.127483+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.127483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:38:07.176293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"89'288","reported_seq":463,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.190778+0000","last_change":"2024-04-18T21:10:51.190778+0000","last_active":"2024-04-18T21:10:51.190778+0000","last_peered":"2024-04-18T21:10:51.190778+0000","last_clean":"2024-04-18T21:10:51.190778+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:51.190778+0000","last_undegraded":"2024-04-18T21:10:51.190778+0000","last_fullsized":"2024-04-18T21:10:51.190778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'288","last_scrub_stamp":"2024-04-18T21:10:51.190517+0000","last_deep_scrub":"89'288","last_deep_scrub_stamp":"2024-04-18T21:10:51.190517+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.190517+0000","objects_scrubbed":2,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:48.012726+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":545,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.347372+0000","last_change":"2024-04-18T21:11:00.347433+0000","last_active":"2024-04-18T21:11:00.347372+0000","last_peered":"2024-04-18T21:11:00.347372+0000","last_clean":"2024-04-18T21:11:00.347372+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:11:00.347372+0000","last_undegraded":"2024-04-18T21:11:00.347372+0000","last_fullsized":"2024-04-18T21:11:00.347372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'338","last_scrub_stamp":"2024-04-18T21:11:00.347178+0000","last_deep_scrub":"74'338","last_deep_scrub_stamp":"2024-04-18T21:11:00.347178+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.347178+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:18.608439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.447133+0000","last_change":"2024-04-18T21:10:51.447264+0000","last_active":"2024-04-18T21:10:51.447133+0000","last_peered":"2024-04-18T21:10:51.447133+0000","last_clean":"2024-04-18T21:10:51.447133+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:51.447133+0000","last_undegraded":"2024-04-18T21:10:51.447133+0000","last_fullsized":"2024-04-18T21:10:51.447133+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:51.446814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:51.446814+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.446814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:45:51.001777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:04.439176+0000","last_change":"2024-04-18T21:11:04.439237+0000","last_active":"2024-04-18T21:11:04.439176+0000","last_peered":"2024-04-18T21:11:04.439176+0000","last_clean":"2024-04-18T21:11:04.439176+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:11:04.439176+0000","last_undegraded":"2024-04-18T21:11:04.439176+0000","last_fullsized":"2024-04-18T21:11:04.439176+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'62","last_scrub_stamp":"2024-04-18T21:11:04.438988+0000","last_deep_scrub":"72'62","last_deep_scrub_stamp":"2024-04-18T21:11:04.438988+0000","last_clean_scrub_stamp":"2024-04-18T21:11:04.438988+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:59:35.430355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.036697+0000","last_change":"2024-04-18T21:10:43.036815+0000","last_active":"2024-04-18T21:10:43.036697+0000","last_peered":"2024-04-18T21:10:43.036697+0000","last_clean":"2024-04-18T21:10:43.036697+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:43.036697+0000","last_undegraded":"2024-04-18T21:10:43.036697+0000","last_fullsized":"2024-04-18T21:10:43.036697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'397","last_scrub_stamp":"2024-04-18T21:10:43.036408+0000","last_deep_scrub":"74'397","last_deep_scrub_stamp":"2024-04-18T21:10:43.036408+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.036408+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:17:15.381816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'253","reported_seq":303,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.544896+0000","last_change":"2024-04-18T21:10:44.544976+0000","last_active":"2024-04-18T21:10:44.544896+0000","last_peered":"2024-04-18T21:10:44.544896+0000","last_clean":"2024-04-18T21:10:44.544896+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:44.544896+0000","last_undegraded":"2024-04-18T21:10:44.544896+0000","last_fullsized":"2024-04-18T21:10:44.544896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'253","last_scrub_stamp":"2024-04-18T21:10:44.544697+0000","last_deep_scrub":"89'253","last_deep_scrub_stamp":"2024-04-18T21:10:44.544697+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.544697+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:07:32.731155+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.107478+0000","last_change":"2024-04-18T21:10:56.107529+0000","last_active":"2024-04-18T21:10:56.107478+0000","last_peered":"2024-04-18T21:10:56.107478+0000","last_clean":"2024-04-18T21:10:56.107478+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:56.107478+0000","last_undegraded":"2024-04-18T21:10:56.107478+0000","last_fullsized":"2024-04-18T21:10:56.107478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:56.107288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:56.107288+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.107288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.217572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":586,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.008640+0000","last_change":"2024-04-18T21:10:44.008705+0000","last_active":"2024-04-18T21:10:44.008640+0000","last_peered":"2024-04-18T21:10:44.008640+0000","last_clean":"2024-04-18T21:10:44.008640+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:44.008640+0000","last_undegraded":"2024-04-18T21:10:44.008640+0000","last_fullsized":"2024-04-18T21:10:44.008640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'376","last_scrub_stamp":"2024-04-18T21:10:44.008446+0000","last_deep_scrub":"74'376","last_deep_scrub_stamp":"2024-04-18T21:10:44.008446+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.008446+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:36.590534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":230,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.089203+0000","last_change":"2024-04-18T21:10:59.089365+0000","last_active":"2024-04-18T21:10:59.089203+0000","last_peered":"2024-04-18T21:10:59.089203+0000","last_clean":"2024-04-18T21:10:59.089203+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:59.089203+0000","last_undegraded":"2024-04-18T21:10:59.089203+0000","last_fullsized":"2024-04-18T21:10:59.089203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'63","last_scrub_stamp":"2024-04-18T21:10:59.088955+0000","last_deep_scrub":"72'63","last_deep_scrub_stamp":"2024-04-18T21:10:59.088955+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.088955+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:09.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:13.436848+0000","last_change":"2024-04-18T21:11:13.436904+0000","last_active":"2024-04-18T21:11:13.436848+0000","last_peered":"2024-04-18T21:11:13.436848+0000","last_clean":"2024-04-18T21:11:13.436848+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:11:13.436848+0000","last_undegraded":"2024-04-18T21:11:13.436848+0000","last_fullsized":"2024-04-18T21:11:13.436848+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:13.436653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:13.436653+0000","last_clean_scrub_stamp":"2024-04-18T21:11:13.436653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:49:23.914036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.994715+0000","last_change":"2024-04-18T21:10:41.994715+0000","last_active":"2024-04-18T21:10:41.994715+0000","last_peered":"2024-04-18T21:10:41.994715+0000","last_clean":"2024-04-18T21:10:41.994715+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:41.994715+0000","last_undegraded":"2024-04-18T21:10:41.994715+0000","last_fullsized":"2024-04-18T21:10:41.994715+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'402","last_scrub_stamp":"2024-04-18T21:10:41.994461+0000","last_deep_scrub":"74'402","last_deep_scrub_stamp":"2024-04-18T21:10:41.994461+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.994461+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:56.353553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"89'64","reported_seq":231,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.187273+0000","last_change":"2024-04-18T21:11:02.187336+0000","last_active":"2024-04-18T21:11:02.187273+0000","last_peered":"2024-04-18T21:11:02.187273+0000","last_clean":"2024-04-18T21:11:02.187273+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:11:02.187273+0000","last_undegraded":"2024-04-18T21:11:02.187273+0000","last_fullsized":"2024-04-18T21:11:02.187273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'64","last_scrub_stamp":"2024-04-18T21:11:02.187081+0000","last_deep_scrub":"89'64","last_deep_scrub_stamp":"2024-04-18T21:11:02.187081+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.187081+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:45.559454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.094112+0000","last_change":"2024-04-18T21:10:58.094163+0000","last_active":"2024-04-18T21:10:58.094112+0000","last_peered":"2024-04-18T21:10:58.094112+0000","last_clean":"2024-04-18T21:10:58.094112+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:58.094112+0000","last_undegraded":"2024-04-18T21:10:58.094112+0000","last_fullsized":"2024-04-18T21:10:58.094112+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:58.093922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:58.093922+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.093922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:27:15.135813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:08.251826+0000","last_change":"2024-04-18T21:11:08.251826+0000","last_active":"2024-04-18T21:11:08.251826+0000","last_peered":"2024-04-18T21:11:08.251826+0000","last_clean":"2024-04-18T21:11:08.251826+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:11:08.251826+0000","last_undegraded":"2024-04-18T21:11:08.251826+0000","last_fullsized":"2024-04-18T21:11:08.251826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'392","last_scrub_stamp":"2024-04-18T21:11:08.251569+0000","last_deep_scrub":"74'392","last_deep_scrub_stamp":"2024-04-18T21:11:08.251569+0000","last_clean_scrub_stamp":"2024-04-18T21:11:08.251569+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:49:18.728952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"89'110","reported_seq":251,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.993904+0000","last_change":"2024-04-18T21:10:49.993970+0000","last_active":"2024-04-18T21:10:49.993904+0000","last_peered":"2024-04-18T21:10:49.993904+0000","last_clean":"2024-04-18T21:10:49.993904+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:49.993904+0000","last_undegraded":"2024-04-18T21:10:49.993904+0000","last_fullsized":"2024-04-18T21:10:49.993904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'110","last_scrub_stamp":"2024-04-18T21:10:49.993694+0000","last_deep_scrub":"89'110","last_deep_scrub_stamp":"2024-04-18T21:10:49.993694+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.993694+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.920224+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:07.410856+0000","last_change":"2024-04-18T21:11:07.410918+0000","last_active":"2024-04-18T21:11:07.410856+0000","last_peered":"2024-04-18T21:11:07.410856+0000","last_clean":"2024-04-18T21:11:07.410856+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:11:07.410856+0000","last_undegraded":"2024-04-18T21:11:07.410856+0000","last_fullsized":"2024-04-18T21:11:07.410856+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:07.410669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:07.410669+0000","last_clean_scrub_stamp":"2024-04-18T21:11:07.410669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:34.543487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":625,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:04.377811+0000","last_change":"2024-04-18T21:11:04.377872+0000","last_active":"2024-04-18T21:11:04.377811+0000","last_peered":"2024-04-18T21:11:04.377811+0000","last_clean":"2024-04-18T21:11:04.377811+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:11:04.377811+0000","last_undegraded":"2024-04-18T21:11:04.377811+0000","last_fullsized":"2024-04-18T21:11:04.377811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'401","last_scrub_stamp":"2024-04-18T21:11:04.377611+0000","last_deep_scrub":"74'401","last_deep_scrub_stamp":"2024-04-18T21:11:04.377611+0000","last_clean_scrub_stamp":"2024-04-18T21:11:04.377611+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:15.168584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":642,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.501930+0000","last_change":"2024-04-18T21:10:48.501989+0000","last_active":"2024-04-18T21:10:48.501930+0000","last_peered":"2024-04-18T21:10:48.501930+0000","last_clean":"2024-04-18T21:10:48.501930+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:48.501930+0000","last_undegraded":"2024-04-18T21:10:48.501930+0000","last_fullsized":"2024-04-18T21:10:48.501930+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'418","last_scrub_stamp":"2024-04-18T21:10:48.501732+0000","last_deep_scrub":"74'418","last_deep_scrub_stamp":"2024-04-18T21:10:48.501732+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.501732+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:30.654262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"89'255","reported_seq":408,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:06.431602+0000","last_change":"2024-04-18T21:11:06.431789+0000","last_active":"2024-04-18T21:11:06.431602+0000","last_peered":"2024-04-18T21:11:06.431602+0000","last_clean":"2024-04-18T21:11:06.431602+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:11:06.431602+0000","last_undegraded":"2024-04-18T21:11:06.431602+0000","last_fullsized":"2024-04-18T21:11:06.431602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'255","last_scrub_stamp":"2024-04-18T21:11:06.431368+0000","last_deep_scrub":"89'255","last_deep_scrub_stamp":"2024-04-18T21:11:06.431368+0000","last_clean_scrub_stamp":"2024-04-18T21:11:06.431368+0000","objects_scrubbed":5,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:45:58.638918+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":578,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.086614+0000","last_change":"2024-04-18T21:10:53.086683+0000","last_active":"2024-04-18T21:10:53.086614+0000","last_peered":"2024-04-18T21:10:53.086614+0000","last_clean":"2024-04-18T21:10:53.086614+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:53.086614+0000","last_undegraded":"2024-04-18T21:10:53.086614+0000","last_fullsized":"2024-04-18T21:10:53.086614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'398","last_scrub_stamp":"2024-04-18T21:10:53.086251+0000","last_deep_scrub":"74'398","last_deep_scrub_stamp":"2024-04-18T21:10:53.086251+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.086251+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:05.595545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'79","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.018963+0000","last_change":"2024-04-18T21:10:43.019130+0000","last_active":"2024-04-18T21:10:43.018963+0000","last_peered":"2024-04-18T21:10:43.018963+0000","last_clean":"2024-04-18T21:10:43.018963+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:43.018963+0000","last_undegraded":"2024-04-18T21:10:43.018963+0000","last_fullsized":"2024-04-18T21:10:43.018963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'79","last_scrub_stamp":"2024-04-18T21:10:43.018744+0000","last_deep_scrub":"89'79","last_deep_scrub_stamp":"2024-04-18T21:10:43.018744+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.018744+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:26.019419+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"89'243","reported_seq":276,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.419262+0000","last_change":"2024-04-18T21:11:01.419405+0000","last_active":"2024-04-18T21:11:01.419262+0000","last_peered":"2024-04-18T21:11:01.419262+0000","last_clean":"2024-04-18T21:11:01.419262+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:11:01.419262+0000","last_undegraded":"2024-04-18T21:11:01.419262+0000","last_fullsized":"2024-04-18T21:11:01.419262+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'243","last_scrub_stamp":"2024-04-18T21:11:01.419031+0000","last_deep_scrub":"89'243","last_deep_scrub_stamp":"2024-04-18T21:11:01.419031+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.419031+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:29:26.700232+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":677,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:06.249460+0000","last_change":"2024-04-18T21:11:06.249538+0000","last_active":"2024-04-18T21:11:06.249460+0000","last_peered":"2024-04-18T21:11:06.249460+0000","last_clean":"2024-04-18T21:11:06.249460+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:11:06.249460+0000","last_undegraded":"2024-04-18T21:11:06.249460+0000","last_fullsized":"2024-04-18T21:11:06.249460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'475","last_scrub_stamp":"2024-04-18T21:11:06.249255+0000","last_deep_scrub":"74'475","last_deep_scrub_stamp":"2024-04-18T21:11:06.249255+0000","last_clean_scrub_stamp":"2024-04-18T21:11:06.249255+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:44.146727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":237,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.954768+0000","last_change":"2024-04-18T21:10:45.954906+0000","last_active":"2024-04-18T21:10:45.954768+0000","last_peered":"2024-04-18T21:10:45.954768+0000","last_clean":"2024-04-18T21:10:45.954768+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:45.954768+0000","last_undegraded":"2024-04-18T21:10:45.954768+0000","last_fullsized":"2024-04-18T21:10:45.954768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'63","last_scrub_stamp":"2024-04-18T21:10:45.954547+0000","last_deep_scrub":"72'63","last_deep_scrub_stamp":"2024-04-18T21:10:45.954547+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.954547+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:29.545083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.934454+0000","last_change":"2024-04-18T21:10:48.934518+0000","last_active":"2024-04-18T21:10:48.934454+0000","last_peered":"2024-04-18T21:10:48.934454+0000","last_clean":"2024-04-18T21:10:48.934454+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:48.934454+0000","last_undegraded":"2024-04-18T21:10:48.934454+0000","last_fullsized":"2024-04-18T21:10:48.934454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'446","last_scrub_stamp":"2024-04-18T21:10:48.934255+0000","last_deep_scrub":"74'446","last_deep_scrub_stamp":"2024-04-18T21:10:48.934255+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.934255+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.407364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":537,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.237261+0000","last_change":"2024-04-18T21:10:57.237321+0000","last_active":"2024-04-18T21:10:57.237261+0000","last_peered":"2024-04-18T21:10:57.237261+0000","last_clean":"2024-04-18T21:10:57.237261+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:57.237261+0000","last_undegraded":"2024-04-18T21:10:57.237261+0000","last_fullsized":"2024-04-18T21:10:57.237261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'343","last_scrub_stamp":"2024-04-18T21:10:57.237066+0000","last_deep_scrub":"74'343","last_deep_scrub_stamp":"2024-04-18T21:10:57.237066+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.237066+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:09.746360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"89'618","reported_seq":785,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:03.272120+0000","last_change":"2024-04-18T21:11:03.272192+0000","last_active":"2024-04-18T21:11:03.272120+0000","last_peered":"2024-04-18T21:11:03.272120+0000","last_clean":"2024-04-18T21:11:03.272120+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:11:03.272120+0000","last_undegraded":"2024-04-18T21:11:03.272120+0000","last_fullsized":"2024-04-18T21:11:03.272120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'618","last_scrub_stamp":"2024-04-18T21:11:03.271930+0000","last_deep_scrub":"89'618","last_deep_scrub_stamp":"2024-04-18T21:11:03.271930+0000","last_clean_scrub_stamp":"2024-04-18T21:11:03.271930+0000","objects_scrubbed":2,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:45.266197+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.058717+0000","last_change":"2024-04-18T21:10:54.058717+0000","last_active":"2024-04-18T21:10:54.058717+0000","last_peered":"2024-04-18T21:10:54.058717+0000","last_clean":"2024-04-18T21:10:54.058717+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:54.058717+0000","last_undegraded":"2024-04-18T21:10:54.058717+0000","last_fullsized":"2024-04-18T21:10:54.058717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:54.058451+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:54.058451+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.058451+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:43.113325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"89'207","reported_seq":381,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:05.259354+0000","last_change":"2024-04-18T21:11:05.259482+0000","last_active":"2024-04-18T21:11:05.259354+0000","last_peered":"2024-04-18T21:11:05.259354+0000","last_clean":"2024-04-18T21:11:05.259354+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:11:05.259354+0000","last_undegraded":"2024-04-18T21:11:05.259354+0000","last_fullsized":"2024-04-18T21:11:05.259354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'207","last_scrub_stamp":"2024-04-18T21:11:05.259136+0000","last_deep_scrub":"89'207","last_deep_scrub_stamp":"2024-04-18T21:11:05.259136+0000","last_clean_scrub_stamp":"2024-04-18T21:11:05.259136+0000","objects_scrubbed":1,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:45.485224+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.964831+0000","last_change":"2024-04-18T21:10:41.964977+0000","last_active":"2024-04-18T21:10:41.964831+0000","last_peered":"2024-04-18T21:10:41.964831+0000","last_clean":"2024-04-18T21:10:41.964831+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:41.964831+0000","last_undegraded":"2024-04-18T21:10:41.964831+0000","last_fullsized":"2024-04-18T21:10:41.964831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:41.964596+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:41.964596+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.964596+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:44:13.418017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"89'189","reported_seq":304,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.175813+0000","last_change":"2024-04-18T21:10:52.175887+0000","last_active":"2024-04-18T21:10:52.175813+0000","last_peered":"2024-04-18T21:10:52.175813+0000","last_clean":"2024-04-18T21:10:52.175813+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:52.175813+0000","last_undegraded":"2024-04-18T21:10:52.175813+0000","last_fullsized":"2024-04-18T21:10:52.175813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'189","last_scrub_stamp":"2024-04-18T21:10:52.175618+0000","last_deep_scrub":"89'189","last_deep_scrub_stamp":"2024-04-18T21:10:52.175618+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.175618+0000","objects_scrubbed":3,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:29.442474+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":572,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:10.446620+0000","last_change":"2024-04-18T21:11:10.446679+0000","last_active":"2024-04-18T21:11:10.446620+0000","last_peered":"2024-04-18T21:11:10.446620+0000","last_clean":"2024-04-18T21:11:10.446620+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:11:10.446620+0000","last_undegraded":"2024-04-18T21:11:10.446620+0000","last_fullsized":"2024-04-18T21:11:10.446620+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'397","last_scrub_stamp":"2024-04-18T21:11:10.446425+0000","last_deep_scrub":"74'397","last_deep_scrub_stamp":"2024-04-18T21:11:10.446425+0000","last_clean_scrub_stamp":"2024-04-18T21:11:10.446425+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:50.672513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"89'58","reported_seq":232,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.043350+0000","last_change":"2024-04-18T21:10:47.043413+0000","last_active":"2024-04-18T21:10:47.043350+0000","last_peered":"2024-04-18T21:10:47.043350+0000","last_clean":"2024-04-18T21:10:47.043350+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:47.043350+0000","last_undegraded":"2024-04-18T21:10:47.043350+0000","last_fullsized":"2024-04-18T21:10:47.043350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'58","last_scrub_stamp":"2024-04-18T21:10:47.043155+0000","last_deep_scrub":"89'58","last_deep_scrub_stamp":"2024-04-18T21:10:47.043155+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.043155+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:01.402247+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":537,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.508770+0000","last_change":"2024-04-18T21:10:49.508837+0000","last_active":"2024-04-18T21:10:49.508770+0000","last_peered":"2024-04-18T21:10:49.508770+0000","last_clean":"2024-04-18T21:10:49.508770+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:49.508770+0000","last_undegraded":"2024-04-18T21:10:49.508770+0000","last_fullsized":"2024-04-18T21:10:49.508770+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'368","last_scrub_stamp":"2024-04-18T21:10:49.508563+0000","last_deep_scrub":"74'368","last_deep_scrub_stamp":"2024-04-18T21:10:49.508563+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.508563+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:16.454033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"89'180","reported_seq":263,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:05.446770+0000","last_change":"2024-04-18T21:11:05.446839+0000","last_active":"2024-04-18T21:11:05.446770+0000","last_peered":"2024-04-18T21:11:05.446770+0000","last_clean":"2024-04-18T21:11:05.446770+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:11:05.446770+0000","last_undegraded":"2024-04-18T21:11:05.446770+0000","last_fullsized":"2024-04-18T21:11:05.446770+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'180","last_scrub_stamp":"2024-04-18T21:11:05.446588+0000","last_deep_scrub":"89'180","last_deep_scrub_stamp":"2024-04-18T21:11:05.446588+0000","last_clean_scrub_stamp":"2024-04-18T21:11:05.446588+0000","objects_scrubbed":2,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:59:18.457517+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.421016+0000","last_change":"2024-04-18T21:10:54.421161+0000","last_active":"2024-04-18T21:10:54.421016+0000","last_peered":"2024-04-18T21:10:54.421016+0000","last_clean":"2024-04-18T21:10:54.421016+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:54.421016+0000","last_undegraded":"2024-04-18T21:10:54.421016+0000","last_fullsized":"2024-04-18T21:10:54.421016+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'402","last_scrub_stamp":"2024-04-18T21:10:54.420766+0000","last_deep_scrub":"74'402","last_deep_scrub_stamp":"2024-04-18T21:10:54.420766+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.420766+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:27:28.968229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"89'195","reported_seq":369,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.096115+0000","last_change":"2024-04-18T21:10:45.096295+0000","last_active":"2024-04-18T21:10:45.096115+0000","last_peered":"2024-04-18T21:10:45.096115+0000","last_clean":"2024-04-18T21:10:45.096115+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:45.096115+0000","last_undegraded":"2024-04-18T21:10:45.096115+0000","last_fullsized":"2024-04-18T21:10:45.096115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'195","last_scrub_stamp":"2024-04-18T21:10:45.095889+0000","last_deep_scrub":"89'195","last_deep_scrub_stamp":"2024-04-18T21:10:45.095889+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.095889+0000","objects_scrubbed":4,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:38:46.648098+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:11.424080+0000","last_change":"2024-04-18T21:11:11.424141+0000","last_active":"2024-04-18T21:11:11.424080+0000","last_peered":"2024-04-18T21:11:11.424080+0000","last_clean":"2024-04-18T21:11:11.424080+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:11:11.424080+0000","last_undegraded":"2024-04-18T21:11:11.424080+0000","last_fullsized":"2024-04-18T21:11:11.424080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'414","last_scrub_stamp":"2024-04-18T21:11:11.423871+0000","last_deep_scrub":"74'414","last_deep_scrub_stamp":"2024-04-18T21:11:11.423871+0000","last_clean_scrub_stamp":"2024-04-18T21:11:11.423871+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:49.321344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"89'173","reported_seq":341,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.138648+0000","last_change":"2024-04-18T21:11:00.138648+0000","last_active":"2024-04-18T21:11:00.138648+0000","last_peered":"2024-04-18T21:11:00.138648+0000","last_clean":"2024-04-18T21:11:00.138648+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:11:00.138648+0000","last_undegraded":"2024-04-18T21:11:00.138648+0000","last_fullsized":"2024-04-18T21:11:00.138648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'173","last_scrub_stamp":"2024-04-18T21:11:00.138488+0000","last_deep_scrub":"89'173","last_deep_scrub_stamp":"2024-04-18T21:11:00.138488+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.138488+0000","objects_scrubbed":1,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:15.514469+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:11.362463+0000","last_change":"2024-04-18T21:11:11.362525+0000","last_active":"2024-04-18T21:11:11.362463+0000","last_peered":"2024-04-18T21:11:11.362463+0000","last_clean":"2024-04-18T21:11:11.362463+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:11:11.362463+0000","last_undegraded":"2024-04-18T21:11:11.362463+0000","last_fullsized":"2024-04-18T21:11:11.362463+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'440","last_scrub_stamp":"2024-04-18T21:11:11.362250+0000","last_deep_scrub":"74'440","last_deep_scrub_stamp":"2024-04-18T21:11:11.362250+0000","last_clean_scrub_stamp":"2024-04-18T21:11:11.362250+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:32.526096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"89'62","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.028888+0000","last_change":"2024-04-18T21:10:44.028955+0000","last_active":"2024-04-18T21:10:44.028888+0000","last_peered":"2024-04-18T21:10:44.028888+0000","last_clean":"2024-04-18T21:10:44.028888+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:44.028888+0000","last_undegraded":"2024-04-18T21:10:44.028888+0000","last_fullsized":"2024-04-18T21:10:44.028888+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'62","last_scrub_stamp":"2024-04-18T21:10:44.028700+0000","last_deep_scrub":"89'62","last_deep_scrub_stamp":"2024-04-18T21:10:44.028700+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.028700+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:51.391600+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6364,"ondisk_log_size":6364,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738449,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103660,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268180,"statfs":{"total":96636764160,"available":96530616320,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738449,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103540,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268300,"statfs":{"total":96636764160,"available":96530739200,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350990,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:11:20.024 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-18T21:05:07.559603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:11:20.026 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T21:11:40.027 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:11:40.338 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:11:40.341 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T21:11:40.357 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-04-18T21:11:39.760487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127727781,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2944,"num_read_kb":1423538,"num_write":29185,"num_write_kb":4221139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":701553,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33043,"ondisk_log_size":33043,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":265728,"kb_used_data":85224,"kb_used_omap":137,"kb_used_meta":180342,"kb_avail":282849792,"statfs":{"total":289910292480,"available":289638187008,"internally_reserved":0,"allocated":87269376,"data_stored":256541526,"data_compressed":37952938,"data_compressed_allocated":49315840,"data_compressed_original":219783168,"omap_allocated":141029,"internal_metadata":184670491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004325"},"pg_stats":[{"pgid":"4.3f","version":"74'396","reported_seq":592,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:08.373177+0000","last_change":"2024-04-18T21:11:08.373237+0000","last_active":"2024-04-18T21:11:08.373177+0000","last_peered":"2024-04-18T21:11:08.373177+0000","last_clean":"2024-04-18T21:11:08.373177+0000","last_became_active":"2024-04-18T21:10:23.931161+0000","last_became_peered":"2024-04-18T21:10:23.931161+0000","last_unstale":"2024-04-18T21:11:08.373177+0000","last_undegraded":"2024-04-18T21:11:08.373177+0000","last_fullsized":"2024-04-18T21:11:08.373177+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'396","last_scrub_stamp":"2024-04-18T21:11:08.372977+0000","last_deep_scrub":"74'396","last_deep_scrub_stamp":"2024-04-18T21:11:08.372977+0000","last_clean_scrub_stamp":"2024-04-18T21:11:08.372977+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:50.367244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32204,"num_write":353,"num_write_kb":42344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"74'430","reported_seq":619,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.148595+0000","last_change":"2024-04-18T21:10:54.148662+0000","last_active":"2024-04-18T21:10:54.148595+0000","last_peered":"2024-04-18T21:10:54.148595+0000","last_clean":"2024-04-18T21:10:54.148595+0000","last_became_active":"2024-04-18T21:10:23.921222+0000","last_became_peered":"2024-04-18T21:10:23.921222+0000","last_unstale":"2024-04-18T21:10:54.148595+0000","last_undegraded":"2024-04-18T21:10:54.148595+0000","last_fullsized":"2024-04-18T21:10:54.148595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'430","last_scrub_stamp":"2024-04-18T21:10:54.148404+0000","last_deep_scrub":"74'430","last_deep_scrub_stamp":"2024-04-18T21:10:54.148404+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.148404+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:09:54.547034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28261,"num_write":404,"num_write_kb":108920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"74'382","reported_seq":548,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:15.400964+0000","last_change":"2024-04-18T21:11:15.401028+0000","last_active":"2024-04-18T21:11:15.400964+0000","last_peered":"2024-04-18T21:11:15.400964+0000","last_clean":"2024-04-18T21:11:15.400964+0000","last_became_active":"2024-04-18T21:10:26.242651+0000","last_became_peered":"2024-04-18T21:10:26.242651+0000","last_unstale":"2024-04-18T21:11:15.400964+0000","last_undegraded":"2024-04-18T21:11:15.400964+0000","last_fullsized":"2024-04-18T21:11:15.400964+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'382","last_scrub_stamp":"2024-04-18T21:11:15.400777+0000","last_deep_scrub":"74'382","last_deep_scrub_stamp":"2024-04-18T21:11:15.400777+0000","last_clean_scrub_stamp":"2024-04-18T21:11:15.400777+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:23.023294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20612,"num_write":356,"num_write_kb":43216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"74'388","reported_seq":547,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.413433+0000","last_change":"2024-04-18T21:10:56.413498+0000","last_active":"2024-04-18T21:10:56.413433+0000","last_peered":"2024-04-18T21:10:56.413433+0000","last_clean":"2024-04-18T21:10:56.413433+0000","last_became_active":"2024-04-18T21:10:26.207526+0000","last_became_peered":"2024-04-18T21:10:26.207526+0000","last_unstale":"2024-04-18T21:10:56.413433+0000","last_undegraded":"2024-04-18T21:10:56.413433+0000","last_fullsized":"2024-04-18T21:10:56.413433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'388","last_scrub_stamp":"2024-04-18T21:10:56.413249+0000","last_deep_scrub":"74'388","last_deep_scrub_stamp":"2024-04-18T21:10:56.413249+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.413249+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:55:45.634198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12364,"num_write":351,"num_write_kb":67454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"74'445","reported_seq":621,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.096084+0000","last_change":"2024-04-18T21:10:50.096147+0000","last_active":"2024-04-18T21:10:50.096084+0000","last_peered":"2024-04-18T21:10:50.096084+0000","last_clean":"2024-04-18T21:10:50.096084+0000","last_became_active":"2024-04-18T21:10:23.917606+0000","last_became_peered":"2024-04-18T21:10:23.917606+0000","last_unstale":"2024-04-18T21:10:50.096084+0000","last_undegraded":"2024-04-18T21:10:50.096084+0000","last_fullsized":"2024-04-18T21:10:50.096084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'445","last_scrub_stamp":"2024-04-18T21:10:50.095884+0000","last_deep_scrub":"74'445","last_deep_scrub_stamp":"2024-04-18T21:10:50.095884+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.095884+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:39.544011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20553,"num_write":414,"num_write_kb":72100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"74'394","reported_seq":560,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:08.364774+0000","last_change":"2024-04-18T21:11:08.364838+0000","last_active":"2024-04-18T21:11:08.364774+0000","last_peered":"2024-04-18T21:11:08.364774+0000","last_clean":"2024-04-18T21:11:08.364774+0000","last_became_active":"2024-04-18T21:10:26.212169+0000","last_became_peered":"2024-04-18T21:10:26.212169+0000","last_unstale":"2024-04-18T21:11:08.364774+0000","last_undegraded":"2024-04-18T21:11:08.364774+0000","last_fullsized":"2024-04-18T21:11:08.364774+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'394","last_scrub_stamp":"2024-04-18T21:11:08.364587+0000","last_deep_scrub":"74'394","last_deep_scrub_stamp":"2024-04-18T21:11:08.364587+0000","last_clean_scrub_stamp":"2024-04-18T21:11:08.364587+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:59.469731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":22917,"num_write":369,"num_write_kb":41591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"74'414","reported_seq":605,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.438733+0000","last_change":"2024-04-18T21:10:53.438860+0000","last_active":"2024-04-18T21:10:53.438733+0000","last_peered":"2024-04-18T21:10:53.438733+0000","last_clean":"2024-04-18T21:10:53.438733+0000","last_became_active":"2024-04-18T21:10:26.203320+0000","last_became_peered":"2024-04-18T21:10:26.203320+0000","last_unstale":"2024-04-18T21:10:53.438733+0000","last_undegraded":"2024-04-18T21:10:53.438733+0000","last_fullsized":"2024-04-18T21:10:53.438733+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'414","last_scrub_stamp":"2024-04-18T21:10:53.438520+0000","last_deep_scrub":"74'414","last_deep_scrub_stamp":"2024-04-18T21:10:53.438520+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.438520+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:08:26.410323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29850,"num_write":381,"num_write_kb":55351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"74'371","reported_seq":539,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.547439+0000","last_change":"2024-04-18T21:10:42.547623+0000","last_active":"2024-04-18T21:10:42.547439+0000","last_peered":"2024-04-18T21:10:42.547439+0000","last_clean":"2024-04-18T21:10:42.547439+0000","last_became_active":"2024-04-18T21:10:26.203598+0000","last_became_peered":"2024-04-18T21:10:26.203598+0000","last_unstale":"2024-04-18T21:10:42.547439+0000","last_undegraded":"2024-04-18T21:10:42.547439+0000","last_fullsized":"2024-04-18T21:10:42.547439+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'371","last_scrub_stamp":"2024-04-18T21:10:42.547204+0000","last_deep_scrub":"74'371","last_deep_scrub_stamp":"2024-04-18T21:10:42.547204+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.547204+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:22.049656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":10609,"num_write":332,"num_write_kb":50885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"74'447","reported_seq":670,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.975806+0000","last_change":"2024-04-18T21:10:44.975956+0000","last_active":"2024-04-18T21:10:44.975806+0000","last_peered":"2024-04-18T21:10:44.975806+0000","last_clean":"2024-04-18T21:10:44.975806+0000","last_became_active":"2024-04-18T21:05:08.604051+0000","last_became_peered":"2024-04-18T21:05:08.604051+0000","last_unstale":"2024-04-18T21:10:44.975806+0000","last_undegraded":"2024-04-18T21:10:44.975806+0000","last_fullsized":"2024-04-18T21:10:44.975806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'447","last_scrub_stamp":"2024-04-18T21:10:44.975572+0000","last_deep_scrub":"74'447","last_deep_scrub_stamp":"2024-04-18T21:10:44.975572+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.975572+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:51.968653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37342,"num_write":416,"num_write_kb":112951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"74'415","reported_seq":580,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:06.376363+0000","last_change":"2024-04-18T21:11:06.376461+0000","last_active":"2024-04-18T21:11:06.376363+0000","last_peered":"2024-04-18T21:11:06.376363+0000","last_clean":"2024-04-18T21:11:06.376363+0000","last_became_active":"2024-04-18T21:10:23.920896+0000","last_became_peered":"2024-04-18T21:10:23.920896+0000","last_unstale":"2024-04-18T21:11:06.376363+0000","last_undegraded":"2024-04-18T21:11:06.376363+0000","last_fullsized":"2024-04-18T21:11:06.376363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'415","last_scrub_stamp":"2024-04-18T21:11:06.376154+0000","last_deep_scrub":"74'415","last_deep_scrub_stamp":"2024-04-18T21:11:06.376154+0000","last_clean_scrub_stamp":"2024-04-18T21:11:06.376154+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:54:11.774141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":15468,"num_write":371,"num_write_kb":100314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"74'363","reported_seq":532,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.550773+0000","last_change":"2024-04-18T21:10:38.550838+0000","last_active":"2024-04-18T21:10:38.550773+0000","last_peered":"2024-04-18T21:10:38.550773+0000","last_clean":"2024-04-18T21:10:38.550773+0000","last_became_active":"2024-04-18T21:10:26.230943+0000","last_became_peered":"2024-04-18T21:10:26.230943+0000","last_unstale":"2024-04-18T21:10:38.550773+0000","last_undegraded":"2024-04-18T21:10:38.550773+0000","last_fullsized":"2024-04-18T21:10:38.550773+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'363","last_scrub_stamp":"2024-04-18T21:10:38.550569+0000","last_deep_scrub":"74'363","last_deep_scrub_stamp":"2024-04-18T21:10:38.550569+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.550569+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:26:33.879921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16265,"num_write":343,"num_write_kb":25724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"74'344","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:05.397124+0000","last_change":"2024-04-18T21:11:05.397185+0000","last_active":"2024-04-18T21:11:05.397124+0000","last_peered":"2024-04-18T21:11:05.397124+0000","last_clean":"2024-04-18T21:11:05.397124+0000","last_became_active":"2024-04-18T21:10:16.874255+0000","last_became_peered":"2024-04-18T21:10:16.874255+0000","last_unstale":"2024-04-18T21:11:05.397124+0000","last_undegraded":"2024-04-18T21:11:05.397124+0000","last_fullsized":"2024-04-18T21:11:05.397124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'344","last_scrub_stamp":"2024-04-18T21:11:05.396921+0000","last_deep_scrub":"74'344","last_deep_scrub_stamp":"2024-04-18T21:11:05.396921+0000","last_clean_scrub_stamp":"2024-04-18T21:11:05.396921+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:20.772902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30164,"num_write":319,"num_write_kb":25511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"74'411","reported_seq":607,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:07.390292+0000","last_change":"2024-04-18T21:11:07.390350+0000","last_active":"2024-04-18T21:11:07.390292+0000","last_peered":"2024-04-18T21:11:07.390292+0000","last_clean":"2024-04-18T21:11:07.390292+0000","last_became_active":"2024-04-18T21:10:23.925776+0000","last_became_peered":"2024-04-18T21:10:23.925776+0000","last_unstale":"2024-04-18T21:11:07.390292+0000","last_undegraded":"2024-04-18T21:11:07.390292+0000","last_fullsized":"2024-04-18T21:11:07.390292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'411","last_scrub_stamp":"2024-04-18T21:11:07.390100+0000","last_deep_scrub":"74'411","last_deep_scrub_stamp":"2024-04-18T21:11:07.390100+0000","last_clean_scrub_stamp":"2024-04-18T21:11:07.390100+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:50.762473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30996,"num_write":372,"num_write_kb":47004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"74'447","reported_seq":658,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.583492+0000","last_change":"2024-04-18T21:10:39.583556+0000","last_active":"2024-04-18T21:10:39.583492+0000","last_peered":"2024-04-18T21:10:39.583492+0000","last_clean":"2024-04-18T21:10:39.583492+0000","last_became_active":"2024-04-18T21:10:26.228456+0000","last_became_peered":"2024-04-18T21:10:26.228456+0000","last_unstale":"2024-04-18T21:10:39.583492+0000","last_undegraded":"2024-04-18T21:10:39.583492+0000","last_fullsized":"2024-04-18T21:10:39.583492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'447","last_scrub_stamp":"2024-04-18T21:10:39.583297+0000","last_deep_scrub":"74'447","last_deep_scrub_stamp":"2024-04-18T21:10:39.583297+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.583297+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:49.385471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26668,"num_write":419,"num_write_kb":88342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"74'410","reported_seq":662,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.389733+0000","last_change":"2024-04-18T21:10:55.389798+0000","last_active":"2024-04-18T21:10:55.389733+0000","last_peered":"2024-04-18T21:10:55.389733+0000","last_clean":"2024-04-18T21:10:55.389733+0000","last_became_active":"2024-04-18T21:10:26.201201+0000","last_became_peered":"2024-04-18T21:10:26.201201+0000","last_unstale":"2024-04-18T21:10:55.389733+0000","last_undegraded":"2024-04-18T21:10:55.389733+0000","last_fullsized":"2024-04-18T21:10:55.389733+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'410","last_scrub_stamp":"2024-04-18T21:10:55.389545+0000","last_deep_scrub":"74'410","last_deep_scrub_stamp":"2024-04-18T21:10:55.389545+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.389545+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:07:52.856824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":51344,"num_write":379,"num_write_kb":100188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"74'448","reported_seq":643,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:10.404377+0000","last_change":"2024-04-18T21:11:10.404440+0000","last_active":"2024-04-18T21:11:10.404377+0000","last_peered":"2024-04-18T21:11:10.404377+0000","last_clean":"2024-04-18T21:11:10.404377+0000","last_became_active":"2024-04-18T21:10:26.231842+0000","last_became_peered":"2024-04-18T21:10:26.231842+0000","last_unstale":"2024-04-18T21:11:10.404377+0000","last_undegraded":"2024-04-18T21:11:10.404377+0000","last_fullsized":"2024-04-18T21:11:10.404377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-04-18T21:11:10.404181+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-04-18T21:11:10.404181+0000","last_clean_scrub_stamp":"2024-04-18T21:11:10.404181+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:14.925736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":419,"num_write_kb":84260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"74'406","reported_seq":600,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.003368+0000","last_change":"2024-04-18T21:10:40.003492+0000","last_active":"2024-04-18T21:10:40.003368+0000","last_peered":"2024-04-18T21:10:40.003368+0000","last_clean":"2024-04-18T21:10:40.003368+0000","last_became_active":"2024-04-18T21:05:08.605844+0000","last_became_peered":"2024-04-18T21:05:08.605844+0000","last_unstale":"2024-04-18T21:10:40.003368+0000","last_undegraded":"2024-04-18T21:10:40.003368+0000","last_fullsized":"2024-04-18T21:10:40.003368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'406","last_scrub_stamp":"2024-04-18T21:10:40.003117+0000","last_deep_scrub":"74'406","last_deep_scrub_stamp":"2024-04-18T21:10:40.003117+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.003117+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:44:57.788059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":9739,"num_write":378,"num_write_kb":55166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"74'409","reported_seq":608,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.253171+0000","last_change":"2024-04-18T21:10:58.253235+0000","last_active":"2024-04-18T21:10:58.253171+0000","last_peered":"2024-04-18T21:10:58.253171+0000","last_clean":"2024-04-18T21:10:58.253171+0000","last_became_active":"2024-04-18T21:05:08.610142+0000","last_became_peered":"2024-04-18T21:05:08.610142+0000","last_unstale":"2024-04-18T21:10:58.253171+0000","last_undegraded":"2024-04-18T21:10:58.253171+0000","last_fullsized":"2024-04-18T21:10:58.253171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'409","last_scrub_stamp":"2024-04-18T21:10:58.252969+0000","last_deep_scrub":"74'409","last_deep_scrub_stamp":"2024-04-18T21:10:58.252969+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.252969+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:47.307843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18796,"num_write":368,"num_write_kb":58878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"74'433","reported_seq":639,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.930678+0000","last_change":"2024-04-18T21:10:46.930846+0000","last_active":"2024-04-18T21:10:46.930678+0000","last_peered":"2024-04-18T21:10:46.930678+0000","last_clean":"2024-04-18T21:10:46.930678+0000","last_became_active":"2024-04-18T21:05:08.603850+0000","last_became_peered":"2024-04-18T21:05:08.603850+0000","last_unstale":"2024-04-18T21:10:46.930678+0000","last_undegraded":"2024-04-18T21:10:46.930678+0000","last_fullsized":"2024-04-18T21:10:46.930678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'433","last_scrub_stamp":"2024-04-18T21:10:46.930433+0000","last_deep_scrub":"74'433","last_deep_scrub_stamp":"2024-04-18T21:10:46.930433+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.930433+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:50.595324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19033,"num_write":395,"num_write_kb":80100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"74'428","reported_seq":596,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.526639+0000","last_change":"2024-04-18T21:10:45.526699+0000","last_active":"2024-04-18T21:10:45.526639+0000","last_peered":"2024-04-18T21:10:45.526639+0000","last_clean":"2024-04-18T21:10:45.526639+0000","last_became_active":"2024-04-18T21:10:26.216722+0000","last_became_peered":"2024-04-18T21:10:26.216722+0000","last_unstale":"2024-04-18T21:10:45.526639+0000","last_undegraded":"2024-04-18T21:10:45.526639+0000","last_fullsized":"2024-04-18T21:10:45.526639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'428","last_scrub_stamp":"2024-04-18T21:10:45.526444+0000","last_deep_scrub":"74'428","last_deep_scrub_stamp":"2024-04-18T21:10:45.526444+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.526444+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:43.905072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":13845,"num_write":391,"num_write_kb":34178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'394","reported_seq":543,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.568891+0000","last_change":"2024-04-18T21:10:46.569086+0000","last_active":"2024-04-18T21:10:46.568891+0000","last_peered":"2024-04-18T21:10:46.568891+0000","last_clean":"2024-04-18T21:10:46.568891+0000","last_became_active":"2024-04-18T21:10:26.214723+0000","last_became_peered":"2024-04-18T21:10:26.214723+0000","last_unstale":"2024-04-18T21:10:46.568891+0000","last_undegraded":"2024-04-18T21:10:46.568891+0000","last_fullsized":"2024-04-18T21:10:46.568891+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'394","last_scrub_stamp":"2024-04-18T21:10:46.568669+0000","last_deep_scrub":"74'394","last_deep_scrub_stamp":"2024-04-18T21:10:46.568669+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.568669+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:31.635467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4885,"num_write":368,"num_write_kb":42989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"74'438","reported_seq":648,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.041366+0000","last_change":"2024-04-18T21:10:46.041430+0000","last_active":"2024-04-18T21:10:46.041366+0000","last_peered":"2024-04-18T21:10:46.041366+0000","last_clean":"2024-04-18T21:10:46.041366+0000","last_became_active":"2024-04-18T21:10:16.891143+0000","last_became_peered":"2024-04-18T21:10:16.891143+0000","last_unstale":"2024-04-18T21:10:46.041366+0000","last_undegraded":"2024-04-18T21:10:46.041366+0000","last_fullsized":"2024-04-18T21:10:46.041366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'438","last_scrub_stamp":"2024-04-18T21:10:46.041169+0000","last_deep_scrub":"74'438","last_deep_scrub_stamp":"2024-04-18T21:10:46.041169+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.041169+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:37:35.518757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":17562,"num_write":412,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"74'409","reported_seq":602,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.973027+0000","last_change":"2024-04-18T21:10:38.973088+0000","last_active":"2024-04-18T21:10:38.973027+0000","last_peered":"2024-04-18T21:10:38.973027+0000","last_clean":"2024-04-18T21:10:38.973027+0000","last_became_active":"2024-04-18T21:10:16.872360+0000","last_became_peered":"2024-04-18T21:10:16.872360+0000","last_unstale":"2024-04-18T21:10:38.973027+0000","last_undegraded":"2024-04-18T21:10:38.973027+0000","last_fullsized":"2024-04-18T21:10:38.973027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'409","last_scrub_stamp":"2024-04-18T21:10:38.972829+0000","last_deep_scrub":"74'409","last_deep_scrub_stamp":"2024-04-18T21:10:38.972829+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.972829+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:38:45.609509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12416,"num_write":371,"num_write_kb":79792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"74'439","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.965485+0000","last_change":"2024-04-18T21:10:39.965566+0000","last_active":"2024-04-18T21:10:39.965485+0000","last_peered":"2024-04-18T21:10:39.965485+0000","last_clean":"2024-04-18T21:10:39.965485+0000","last_became_active":"2024-04-18T21:10:23.918848+0000","last_became_peered":"2024-04-18T21:10:23.918848+0000","last_unstale":"2024-04-18T21:10:39.965485+0000","last_undegraded":"2024-04-18T21:10:39.965485+0000","last_fullsized":"2024-04-18T21:10:39.965485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'439","last_scrub_stamp":"2024-04-18T21:10:39.965281+0000","last_deep_scrub":"74'439","last_deep_scrub_stamp":"2024-04-18T21:10:39.965281+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.965281+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:33.165098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28780,"num_write":408,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"74'423","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.142702+0000","last_change":"2024-04-18T21:10:53.142770+0000","last_active":"2024-04-18T21:10:53.142702+0000","last_peered":"2024-04-18T21:10:53.142702+0000","last_clean":"2024-04-18T21:10:53.142702+0000","last_became_active":"2024-04-18T21:10:16.874524+0000","last_became_peered":"2024-04-18T21:10:16.874524+0000","last_unstale":"2024-04-18T21:10:53.142702+0000","last_undegraded":"2024-04-18T21:10:53.142702+0000","last_fullsized":"2024-04-18T21:10:53.142702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'423","last_scrub_stamp":"2024-04-18T21:10:53.142504+0000","last_deep_scrub":"74'423","last_deep_scrub_stamp":"2024-04-18T21:10:53.142504+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.142504+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:58.615614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10573,"num_write":403,"num_write_kb":42463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"74'493","reported_seq":751,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.915238+0000","last_change":"2024-04-18T21:10:47.915305+0000","last_active":"2024-04-18T21:10:47.915238+0000","last_peered":"2024-04-18T21:10:47.915238+0000","last_clean":"2024-04-18T21:10:47.915238+0000","last_became_active":"2024-04-18T21:10:16.867790+0000","last_became_peered":"2024-04-18T21:10:16.867790+0000","last_unstale":"2024-04-18T21:10:47.915238+0000","last_undegraded":"2024-04-18T21:10:47.915238+0000","last_fullsized":"2024-04-18T21:10:47.915238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'493","last_scrub_stamp":"2024-04-18T21:10:47.915034+0000","last_deep_scrub":"74'493","last_deep_scrub_stamp":"2024-04-18T21:10:47.915034+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.915034+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:52:37.937061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":49506,"num_write":448,"num_write_kb":88306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"74'394","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:14.357271+0000","last_change":"2024-04-18T21:11:14.357331+0000","last_active":"2024-04-18T21:11:14.357271+0000","last_peered":"2024-04-18T21:11:14.357271+0000","last_clean":"2024-04-18T21:11:14.357271+0000","last_became_active":"2024-04-18T21:10:26.232987+0000","last_became_peered":"2024-04-18T21:10:26.232987+0000","last_unstale":"2024-04-18T21:11:14.357271+0000","last_undegraded":"2024-04-18T21:11:14.357271+0000","last_fullsized":"2024-04-18T21:11:14.357271+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'394","last_scrub_stamp":"2024-04-18T21:11:14.357035+0000","last_deep_scrub":"74'394","last_deep_scrub_stamp":"2024-04-18T21:11:14.357035+0000","last_clean_scrub_stamp":"2024-04-18T21:11:14.357035+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:30.920926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":15420,"num_write":363,"num_write_kb":34832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"74'395","reported_seq":658,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.194577+0000","last_change":"2024-04-18T21:10:55.194639+0000","last_active":"2024-04-18T21:10:55.194577+0000","last_peered":"2024-04-18T21:10:55.194577+0000","last_clean":"2024-04-18T21:10:55.194577+0000","last_became_active":"2024-04-18T21:10:16.874182+0000","last_became_peered":"2024-04-18T21:10:16.874182+0000","last_unstale":"2024-04-18T21:10:55.194577+0000","last_undegraded":"2024-04-18T21:10:55.194577+0000","last_fullsized":"2024-04-18T21:10:55.194577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:55.194373+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:55.194373+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.194373+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:19.827646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":49749,"num_write":367,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"74'400","reported_seq":594,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.104925+0000","last_change":"2024-04-18T21:10:55.104925+0000","last_active":"2024-04-18T21:10:55.104925+0000","last_peered":"2024-04-18T21:10:55.104925+0000","last_clean":"2024-04-18T21:10:55.104925+0000","last_became_active":"2024-04-18T21:05:08.600039+0000","last_became_peered":"2024-04-18T21:05:08.600039+0000","last_unstale":"2024-04-18T21:10:55.104925+0000","last_undegraded":"2024-04-18T21:10:55.104925+0000","last_fullsized":"2024-04-18T21:10:55.104925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'400","last_scrub_stamp":"2024-04-18T21:10:55.104654+0000","last_deep_scrub":"74'400","last_deep_scrub_stamp":"2024-04-18T21:10:55.104654+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.104654+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:33.637116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13024,"num_write":371,"num_write_kb":50752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"74'472","reported_seq":703,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.062795+0000","last_change":"2024-04-18T21:10:48.062795+0000","last_active":"2024-04-18T21:10:48.062795+0000","last_peered":"2024-04-18T21:10:48.062795+0000","last_clean":"2024-04-18T21:10:48.062795+0000","last_became_active":"2024-04-18T21:10:16.895382+0000","last_became_peered":"2024-04-18T21:10:16.895382+0000","last_unstale":"2024-04-18T21:10:48.062795+0000","last_undegraded":"2024-04-18T21:10:48.062795+0000","last_fullsized":"2024-04-18T21:10:48.062795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'472","last_scrub_stamp":"2024-04-18T21:10:48.062345+0000","last_deep_scrub":"74'472","last_deep_scrub_stamp":"2024-04-18T21:10:48.062345+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.062345+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:17:20.407753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28531,"num_write":435,"num_write_kb":67429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"74'448","reported_seq":673,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.009025+0000","last_change":"2024-04-18T21:10:51.009025+0000","last_active":"2024-04-18T21:10:51.009025+0000","last_peered":"2024-04-18T21:10:51.009025+0000","last_clean":"2024-04-18T21:10:51.009025+0000","last_became_active":"2024-04-18T21:05:08.602036+0000","last_became_peered":"2024-04-18T21:05:08.602036+0000","last_unstale":"2024-04-18T21:10:51.009025+0000","last_undegraded":"2024-04-18T21:10:51.009025+0000","last_fullsized":"2024-04-18T21:10:51.009025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'448","last_scrub_stamp":"2024-04-18T21:10:51.008759+0000","last_deep_scrub":"74'448","last_deep_scrub_stamp":"2024-04-18T21:10:51.008759+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.008759+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:15.642032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26481,"num_write":417,"num_write_kb":55677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"74'443","reported_seq":616,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:09.391468+0000","last_change":"2024-04-18T21:11:09.391529+0000","last_active":"2024-04-18T21:11:09.391468+0000","last_peered":"2024-04-18T21:11:09.391468+0000","last_clean":"2024-04-18T21:11:09.391468+0000","last_became_active":"2024-04-18T21:10:26.202778+0000","last_became_peered":"2024-04-18T21:10:26.202778+0000","last_unstale":"2024-04-18T21:11:09.391468+0000","last_undegraded":"2024-04-18T21:11:09.391468+0000","last_fullsized":"2024-04-18T21:11:09.391468+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'443","last_scrub_stamp":"2024-04-18T21:11:09.391267+0000","last_deep_scrub":"74'443","last_deep_scrub_stamp":"2024-04-18T21:11:09.391267+0000","last_clean_scrub_stamp":"2024-04-18T21:11:09.391267+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:52:23.343994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18096,"num_write":411,"num_write_kb":40392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"74'405","reported_seq":589,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:09.401415+0000","last_change":"2024-04-18T21:11:09.401539+0000","last_active":"2024-04-18T21:11:09.401415+0000","last_peered":"2024-04-18T21:11:09.401415+0000","last_clean":"2024-04-18T21:11:09.401415+0000","last_became_active":"2024-04-18T21:10:23.930553+0000","last_became_peered":"2024-04-18T21:10:23.930553+0000","last_unstale":"2024-04-18T21:11:09.401415+0000","last_undegraded":"2024-04-18T21:11:09.401415+0000","last_fullsized":"2024-04-18T21:11:09.401415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'405","last_scrub_stamp":"2024-04-18T21:11:09.401115+0000","last_deep_scrub":"74'405","last_deep_scrub_stamp":"2024-04-18T21:11:09.401115+0000","last_clean_scrub_stamp":"2024-04-18T21:11:09.401115+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:30.830268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24292,"num_write":369,"num_write_kb":63650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"89'646","reported_seq":641,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:03.536961+0000","last_change":"2024-04-18T21:11:03.537036+0000","last_active":"2024-04-18T21:11:03.536961+0000","last_peered":"2024-04-18T21:11:03.536961+0000","last_clean":"2024-04-18T21:11:03.536961+0000","last_became_active":"2024-04-18T21:10:26.204728+0000","last_became_peered":"2024-04-18T21:10:26.204728+0000","last_unstale":"2024-04-18T21:11:03.536961+0000","last_undegraded":"2024-04-18T21:11:03.536961+0000","last_fullsized":"2024-04-18T21:11:03.536961+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'646","last_scrub_stamp":"2024-04-18T21:11:03.536777+0000","last_deep_scrub":"89'646","last_deep_scrub_stamp":"2024-04-18T21:11:03.536777+0000","last_clean_scrub_stamp":"2024-04-18T21:11:03.536777+0000","objects_scrubbed":4,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:21.990601+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":8461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"74'420","reported_seq":594,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.234527+0000","last_change":"2024-04-18T21:10:56.234588+0000","last_active":"2024-04-18T21:10:56.234527+0000","last_peered":"2024-04-18T21:10:56.234527+0000","last_clean":"2024-04-18T21:10:56.234527+0000","last_became_active":"2024-04-18T21:10:23.920037+0000","last_became_peered":"2024-04-18T21:10:23.920037+0000","last_unstale":"2024-04-18T21:10:56.234527+0000","last_undegraded":"2024-04-18T21:10:56.234527+0000","last_fullsized":"2024-04-18T21:10:56.234527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'420","last_scrub_stamp":"2024-04-18T21:10:56.234335+0000","last_deep_scrub":"74'420","last_deep_scrub_stamp":"2024-04-18T21:10:56.234335+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.234335+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:48.002634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14075,"num_write":379,"num_write_kb":96030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"72'53","reported_seq":227,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:10.262889+0000","last_change":"2024-04-18T21:11:10.262951+0000","last_active":"2024-04-18T21:11:10.262889+0000","last_peered":"2024-04-18T21:11:10.262889+0000","last_clean":"2024-04-18T21:11:10.262889+0000","last_became_active":"2024-04-18T21:10:16.894739+0000","last_became_peered":"2024-04-18T21:10:16.894739+0000","last_unstale":"2024-04-18T21:11:10.262889+0000","last_undegraded":"2024-04-18T21:11:10.262889+0000","last_fullsized":"2024-04-18T21:11:10.262889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'53","last_scrub_stamp":"2024-04-18T21:11:10.262674+0000","last_deep_scrub":"72'53","last_deep_scrub_stamp":"2024-04-18T21:11:10.262674+0000","last_clean_scrub_stamp":"2024-04-18T21:11:10.262674+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:25.927468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"74'412","reported_seq":631,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:04.235547+0000","last_change":"2024-04-18T21:11:04.235607+0000","last_active":"2024-04-18T21:11:04.235547+0000","last_peered":"2024-04-18T21:11:04.235547+0000","last_clean":"2024-04-18T21:11:04.235547+0000","last_became_active":"2024-04-18T21:10:16.873820+0000","last_became_peered":"2024-04-18T21:10:16.873820+0000","last_unstale":"2024-04-18T21:11:04.235547+0000","last_undegraded":"2024-04-18T21:11:04.235547+0000","last_fullsized":"2024-04-18T21:11:04.235547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'412","last_scrub_stamp":"2024-04-18T21:11:04.235335+0000","last_deep_scrub":"74'412","last_deep_scrub_stamp":"2024-04-18T21:11:04.235335+0000","last_clean_scrub_stamp":"2024-04-18T21:11:04.235335+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:25.664489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":30175,"num_write":379,"num_write_kb":54971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"72'81","reported_seq":255,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.348616+0000","last_change":"2024-04-18T21:11:02.348740+0000","last_active":"2024-04-18T21:11:02.348616+0000","last_peered":"2024-04-18T21:11:02.348616+0000","last_clean":"2024-04-18T21:11:02.348616+0000","last_became_active":"2024-04-18T21:10:16.871629+0000","last_became_peered":"2024-04-18T21:10:16.871629+0000","last_unstale":"2024-04-18T21:11:02.348616+0000","last_undegraded":"2024-04-18T21:11:02.348616+0000","last_fullsized":"2024-04-18T21:11:02.348616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'81","last_scrub_stamp":"2024-04-18T21:11:02.348394+0000","last_deep_scrub":"72'81","last_deep_scrub_stamp":"2024-04-18T21:11:02.348394+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.348394+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:00:31.454039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"74'393","reported_seq":623,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.040333+0000","last_change":"2024-04-18T21:10:52.040390+0000","last_active":"2024-04-18T21:10:52.040333+0000","last_peered":"2024-04-18T21:10:52.040333+0000","last_clean":"2024-04-18T21:10:52.040333+0000","last_became_active":"2024-04-18T21:10:16.872616+0000","last_became_peered":"2024-04-18T21:10:16.872616+0000","last_unstale":"2024-04-18T21:10:52.040333+0000","last_undegraded":"2024-04-18T21:10:52.040333+0000","last_fullsized":"2024-04-18T21:10:52.040333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'393","last_scrub_stamp":"2024-04-18T21:10:52.040136+0000","last_deep_scrub":"74'393","last_deep_scrub_stamp":"2024-04-18T21:10:52.040136+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.040136+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:43.808436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31709,"num_write":359,"num_write_kb":59734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"89'68","reported_seq":182,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:12.347986+0000","last_change":"2024-04-18T21:11:12.348072+0000","last_active":"2024-04-18T21:11:12.347986+0000","last_peered":"2024-04-18T21:11:12.347986+0000","last_clean":"2024-04-18T21:11:12.347986+0000","last_became_active":"2024-04-18T21:10:26.245821+0000","last_became_peered":"2024-04-18T21:10:26.245821+0000","last_unstale":"2024-04-18T21:11:12.347986+0000","last_undegraded":"2024-04-18T21:11:12.347986+0000","last_fullsized":"2024-04-18T21:11:12.347986+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'68","last_scrub_stamp":"2024-04-18T21:11:12.347785+0000","last_deep_scrub":"89'68","last_deep_scrub_stamp":"2024-04-18T21:11:12.347785+0000","last_clean_scrub_stamp":"2024-04-18T21:11:12.347785+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:44:55.674070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'167","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.451971+0000","last_change":"2024-04-18T21:10:59.452143+0000","last_active":"2024-04-18T21:10:59.451971+0000","last_peered":"2024-04-18T21:10:59.451971+0000","last_clean":"2024-04-18T21:10:59.451971+0000","last_became_active":"2024-04-18T21:10:26.214583+0000","last_became_peered":"2024-04-18T21:10:26.214583+0000","last_unstale":"2024-04-18T21:10:59.451971+0000","last_undegraded":"2024-04-18T21:10:59.451971+0000","last_fullsized":"2024-04-18T21:10:59.451971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'167","last_scrub_stamp":"2024-04-18T21:10:59.451742+0000","last_deep_scrub":"89'167","last_deep_scrub_stamp":"2024-04-18T21:10:59.451742+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.451742+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:00.584623+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"74'417","reported_seq":615,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.071510+0000","last_change":"2024-04-18T21:10:49.071636+0000","last_active":"2024-04-18T21:10:49.071510+0000","last_peered":"2024-04-18T21:10:49.071510+0000","last_clean":"2024-04-18T21:10:49.071510+0000","last_became_active":"2024-04-18T21:10:16.886237+0000","last_became_peered":"2024-04-18T21:10:16.886237+0000","last_unstale":"2024-04-18T21:10:49.071510+0000","last_undegraded":"2024-04-18T21:10:49.071510+0000","last_fullsized":"2024-04-18T21:10:49.071510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'417","last_scrub_stamp":"2024-04-18T21:10:49.071274+0000","last_deep_scrub":"74'417","last_deep_scrub_stamp":"2024-04-18T21:10:49.071274+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.071274+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:56.434174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9028,"num_write":381,"num_write_kb":55274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"89'286","reported_seq":460,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.430211+0000","last_change":"2024-04-18T21:11:01.430284+0000","last_active":"2024-04-18T21:11:01.430211+0000","last_peered":"2024-04-18T21:11:01.430211+0000","last_clean":"2024-04-18T21:11:01.430211+0000","last_became_active":"2024-04-18T21:10:16.870959+0000","last_became_peered":"2024-04-18T21:10:16.870959+0000","last_unstale":"2024-04-18T21:11:01.430211+0000","last_undegraded":"2024-04-18T21:11:01.430211+0000","last_fullsized":"2024-04-18T21:11:01.430211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'286","last_scrub_stamp":"2024-04-18T21:11:01.430015+0000","last_deep_scrub":"89'286","last_deep_scrub_stamp":"2024-04-18T21:11:01.430015+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.430015+0000","objects_scrubbed":2,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:06:52.036683+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"74'455","reported_seq":655,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:12.457215+0000","last_change":"2024-04-18T21:11:12.457273+0000","last_active":"2024-04-18T21:11:12.457215+0000","last_peered":"2024-04-18T21:11:12.457215+0000","last_clean":"2024-04-18T21:11:12.457215+0000","last_became_active":"2024-04-18T21:10:23.924185+0000","last_became_peered":"2024-04-18T21:10:23.924185+0000","last_unstale":"2024-04-18T21:11:12.457215+0000","last_undegraded":"2024-04-18T21:11:12.457215+0000","last_fullsized":"2024-04-18T21:11:12.457215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'455","last_scrub_stamp":"2024-04-18T21:11:12.457017+0000","last_deep_scrub":"74'455","last_deep_scrub_stamp":"2024-04-18T21:11:12.457017+0000","last_clean_scrub_stamp":"2024-04-18T21:11:12.457017+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:37:39.409364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27878,"num_write":429,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"89'560","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.523223+0000","last_change":"2024-04-18T21:10:50.523296+0000","last_active":"2024-04-18T21:10:50.523223+0000","last_peered":"2024-04-18T21:10:50.523223+0000","last_clean":"2024-04-18T21:10:50.523223+0000","last_became_active":"2024-04-18T21:10:26.214841+0000","last_became_peered":"2024-04-18T21:10:26.214841+0000","last_unstale":"2024-04-18T21:10:50.523223+0000","last_undegraded":"2024-04-18T21:10:50.523223+0000","last_fullsized":"2024-04-18T21:10:50.523223+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'560","last_scrub_stamp":"2024-04-18T21:10:50.523027+0000","last_deep_scrub":"89'560","last_deep_scrub_stamp":"2024-04-18T21:10:50.523027+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.523027+0000","objects_scrubbed":2,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:23:32.729636+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"74'475","reported_seq":708,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.543014+0000","last_change":"2024-04-18T21:10:41.543149+0000","last_active":"2024-04-18T21:10:41.543014+0000","last_peered":"2024-04-18T21:10:41.543014+0000","last_clean":"2024-04-18T21:10:41.543014+0000","last_became_active":"2024-04-18T21:10:26.228687+0000","last_became_peered":"2024-04-18T21:10:26.228687+0000","last_unstale":"2024-04-18T21:10:41.543014+0000","last_undegraded":"2024-04-18T21:10:41.543014+0000","last_fullsized":"2024-04-18T21:10:41.543014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'475","last_scrub_stamp":"2024-04-18T21:10:41.542789+0000","last_deep_scrub":"74'475","last_deep_scrub_stamp":"2024-04-18T21:10:41.542789+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.542789+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:28:54.188274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":49394,"num_write":448,"num_write_kb":138842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"72'52","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.539591+0000","last_change":"2024-04-18T21:10:47.539653+0000","last_active":"2024-04-18T21:10:47.539591+0000","last_peered":"2024-04-18T21:10:47.539591+0000","last_clean":"2024-04-18T21:10:47.539591+0000","last_became_active":"2024-04-18T21:10:26.213184+0000","last_became_peered":"2024-04-18T21:10:26.213184+0000","last_unstale":"2024-04-18T21:10:47.539591+0000","last_undegraded":"2024-04-18T21:10:47.539591+0000","last_fullsized":"2024-04-18T21:10:47.539591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'52","last_scrub_stamp":"2024-04-18T21:10:47.539398+0000","last_deep_scrub":"72'52","last_deep_scrub_stamp":"2024-04-18T21:10:47.539398+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.539398+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:57.377253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"74'449","reported_seq":709,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:11.215329+0000","last_change":"2024-04-18T21:11:11.215392+0000","last_active":"2024-04-18T21:11:11.215329+0000","last_peered":"2024-04-18T21:11:11.215329+0000","last_clean":"2024-04-18T21:11:11.215329+0000","last_became_active":"2024-04-18T21:10:16.895302+0000","last_became_peered":"2024-04-18T21:10:16.895302+0000","last_unstale":"2024-04-18T21:11:11.215329+0000","last_undegraded":"2024-04-18T21:11:11.215329+0000","last_fullsized":"2024-04-18T21:11:11.215329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'449","last_scrub_stamp":"2024-04-18T21:11:11.215132+0000","last_deep_scrub":"74'449","last_deep_scrub_stamp":"2024-04-18T21:11:11.215132+0000","last_clean_scrub_stamp":"2024-04-18T21:11:11.215132+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:50:12.124722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44070,"num_write":414,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"89'174","reported_seq":348,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:09.271526+0000","last_change":"2024-04-18T21:11:09.271605+0000","last_active":"2024-04-18T21:11:09.271526+0000","last_peered":"2024-04-18T21:11:09.271526+0000","last_clean":"2024-04-18T21:11:09.271526+0000","last_became_active":"2024-04-18T21:10:16.892743+0000","last_became_peered":"2024-04-18T21:10:16.892743+0000","last_unstale":"2024-04-18T21:11:09.271526+0000","last_undegraded":"2024-04-18T21:11:09.271526+0000","last_fullsized":"2024-04-18T21:11:09.271526+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'174","last_scrub_stamp":"2024-04-18T21:11:09.271335+0000","last_deep_scrub":"89'174","last_deep_scrub_stamp":"2024-04-18T21:11:09.271335+0000","last_clean_scrub_stamp":"2024-04-18T21:11:09.271335+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:10:34.329460+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"74'462","reported_seq":634,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.470712+0000","last_change":"2024-04-18T21:10:58.470847+0000","last_active":"2024-04-18T21:10:58.470712+0000","last_peered":"2024-04-18T21:10:58.470712+0000","last_clean":"2024-04-18T21:10:58.470712+0000","last_became_active":"2024-04-18T21:10:26.233561+0000","last_became_peered":"2024-04-18T21:10:26.233561+0000","last_unstale":"2024-04-18T21:10:58.470712+0000","last_undegraded":"2024-04-18T21:10:58.470712+0000","last_fullsized":"2024-04-18T21:10:58.470712+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'462","last_scrub_stamp":"2024-04-18T21:10:58.470476+0000","last_deep_scrub":"74'462","last_deep_scrub_stamp":"2024-04-18T21:10:58.470476+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.470476+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:30.165777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24712,"num_write":425,"num_write_kb":59536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"89'112","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.459818+0000","last_change":"2024-04-18T21:10:52.459963+0000","last_active":"2024-04-18T21:10:52.459818+0000","last_peered":"2024-04-18T21:10:52.459818+0000","last_clean":"2024-04-18T21:10:52.459818+0000","last_became_active":"2024-04-18T21:10:26.204061+0000","last_became_peered":"2024-04-18T21:10:26.204061+0000","last_unstale":"2024-04-18T21:10:52.459818+0000","last_undegraded":"2024-04-18T21:10:52.459818+0000","last_fullsized":"2024-04-18T21:10:52.459818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'112","last_scrub_stamp":"2024-04-18T21:10:52.459590+0000","last_deep_scrub":"89'112","last_deep_scrub_stamp":"2024-04-18T21:10:52.459590+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.459590+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:05:15.629219+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"74'420","reported_seq":618,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.548220+0000","last_change":"2024-04-18T21:10:43.548287+0000","last_active":"2024-04-18T21:10:43.548220+0000","last_peered":"2024-04-18T21:10:43.548220+0000","last_clean":"2024-04-18T21:10:43.548220+0000","last_became_active":"2024-04-18T21:10:26.210007+0000","last_became_peered":"2024-04-18T21:10:26.210007+0000","last_unstale":"2024-04-18T21:10:43.548220+0000","last_undegraded":"2024-04-18T21:10:43.548220+0000","last_fullsized":"2024-04-18T21:10:43.548220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'420","last_scrub_stamp":"2024-04-18T21:10:43.548042+0000","last_deep_scrub":"74'420","last_deep_scrub_stamp":"2024-04-18T21:10:43.548042+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.548042+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:25:49.418674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25822,"num_write":391,"num_write_kb":87557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"72'57","reported_seq":231,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:03.363843+0000","last_change":"2024-04-18T21:11:03.363908+0000","last_active":"2024-04-18T21:11:03.363843+0000","last_peered":"2024-04-18T21:11:03.363843+0000","last_clean":"2024-04-18T21:11:03.363843+0000","last_became_active":"2024-04-18T21:10:16.874366+0000","last_became_peered":"2024-04-18T21:10:16.874366+0000","last_unstale":"2024-04-18T21:11:03.363843+0000","last_undegraded":"2024-04-18T21:11:03.363843+0000","last_fullsized":"2024-04-18T21:11:03.363843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'57","last_scrub_stamp":"2024-04-18T21:11:03.363634+0000","last_deep_scrub":"72'57","last_deep_scrub_stamp":"2024-04-18T21:11:03.363634+0000","last_clean_scrub_stamp":"2024-04-18T21:11:03.363634+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:27:20.405525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"74'371","reported_seq":533,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.453444+0000","last_change":"2024-04-18T21:10:57.453507+0000","last_active":"2024-04-18T21:10:57.453444+0000","last_peered":"2024-04-18T21:10:57.453444+0000","last_clean":"2024-04-18T21:10:57.453444+0000","last_became_active":"2024-04-18T21:10:26.205215+0000","last_became_peered":"2024-04-18T21:10:26.205215+0000","last_unstale":"2024-04-18T21:10:57.453444+0000","last_undegraded":"2024-04-18T21:10:57.453444+0000","last_fullsized":"2024-04-18T21:10:57.453444+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'371","last_scrub_stamp":"2024-04-18T21:10:57.453252+0000","last_deep_scrub":"74'371","last_deep_scrub_stamp":"2024-04-18T21:10:57.453252+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.453252+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:40.962115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9016,"num_write":341,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"89'471","reported_seq":566,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.013442+0000","last_change":"2024-04-18T21:10:41.013618+0000","last_active":"2024-04-18T21:10:41.013442+0000","last_peered":"2024-04-18T21:10:41.013442+0000","last_clean":"2024-04-18T21:10:41.013442+0000","last_became_active":"2024-04-18T21:10:23.920628+0000","last_became_peered":"2024-04-18T21:10:23.920628+0000","last_unstale":"2024-04-18T21:10:41.013442+0000","last_undegraded":"2024-04-18T21:10:41.013442+0000","last_fullsized":"2024-04-18T21:10:41.013442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'471","last_scrub_stamp":"2024-04-18T21:10:41.013171+0000","last_deep_scrub":"89'471","last_deep_scrub_stamp":"2024-04-18T21:10:41.013171+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.013171+0000","objects_scrubbed":1,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:41.021777+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"74'424","reported_seq":683,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.010904+0000","last_change":"2024-04-18T21:10:41.010966+0000","last_active":"2024-04-18T21:10:41.010904+0000","last_peered":"2024-04-18T21:10:41.010904+0000","last_clean":"2024-04-18T21:10:41.010904+0000","last_became_active":"2024-04-18T21:05:08.604908+0000","last_became_peered":"2024-04-18T21:05:08.604908+0000","last_unstale":"2024-04-18T21:10:41.010904+0000","last_undegraded":"2024-04-18T21:10:41.010904+0000","last_fullsized":"2024-04-18T21:10:41.010904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'424","last_scrub_stamp":"2024-04-18T21:10:41.010667+0000","last_deep_scrub":"74'424","last_deep_scrub_stamp":"2024-04-18T21:10:41.010667+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.010667+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:11.233039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":45864,"num_write":392,"num_write_kb":100707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"89'159","reported_seq":337,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.435195+0000","last_change":"2024-04-18T21:11:00.435269+0000","last_active":"2024-04-18T21:11:00.435195+0000","last_peered":"2024-04-18T21:11:00.435195+0000","last_clean":"2024-04-18T21:11:00.435195+0000","last_became_active":"2024-04-18T21:10:26.198951+0000","last_became_peered":"2024-04-18T21:10:26.198951+0000","last_unstale":"2024-04-18T21:11:00.435195+0000","last_undegraded":"2024-04-18T21:11:00.435195+0000","last_fullsized":"2024-04-18T21:11:00.435195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'159","last_scrub_stamp":"2024-04-18T21:11:00.434987+0000","last_deep_scrub":"89'159","last_deep_scrub_stamp":"2024-04-18T21:11:00.434987+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.434987+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:32:07.664185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.436020+0000","last_change":"2024-04-18T21:11:02.436072+0000","last_active":"2024-04-18T21:11:02.436020+0000","last_peered":"2024-04-18T21:11:02.436020+0000","last_clean":"2024-04-18T21:11:02.436020+0000","last_became_active":"2024-04-18T21:10:26.203029+0000","last_became_peered":"2024-04-18T21:10:26.203029+0000","last_unstale":"2024-04-18T21:11:02.436020+0000","last_undegraded":"2024-04-18T21:11:02.436020+0000","last_fullsized":"2024-04-18T21:11:02.436020+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:02.435834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:02.435834+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.435834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:21:53.944208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"89'348","reported_seq":516,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.185586+0000","last_change":"2024-04-18T21:11:01.185586+0000","last_active":"2024-04-18T21:11:01.185586+0000","last_peered":"2024-04-18T21:11:01.185586+0000","last_clean":"2024-04-18T21:11:01.185586+0000","last_became_active":"2024-04-18T21:05:07.582380+0000","last_became_peered":"2024-04-18T21:05:07.582380+0000","last_unstale":"2024-04-18T21:11:01.185586+0000","last_undegraded":"2024-04-18T21:11:01.185586+0000","last_fullsized":"2024-04-18T21:11:01.185586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'348","last_scrub_stamp":"2024-04-18T21:11:01.185326+0000","last_deep_scrub":"89'348","last_deep_scrub_stamp":"2024-04-18T21:11:01.185326+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.185326+0000","objects_scrubbed":2,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:54:06.583314+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"74'429","reported_seq":618,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.564701+0000","last_change":"2024-04-18T21:10:40.564767+0000","last_active":"2024-04-18T21:10:40.564701+0000","last_peered":"2024-04-18T21:10:40.564701+0000","last_clean":"2024-04-18T21:10:40.564701+0000","last_became_active":"2024-04-18T21:10:26.217055+0000","last_became_peered":"2024-04-18T21:10:26.217055+0000","last_unstale":"2024-04-18T21:10:40.564701+0000","last_undegraded":"2024-04-18T21:10:40.564701+0000","last_fullsized":"2024-04-18T21:10:40.564701+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'429","last_scrub_stamp":"2024-04-18T21:10:40.564515+0000","last_deep_scrub":"74'429","last_deep_scrub_stamp":"2024-04-18T21:10:40.564515+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.564515+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:11.565225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7806,"num_write":392,"num_write_kb":42684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:13.311281+0000","last_change":"2024-04-18T21:11:13.311340+0000","last_active":"2024-04-18T21:11:13.311281+0000","last_peered":"2024-04-18T21:11:13.311281+0000","last_clean":"2024-04-18T21:11:13.311281+0000","last_became_active":"2024-04-18T21:10:26.246177+0000","last_became_peered":"2024-04-18T21:10:26.246177+0000","last_unstale":"2024-04-18T21:11:13.311281+0000","last_undegraded":"2024-04-18T21:11:13.311281+0000","last_fullsized":"2024-04-18T21:11:13.311281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:13.311093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:13.311093+0000","last_clean_scrub_stamp":"2024-04-18T21:11:13.311093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:52.208813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"89'127","reported_seq":364,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:07.236226+0000","last_change":"2024-04-18T21:11:07.236226+0000","last_active":"2024-04-18T21:11:07.236226+0000","last_peered":"2024-04-18T21:11:07.236226+0000","last_clean":"2024-04-18T21:11:07.236226+0000","last_became_active":"2024-04-18T21:10:16.884337+0000","last_became_peered":"2024-04-18T21:10:16.884337+0000","last_unstale":"2024-04-18T21:11:07.236226+0000","last_undegraded":"2024-04-18T21:11:07.236226+0000","last_fullsized":"2024-04-18T21:11:07.236226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'127","last_scrub_stamp":"2024-04-18T21:11:07.235838+0000","last_deep_scrub":"89'127","last_deep_scrub_stamp":"2024-04-18T21:11:07.235838+0000","last_clean_scrub_stamp":"2024-04-18T21:11:07.235838+0000","objects_scrubbed":1,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:37:34.188184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":62,"num_write_kb":1476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"74'462","reported_seq":715,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.300667+0000","last_change":"2024-04-18T21:10:59.300728+0000","last_active":"2024-04-18T21:10:59.300667+0000","last_peered":"2024-04-18T21:10:59.300667+0000","last_clean":"2024-04-18T21:10:59.300667+0000","last_became_active":"2024-04-18T21:05:08.612287+0000","last_became_peered":"2024-04-18T21:05:08.612287+0000","last_unstale":"2024-04-18T21:10:59.300667+0000","last_undegraded":"2024-04-18T21:10:59.300667+0000","last_fullsized":"2024-04-18T21:10:59.300667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'462","last_scrub_stamp":"2024-04-18T21:10:59.300475+0000","last_deep_scrub":"74'462","last_deep_scrub_stamp":"2024-04-18T21:10:59.300475+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.300475+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:43.051646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":37749,"num_write":436,"num_write_kb":100612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.127773+0000","last_change":"2024-04-18T21:10:57.127773+0000","last_active":"2024-04-18T21:10:57.127773+0000","last_peered":"2024-04-18T21:10:57.127773+0000","last_clean":"2024-04-18T21:10:57.127773+0000","last_became_active":"2024-04-18T21:05:03.546871+0000","last_became_peered":"2024-04-18T21:05:03.546871+0000","last_unstale":"2024-04-18T21:10:57.127773+0000","last_undegraded":"2024-04-18T21:10:57.127773+0000","last_fullsized":"2024-04-18T21:10:57.127773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:57.127483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:57.127483+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.127483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:38:07.176293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"89'288","reported_seq":463,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.190778+0000","last_change":"2024-04-18T21:10:51.190778+0000","last_active":"2024-04-18T21:10:51.190778+0000","last_peered":"2024-04-18T21:10:51.190778+0000","last_clean":"2024-04-18T21:10:51.190778+0000","last_became_active":"2024-04-18T21:10:16.886768+0000","last_became_peered":"2024-04-18T21:10:16.886768+0000","last_unstale":"2024-04-18T21:10:51.190778+0000","last_undegraded":"2024-04-18T21:10:51.190778+0000","last_fullsized":"2024-04-18T21:10:51.190778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'288","last_scrub_stamp":"2024-04-18T21:10:51.190517+0000","last_deep_scrub":"89'288","last_deep_scrub_stamp":"2024-04-18T21:10:51.190517+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.190517+0000","objects_scrubbed":2,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:48.012726+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"74'338","reported_seq":545,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.347372+0000","last_change":"2024-04-18T21:11:00.347433+0000","last_active":"2024-04-18T21:11:00.347372+0000","last_peered":"2024-04-18T21:11:00.347372+0000","last_clean":"2024-04-18T21:11:00.347372+0000","last_became_active":"2024-04-18T21:07:24.954796+0000","last_became_peered":"2024-04-18T21:07:24.954796+0000","last_unstale":"2024-04-18T21:11:00.347372+0000","last_undegraded":"2024-04-18T21:11:00.347372+0000","last_fullsized":"2024-04-18T21:11:00.347372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'338","last_scrub_stamp":"2024-04-18T21:11:00.347178+0000","last_deep_scrub":"74'338","last_deep_scrub_stamp":"2024-04-18T21:11:00.347178+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.347178+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:18.608439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14531,"num_write":313,"num_write_kb":30142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.447133+0000","last_change":"2024-04-18T21:10:51.447264+0000","last_active":"2024-04-18T21:10:51.447133+0000","last_peered":"2024-04-18T21:10:51.447133+0000","last_clean":"2024-04-18T21:10:51.447133+0000","last_became_active":"2024-04-18T21:10:26.202959+0000","last_became_peered":"2024-04-18T21:10:26.202959+0000","last_unstale":"2024-04-18T21:10:51.447133+0000","last_undegraded":"2024-04-18T21:10:51.447133+0000","last_fullsized":"2024-04-18T21:10:51.447133+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:51.446814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:51.446814+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.446814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:45:51.001777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"72'62","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:04.439176+0000","last_change":"2024-04-18T21:11:04.439237+0000","last_active":"2024-04-18T21:11:04.439176+0000","last_peered":"2024-04-18T21:11:04.439176+0000","last_clean":"2024-04-18T21:11:04.439176+0000","last_became_active":"2024-04-18T21:10:26.208004+0000","last_became_peered":"2024-04-18T21:10:26.208004+0000","last_unstale":"2024-04-18T21:11:04.439176+0000","last_undegraded":"2024-04-18T21:11:04.439176+0000","last_fullsized":"2024-04-18T21:11:04.439176+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'62","last_scrub_stamp":"2024-04-18T21:11:04.438988+0000","last_deep_scrub":"72'62","last_deep_scrub_stamp":"2024-04-18T21:11:04.438988+0000","last_clean_scrub_stamp":"2024-04-18T21:11:04.438988+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:59:35.430355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"74'397","reported_seq":594,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.036815+0000","last_change":"2024-04-18T21:10:43.036815+0000","last_active":"2024-04-18T21:10:43.036815+0000","last_peered":"2024-04-18T21:10:43.036815+0000","last_clean":"2024-04-18T21:10:43.036815+0000","last_became_active":"2024-04-18T21:05:08.603799+0000","last_became_peered":"2024-04-18T21:05:08.603799+0000","last_unstale":"2024-04-18T21:10:43.036815+0000","last_undegraded":"2024-04-18T21:10:43.036815+0000","last_fullsized":"2024-04-18T21:10:43.036815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'397","last_scrub_stamp":"2024-04-18T21:10:43.036408+0000","last_deep_scrub":"74'397","last_deep_scrub_stamp":"2024-04-18T21:10:43.036408+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.036408+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:17:15.381816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17338,"num_write":363,"num_write_kb":83699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'253","reported_seq":303,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.544896+0000","last_change":"2024-04-18T21:10:44.544976+0000","last_active":"2024-04-18T21:10:44.544896+0000","last_peered":"2024-04-18T21:10:44.544896+0000","last_clean":"2024-04-18T21:10:44.544896+0000","last_became_active":"2024-04-18T21:10:26.210096+0000","last_became_peered":"2024-04-18T21:10:26.210096+0000","last_unstale":"2024-04-18T21:10:44.544896+0000","last_undegraded":"2024-04-18T21:10:44.544896+0000","last_fullsized":"2024-04-18T21:10:44.544896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'253","last_scrub_stamp":"2024-04-18T21:10:44.544697+0000","last_deep_scrub":"89'253","last_deep_scrub_stamp":"2024-04-18T21:10:44.544697+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.544697+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:07:32.731155+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.107529+0000","last_change":"2024-04-18T21:10:56.107529+0000","last_active":"2024-04-18T21:10:56.107529+0000","last_peered":"2024-04-18T21:10:56.107529+0000","last_clean":"2024-04-18T21:10:56.107529+0000","last_became_active":"2024-04-18T21:05:03.546929+0000","last_became_peered":"2024-04-18T21:05:03.546929+0000","last_unstale":"2024-04-18T21:10:56.107529+0000","last_undegraded":"2024-04-18T21:10:56.107529+0000","last_fullsized":"2024-04-18T21:10:56.107529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:56.107288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:56.107288+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.107288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:54.217572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"74'376","reported_seq":587,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.008705+0000","last_change":"2024-04-18T21:10:44.008705+0000","last_active":"2024-04-18T21:10:44.008705+0000","last_peered":"2024-04-18T21:10:44.008705+0000","last_clean":"2024-04-18T21:10:44.008705+0000","last_became_active":"2024-04-18T21:10:16.890857+0000","last_became_peered":"2024-04-18T21:10:16.890857+0000","last_unstale":"2024-04-18T21:10:44.008705+0000","last_undegraded":"2024-04-18T21:10:44.008705+0000","last_fullsized":"2024-04-18T21:10:44.008705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'376","last_scrub_stamp":"2024-04-18T21:10:44.008446+0000","last_deep_scrub":"74'376","last_deep_scrub_stamp":"2024-04-18T21:10:44.008446+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.008446+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:50:36.590534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15286,"num_write":337,"num_write_kb":34469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"72'63","reported_seq":231,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.089365+0000","last_change":"2024-04-18T21:10:59.089365+0000","last_active":"2024-04-18T21:10:59.089365+0000","last_peered":"2024-04-18T21:10:59.089365+0000","last_clean":"2024-04-18T21:10:59.089365+0000","last_became_active":"2024-04-18T21:05:07.581706+0000","last_became_peered":"2024-04-18T21:05:07.581706+0000","last_unstale":"2024-04-18T21:10:59.089365+0000","last_undegraded":"2024-04-18T21:10:59.089365+0000","last_fullsized":"2024-04-18T21:10:59.089365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'63","last_scrub_stamp":"2024-04-18T21:10:59.088955+0000","last_deep_scrub":"72'63","last_deep_scrub_stamp":"2024-04-18T21:10:59.088955+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.088955+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:09.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:13.436848+0000","last_change":"2024-04-18T21:11:13.436904+0000","last_active":"2024-04-18T21:11:13.436848+0000","last_peered":"2024-04-18T21:11:13.436848+0000","last_clean":"2024-04-18T21:11:13.436848+0000","last_became_active":"2024-04-18T21:10:23.943104+0000","last_became_peered":"2024-04-18T21:10:23.943104+0000","last_unstale":"2024-04-18T21:11:13.436848+0000","last_undegraded":"2024-04-18T21:11:13.436848+0000","last_fullsized":"2024-04-18T21:11:13.436848+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:13.436653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:13.436653+0000","last_clean_scrub_stamp":"2024-04-18T21:11:13.436653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:49:23.914036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"74'402","reported_seq":599,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.994715+0000","last_change":"2024-04-18T21:10:41.994715+0000","last_active":"2024-04-18T21:10:41.994715+0000","last_peered":"2024-04-18T21:10:41.994715+0000","last_clean":"2024-04-18T21:10:41.994715+0000","last_became_active":"2024-04-18T21:06:57.673744+0000","last_became_peered":"2024-04-18T21:06:57.673744+0000","last_unstale":"2024-04-18T21:10:41.994715+0000","last_undegraded":"2024-04-18T21:10:41.994715+0000","last_fullsized":"2024-04-18T21:10:41.994715+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'402","last_scrub_stamp":"2024-04-18T21:10:41.994461+0000","last_deep_scrub":"74'402","last_deep_scrub_stamp":"2024-04-18T21:10:41.994461+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.994461+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:56.353553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16063,"num_write":364,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"89'64","reported_seq":231,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.187273+0000","last_change":"2024-04-18T21:11:02.187336+0000","last_active":"2024-04-18T21:11:02.187273+0000","last_peered":"2024-04-18T21:11:02.187273+0000","last_clean":"2024-04-18T21:11:02.187273+0000","last_became_active":"2024-04-18T21:05:07.582577+0000","last_became_peered":"2024-04-18T21:05:07.582577+0000","last_unstale":"2024-04-18T21:11:02.187273+0000","last_undegraded":"2024-04-18T21:11:02.187273+0000","last_fullsized":"2024-04-18T21:11:02.187273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'64","last_scrub_stamp":"2024-04-18T21:11:02.187081+0000","last_deep_scrub":"89'64","last_deep_scrub_stamp":"2024-04-18T21:11:02.187081+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.187081+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:12:45.559454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.094163+0000","last_change":"2024-04-18T21:10:58.094163+0000","last_active":"2024-04-18T21:10:58.094163+0000","last_peered":"2024-04-18T21:10:58.094163+0000","last_clean":"2024-04-18T21:10:58.094163+0000","last_became_active":"2024-04-18T21:05:03.547036+0000","last_became_peered":"2024-04-18T21:05:03.547036+0000","last_unstale":"2024-04-18T21:10:58.094163+0000","last_undegraded":"2024-04-18T21:10:58.094163+0000","last_fullsized":"2024-04-18T21:10:58.094163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:58.093922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:58.093922+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.093922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:27:15.135813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"74'392","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:08.251826+0000","last_change":"2024-04-18T21:11:08.251826+0000","last_active":"2024-04-18T21:11:08.251826+0000","last_peered":"2024-04-18T21:11:08.251826+0000","last_clean":"2024-04-18T21:11:08.251826+0000","last_became_active":"2024-04-18T21:10:16.888238+0000","last_became_peered":"2024-04-18T21:10:16.888238+0000","last_unstale":"2024-04-18T21:11:08.251826+0000","last_undegraded":"2024-04-18T21:11:08.251826+0000","last_fullsized":"2024-04-18T21:11:08.251826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'392","last_scrub_stamp":"2024-04-18T21:11:08.251569+0000","last_deep_scrub":"74'392","last_deep_scrub_stamp":"2024-04-18T21:11:08.251569+0000","last_clean_scrub_stamp":"2024-04-18T21:11:08.251569+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:49:18.728952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":356,"num_write_kb":33620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"89'110","reported_seq":251,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.993904+0000","last_change":"2024-04-18T21:10:49.993970+0000","last_active":"2024-04-18T21:10:49.993904+0000","last_peered":"2024-04-18T21:10:49.993904+0000","last_clean":"2024-04-18T21:10:49.993904+0000","last_became_active":"2024-04-18T21:10:16.878682+0000","last_became_peered":"2024-04-18T21:10:16.878682+0000","last_unstale":"2024-04-18T21:10:49.993904+0000","last_undegraded":"2024-04-18T21:10:49.993904+0000","last_fullsized":"2024-04-18T21:10:49.993904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'110","last_scrub_stamp":"2024-04-18T21:10:49.993694+0000","last_deep_scrub":"89'110","last_deep_scrub_stamp":"2024-04-18T21:10:49.993694+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.993694+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:26.920224+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:07.410856+0000","last_change":"2024-04-18T21:11:07.410918+0000","last_active":"2024-04-18T21:11:07.410856+0000","last_peered":"2024-04-18T21:11:07.410856+0000","last_clean":"2024-04-18T21:11:07.410856+0000","last_became_active":"2024-04-18T21:10:26.213625+0000","last_became_peered":"2024-04-18T21:10:26.213625+0000","last_unstale":"2024-04-18T21:11:07.410856+0000","last_undegraded":"2024-04-18T21:11:07.410856+0000","last_fullsized":"2024-04-18T21:11:07.410856+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:11:07.410669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:11:07.410669+0000","last_clean_scrub_stamp":"2024-04-18T21:11:07.410669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:34.543487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"74'401","reported_seq":626,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:04.377872+0000","last_change":"2024-04-18T21:11:04.377872+0000","last_active":"2024-04-18T21:11:04.377872+0000","last_peered":"2024-04-18T21:11:04.377872+0000","last_clean":"2024-04-18T21:11:04.377872+0000","last_became_active":"2024-04-18T21:10:16.871816+0000","last_became_peered":"2024-04-18T21:10:16.871816+0000","last_unstale":"2024-04-18T21:11:04.377872+0000","last_undegraded":"2024-04-18T21:11:04.377872+0000","last_fullsized":"2024-04-18T21:11:04.377872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'401","last_scrub_stamp":"2024-04-18T21:11:04.377611+0000","last_deep_scrub":"74'401","last_deep_scrub_stamp":"2024-04-18T21:11:04.377611+0000","last_clean_scrub_stamp":"2024-04-18T21:11:04.377611+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:15.168584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":16676,"num_write":373,"num_write_kb":79562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"74'418","reported_seq":642,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.501930+0000","last_change":"2024-04-18T21:10:48.501989+0000","last_active":"2024-04-18T21:10:48.501930+0000","last_peered":"2024-04-18T21:10:48.501930+0000","last_clean":"2024-04-18T21:10:48.501930+0000","last_became_active":"2024-04-18T21:10:26.229875+0000","last_became_peered":"2024-04-18T21:10:26.229875+0000","last_unstale":"2024-04-18T21:10:48.501930+0000","last_undegraded":"2024-04-18T21:10:48.501930+0000","last_fullsized":"2024-04-18T21:10:48.501930+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'418","last_scrub_stamp":"2024-04-18T21:10:48.501732+0000","last_deep_scrub":"74'418","last_deep_scrub_stamp":"2024-04-18T21:10:48.501732+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.501732+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:30.654262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":42230,"num_write":389,"num_write_kb":98682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"89'255","reported_seq":408,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:06.431602+0000","last_change":"2024-04-18T21:11:06.431789+0000","last_active":"2024-04-18T21:11:06.431602+0000","last_peered":"2024-04-18T21:11:06.431602+0000","last_clean":"2024-04-18T21:11:06.431602+0000","last_became_active":"2024-04-18T21:10:26.208331+0000","last_became_peered":"2024-04-18T21:10:26.208331+0000","last_unstale":"2024-04-18T21:11:06.431602+0000","last_undegraded":"2024-04-18T21:11:06.431602+0000","last_fullsized":"2024-04-18T21:11:06.431602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'255","last_scrub_stamp":"2024-04-18T21:11:06.431368+0000","last_deep_scrub":"89'255","last_deep_scrub_stamp":"2024-04-18T21:11:06.431368+0000","last_clean_scrub_stamp":"2024-04-18T21:11:06.431368+0000","objects_scrubbed":5,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:45:58.638918+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"74'398","reported_seq":578,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.086614+0000","last_change":"2024-04-18T21:10:53.086683+0000","last_active":"2024-04-18T21:10:53.086614+0000","last_peered":"2024-04-18T21:10:53.086614+0000","last_clean":"2024-04-18T21:10:53.086614+0000","last_became_active":"2024-04-18T21:05:08.601746+0000","last_became_peered":"2024-04-18T21:05:08.601746+0000","last_unstale":"2024-04-18T21:10:53.086614+0000","last_undegraded":"2024-04-18T21:10:53.086614+0000","last_fullsized":"2024-04-18T21:10:53.086614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'398","last_scrub_stamp":"2024-04-18T21:10:53.086251+0000","last_deep_scrub":"74'398","last_deep_scrub_stamp":"2024-04-18T21:10:53.086251+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.086251+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:05.595545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":3383,"num_write":362,"num_write_kb":34377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'79","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.018963+0000","last_change":"2024-04-18T21:10:43.019130+0000","last_active":"2024-04-18T21:10:43.018963+0000","last_peered":"2024-04-18T21:10:43.018963+0000","last_clean":"2024-04-18T21:10:43.018963+0000","last_became_active":"2024-04-18T21:10:16.893471+0000","last_became_peered":"2024-04-18T21:10:16.893471+0000","last_unstale":"2024-04-18T21:10:43.018963+0000","last_undegraded":"2024-04-18T21:10:43.018963+0000","last_fullsized":"2024-04-18T21:10:43.018963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'79","last_scrub_stamp":"2024-04-18T21:10:43.018744+0000","last_deep_scrub":"89'79","last_deep_scrub_stamp":"2024-04-18T21:10:43.018744+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.018744+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:26.019419+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"89'243","reported_seq":276,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.419262+0000","last_change":"2024-04-18T21:11:01.419405+0000","last_active":"2024-04-18T21:11:01.419262+0000","last_peered":"2024-04-18T21:11:01.419262+0000","last_clean":"2024-04-18T21:11:01.419262+0000","last_became_active":"2024-04-18T21:10:26.203726+0000","last_became_peered":"2024-04-18T21:10:26.203726+0000","last_unstale":"2024-04-18T21:11:01.419262+0000","last_undegraded":"2024-04-18T21:11:01.419262+0000","last_fullsized":"2024-04-18T21:11:01.419262+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'243","last_scrub_stamp":"2024-04-18T21:11:01.419031+0000","last_deep_scrub":"89'243","last_deep_scrub_stamp":"2024-04-18T21:11:01.419031+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.419031+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:29:26.700232+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'475","reported_seq":677,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:06.249460+0000","last_change":"2024-04-18T21:11:06.249538+0000","last_active":"2024-04-18T21:11:06.249460+0000","last_peered":"2024-04-18T21:11:06.249460+0000","last_clean":"2024-04-18T21:11:06.249460+0000","last_became_active":"2024-04-18T21:10:16.879118+0000","last_became_peered":"2024-04-18T21:10:16.879118+0000","last_unstale":"2024-04-18T21:11:06.249460+0000","last_undegraded":"2024-04-18T21:11:06.249460+0000","last_fullsized":"2024-04-18T21:11:06.249460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'475","last_scrub_stamp":"2024-04-18T21:11:06.249255+0000","last_deep_scrub":"74'475","last_deep_scrub_stamp":"2024-04-18T21:11:06.249255+0000","last_clean_scrub_stamp":"2024-04-18T21:11:06.249255+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:44.146727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16263,"num_write":442,"num_write_kb":89616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"72'63","reported_seq":237,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.954768+0000","last_change":"2024-04-18T21:10:45.954906+0000","last_active":"2024-04-18T21:10:45.954768+0000","last_peered":"2024-04-18T21:10:45.954768+0000","last_clean":"2024-04-18T21:10:45.954768+0000","last_became_active":"2024-04-18T21:10:16.874544+0000","last_became_peered":"2024-04-18T21:10:16.874544+0000","last_unstale":"2024-04-18T21:10:45.954768+0000","last_undegraded":"2024-04-18T21:10:45.954768+0000","last_fullsized":"2024-04-18T21:10:45.954768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'63","last_scrub_stamp":"2024-04-18T21:10:45.954547+0000","last_deep_scrub":"72'63","last_deep_scrub_stamp":"2024-04-18T21:10:45.954547+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.954547+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:29.545083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"74'446","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.934454+0000","last_change":"2024-04-18T21:10:48.934518+0000","last_active":"2024-04-18T21:10:48.934454+0000","last_peered":"2024-04-18T21:10:48.934454+0000","last_clean":"2024-04-18T21:10:48.934454+0000","last_became_active":"2024-04-18T21:05:08.603741+0000","last_became_peered":"2024-04-18T21:05:08.603741+0000","last_unstale":"2024-04-18T21:10:48.934454+0000","last_undegraded":"2024-04-18T21:10:48.934454+0000","last_fullsized":"2024-04-18T21:10:48.934454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'446","last_scrub_stamp":"2024-04-18T21:10:48.934255+0000","last_deep_scrub":"74'446","last_deep_scrub_stamp":"2024-04-18T21:10:48.934255+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.934255+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.407364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5371,"num_write":419,"num_write_kb":34915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"74'343","reported_seq":538,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.237321+0000","last_change":"2024-04-18T21:10:57.237321+0000","last_active":"2024-04-18T21:10:57.237321+0000","last_peered":"2024-04-18T21:10:57.237321+0000","last_clean":"2024-04-18T21:10:57.237321+0000","last_became_active":"2024-04-18T21:10:16.874981+0000","last_became_peered":"2024-04-18T21:10:16.874981+0000","last_unstale":"2024-04-18T21:10:57.237321+0000","last_undegraded":"2024-04-18T21:10:57.237321+0000","last_fullsized":"2024-04-18T21:10:57.237321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'343","last_scrub_stamp":"2024-04-18T21:10:57.237066+0000","last_deep_scrub":"74'343","last_deep_scrub_stamp":"2024-04-18T21:10:57.237066+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.237066+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:09.746360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20009,"num_write":318,"num_write_kb":18018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"89'618","reported_seq":785,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:03.272120+0000","last_change":"2024-04-18T21:11:03.272192+0000","last_active":"2024-04-18T21:11:03.272120+0000","last_peered":"2024-04-18T21:11:03.272120+0000","last_clean":"2024-04-18T21:11:03.272120+0000","last_became_active":"2024-04-18T21:05:07.581681+0000","last_became_peered":"2024-04-18T21:05:07.581681+0000","last_unstale":"2024-04-18T21:11:03.272120+0000","last_undegraded":"2024-04-18T21:11:03.272120+0000","last_fullsized":"2024-04-18T21:11:03.272120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'618","last_scrub_stamp":"2024-04-18T21:11:03.271930+0000","last_deep_scrub":"89'618","last_deep_scrub_stamp":"2024-04-18T21:11:03.271930+0000","last_clean_scrub_stamp":"2024-04-18T21:11:03.271930+0000","objects_scrubbed":2,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:45.266197+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":8459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"74'395","reported_seq":593,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.058717+0000","last_change":"2024-04-18T21:10:54.058717+0000","last_active":"2024-04-18T21:10:54.058717+0000","last_peered":"2024-04-18T21:10:54.058717+0000","last_clean":"2024-04-18T21:10:54.058717+0000","last_became_active":"2024-04-18T21:10:16.868829+0000","last_became_peered":"2024-04-18T21:10:16.868829+0000","last_unstale":"2024-04-18T21:10:54.058717+0000","last_undegraded":"2024-04-18T21:10:54.058717+0000","last_fullsized":"2024-04-18T21:10:54.058717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:54.058451+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:54.058451+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.058451+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:51:43.113325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11614,"num_write":367,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"89'207","reported_seq":381,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:05.259354+0000","last_change":"2024-04-18T21:11:05.259482+0000","last_active":"2024-04-18T21:11:05.259354+0000","last_peered":"2024-04-18T21:11:05.259354+0000","last_clean":"2024-04-18T21:11:05.259354+0000","last_became_active":"2024-04-18T21:10:16.882524+0000","last_became_peered":"2024-04-18T21:10:16.882524+0000","last_unstale":"2024-04-18T21:11:05.259354+0000","last_undegraded":"2024-04-18T21:11:05.259354+0000","last_fullsized":"2024-04-18T21:11:05.259354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'207","last_scrub_stamp":"2024-04-18T21:11:05.259136+0000","last_deep_scrub":"89'207","last_deep_scrub_stamp":"2024-04-18T21:11:05.259136+0000","last_clean_scrub_stamp":"2024-04-18T21:11:05.259136+0000","objects_scrubbed":1,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:45.485224+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"74'395","reported_seq":610,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.964831+0000","last_change":"2024-04-18T21:10:41.964977+0000","last_active":"2024-04-18T21:10:41.964831+0000","last_peered":"2024-04-18T21:10:41.964831+0000","last_clean":"2024-04-18T21:10:41.964831+0000","last_became_active":"2024-04-18T21:10:16.892669+0000","last_became_peered":"2024-04-18T21:10:16.892669+0000","last_unstale":"2024-04-18T21:10:41.964831+0000","last_undegraded":"2024-04-18T21:10:41.964831+0000","last_fullsized":"2024-04-18T21:10:41.964831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'395","last_scrub_stamp":"2024-04-18T21:10:41.964596+0000","last_deep_scrub":"74'395","last_deep_scrub_stamp":"2024-04-18T21:10:41.964596+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.964596+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:44:13.418017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24632,"num_write":352,"num_write_kb":71116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"89'189","reported_seq":304,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.175813+0000","last_change":"2024-04-18T21:10:52.175887+0000","last_active":"2024-04-18T21:10:52.175813+0000","last_peered":"2024-04-18T21:10:52.175813+0000","last_clean":"2024-04-18T21:10:52.175813+0000","last_became_active":"2024-04-18T21:10:23.923669+0000","last_became_peered":"2024-04-18T21:10:23.923669+0000","last_unstale":"2024-04-18T21:10:52.175813+0000","last_undegraded":"2024-04-18T21:10:52.175813+0000","last_fullsized":"2024-04-18T21:10:52.175813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'189","last_scrub_stamp":"2024-04-18T21:10:52.175618+0000","last_deep_scrub":"89'189","last_deep_scrub_stamp":"2024-04-18T21:10:52.175618+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.175618+0000","objects_scrubbed":3,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:29.442474+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12421195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"74'397","reported_seq":572,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:10.446620+0000","last_change":"2024-04-18T21:11:10.446679+0000","last_active":"2024-04-18T21:11:10.446620+0000","last_peered":"2024-04-18T21:11:10.446620+0000","last_clean":"2024-04-18T21:11:10.446620+0000","last_became_active":"2024-04-18T21:10:23.933421+0000","last_became_peered":"2024-04-18T21:10:23.933421+0000","last_unstale":"2024-04-18T21:11:10.446620+0000","last_undegraded":"2024-04-18T21:11:10.446620+0000","last_fullsized":"2024-04-18T21:11:10.446620+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'397","last_scrub_stamp":"2024-04-18T21:11:10.446425+0000","last_deep_scrub":"74'397","last_deep_scrub_stamp":"2024-04-18T21:11:10.446425+0000","last_clean_scrub_stamp":"2024-04-18T21:11:10.446425+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:50.672513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18040,"num_write":372,"num_write_kb":112462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"89'58","reported_seq":232,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.043350+0000","last_change":"2024-04-18T21:10:47.043413+0000","last_active":"2024-04-18T21:10:47.043350+0000","last_peered":"2024-04-18T21:10:47.043350+0000","last_clean":"2024-04-18T21:10:47.043350+0000","last_became_active":"2024-04-18T21:10:16.886999+0000","last_became_peered":"2024-04-18T21:10:16.886999+0000","last_unstale":"2024-04-18T21:10:47.043350+0000","last_undegraded":"2024-04-18T21:10:47.043350+0000","last_fullsized":"2024-04-18T21:10:47.043350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'58","last_scrub_stamp":"2024-04-18T21:10:47.043155+0000","last_deep_scrub":"89'58","last_deep_scrub_stamp":"2024-04-18T21:10:47.043155+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.043155+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:01.402247+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"74'368","reported_seq":537,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.508770+0000","last_change":"2024-04-18T21:10:49.508837+0000","last_active":"2024-04-18T21:10:49.508770+0000","last_peered":"2024-04-18T21:10:49.508770+0000","last_clean":"2024-04-18T21:10:49.508770+0000","last_became_active":"2024-04-18T21:10:26.211395+0000","last_became_peered":"2024-04-18T21:10:26.211395+0000","last_unstale":"2024-04-18T21:10:49.508770+0000","last_undegraded":"2024-04-18T21:10:49.508770+0000","last_fullsized":"2024-04-18T21:10:49.508770+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'368","last_scrub_stamp":"2024-04-18T21:10:49.508563+0000","last_deep_scrub":"74'368","last_deep_scrub_stamp":"2024-04-18T21:10:49.508563+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.508563+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:16.454033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13503,"num_write":339,"num_write_kb":30017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"89'180","reported_seq":263,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:05.446770+0000","last_change":"2024-04-18T21:11:05.446839+0000","last_active":"2024-04-18T21:11:05.446770+0000","last_peered":"2024-04-18T21:11:05.446770+0000","last_clean":"2024-04-18T21:11:05.446770+0000","last_became_active":"2024-04-18T21:10:26.205229+0000","last_became_peered":"2024-04-18T21:10:26.205229+0000","last_unstale":"2024-04-18T21:11:05.446770+0000","last_undegraded":"2024-04-18T21:11:05.446770+0000","last_fullsized":"2024-04-18T21:11:05.446770+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'180","last_scrub_stamp":"2024-04-18T21:11:05.446588+0000","last_deep_scrub":"89'180","last_deep_scrub_stamp":"2024-04-18T21:11:05.446588+0000","last_clean_scrub_stamp":"2024-04-18T21:11:05.446588+0000","objects_scrubbed":2,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:59:18.457517+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"74'402","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.421016+0000","last_change":"2024-04-18T21:10:54.421161+0000","last_active":"2024-04-18T21:10:54.421016+0000","last_peered":"2024-04-18T21:10:54.421016+0000","last_clean":"2024-04-18T21:10:54.421016+0000","last_became_active":"2024-04-18T21:10:26.204718+0000","last_became_peered":"2024-04-18T21:10:26.204718+0000","last_unstale":"2024-04-18T21:10:54.421016+0000","last_undegraded":"2024-04-18T21:10:54.421016+0000","last_fullsized":"2024-04-18T21:10:54.421016+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'402","last_scrub_stamp":"2024-04-18T21:10:54.420766+0000","last_deep_scrub":"74'402","last_deep_scrub_stamp":"2024-04-18T21:10:54.420766+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.420766+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:27:28.968229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17259,"num_write":368,"num_write_kb":100081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"89'195","reported_seq":369,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.096115+0000","last_change":"2024-04-18T21:10:45.096295+0000","last_active":"2024-04-18T21:10:45.096115+0000","last_peered":"2024-04-18T21:10:45.096115+0000","last_clean":"2024-04-18T21:10:45.096115+0000","last_became_active":"2024-04-18T21:10:16.891191+0000","last_became_peered":"2024-04-18T21:10:16.891191+0000","last_unstale":"2024-04-18T21:10:45.096115+0000","last_undegraded":"2024-04-18T21:10:45.096115+0000","last_fullsized":"2024-04-18T21:10:45.096115+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'195","last_scrub_stamp":"2024-04-18T21:10:45.095889+0000","last_deep_scrub":"89'195","last_deep_scrub_stamp":"2024-04-18T21:10:45.095889+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.095889+0000","objects_scrubbed":4,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:38:46.648098+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"74'414","reported_seq":571,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:11.424080+0000","last_change":"2024-04-18T21:11:11.424141+0000","last_active":"2024-04-18T21:11:11.424080+0000","last_peered":"2024-04-18T21:11:11.424080+0000","last_clean":"2024-04-18T21:11:11.424080+0000","last_became_active":"2024-04-18T21:10:23.923677+0000","last_became_peered":"2024-04-18T21:10:23.923677+0000","last_unstale":"2024-04-18T21:11:11.424080+0000","last_undegraded":"2024-04-18T21:11:11.424080+0000","last_fullsized":"2024-04-18T21:11:11.424080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'414","last_scrub_stamp":"2024-04-18T21:11:11.423871+0000","last_deep_scrub":"74'414","last_deep_scrub_stamp":"2024-04-18T21:11:11.423871+0000","last_clean_scrub_stamp":"2024-04-18T21:11:11.423871+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:49.321344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8130,"num_write":380,"num_write_kb":63257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"89'173","reported_seq":341,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.138648+0000","last_change":"2024-04-18T21:11:00.138648+0000","last_active":"2024-04-18T21:11:00.138648+0000","last_peered":"2024-04-18T21:11:00.138648+0000","last_clean":"2024-04-18T21:11:00.138648+0000","last_became_active":"2024-04-18T21:05:07.582165+0000","last_became_peered":"2024-04-18T21:05:07.582165+0000","last_unstale":"2024-04-18T21:11:00.138648+0000","last_undegraded":"2024-04-18T21:11:00.138648+0000","last_fullsized":"2024-04-18T21:11:00.138648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'173","last_scrub_stamp":"2024-04-18T21:11:00.138488+0000","last_deep_scrub":"89'173","last_deep_scrub_stamp":"2024-04-18T21:11:00.138488+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.138488+0000","objects_scrubbed":1,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:15.514469+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"74'440","reported_seq":612,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:11:11.362463+0000","last_change":"2024-04-18T21:11:11.362525+0000","last_active":"2024-04-18T21:11:11.362463+0000","last_peered":"2024-04-18T21:11:11.362463+0000","last_clean":"2024-04-18T21:11:11.362463+0000","last_became_active":"2024-04-18T21:10:26.229233+0000","last_became_peered":"2024-04-18T21:10:26.229233+0000","last_unstale":"2024-04-18T21:11:11.362463+0000","last_undegraded":"2024-04-18T21:11:11.362463+0000","last_fullsized":"2024-04-18T21:11:11.362463+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'440","last_scrub_stamp":"2024-04-18T21:11:11.362250+0000","last_deep_scrub":"74'440","last_deep_scrub_stamp":"2024-04-18T21:11:11.362250+0000","last_clean_scrub_stamp":"2024-04-18T21:11:11.362250+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:32.526096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21667,"num_write":402,"num_write_kb":34292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"89'62","reported_seq":237,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.028955+0000","last_change":"2024-04-18T21:10:44.028955+0000","last_active":"2024-04-18T21:10:44.028955+0000","last_peered":"2024-04-18T21:10:44.028955+0000","last_clean":"2024-04-18T21:10:44.028955+0000","last_became_active":"2024-04-18T21:10:16.872521+0000","last_became_peered":"2024-04-18T21:10:16.872521+0000","last_unstale":"2024-04-18T21:10:44.028955+0000","last_undegraded":"2024-04-18T21:10:44.028955+0000","last_fullsized":"2024-04-18T21:10:44.028955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'62","last_scrub_stamp":"2024-04-18T21:10:44.028700+0000","last_deep_scrub":"89'62","last_deep_scrub_stamp":"2024-04-18T21:10:44.028700+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.028700+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:51:51.391600+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1421944,"num_write":24455,"num_write_kb":4090105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":701553,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26520,"ondisk_log_size":26520,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127137413,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1476,"num_write":4527,"num_write_kb":127574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":254274826,"data_compressed":37883376,"data_compressed_allocated":49225728,"data_compressed_original":218636288,"omap_allocated":136244,"internal_metadata":0},"log_size":6364,"ondisk_log_size":6364,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":69562,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738453,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103660,"kb_used_data":28132,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268180,"statfs":{"total":96636764160,"available":96530616320,"internally_reserved":0,"allocated":28807168,"data_stored":84677573,"data_compressed":12367726,"data_compressed_allocated":16093184,"data_compressed_original":72364032,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738453,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103540,"kb_used_data":28012,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94268300,"statfs":{"total":96636764160,"available":96530739200,"internally_reserved":0,"allocated":28684288,"data_stored":81361203,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":81,"seq":347892350994,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58528,"kb_used_data":29080,"kb_used_omap":134,"kb_used_meta":29305,"kb_avail":94313312,"statfs":{"total":96636764160,"available":96576831488,"internally_reserved":0,"allocated":29777920,"data_stored":90502750,"data_compressed":13593114,"data_compressed_allocated":17559552,"data_compressed_original":78692352,"omap_allocated":137839,"internal_metadata":30008721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34781,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28975104,"data_stored":89550394,"data_compressed":13558333,"data_compressed_allocated":17514496,"data_compressed_original":78118912,"omap_allocated":136244,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27947008,"data_stored":80999215,"data_compressed":11992098,"data_compressed_allocated":15663104,"data_compressed_original":68726784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28004352,"data_stored":83725217,"data_compressed":12332945,"data_compressed_allocated":16048128,"data_compressed_original":71790592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:11:40.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-18T21:11:40.718 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-18T21:11:40.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:11:41.022 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:11:41.023 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:07.912310+0000","modified":"2024-04-18T21:05:09.941505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/2660214547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2660214547},{"type":"v1","addr":"172.21.15.96:6803","nonce":2660214547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:11:41.023 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-18T21:11:41.042 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:11:41.352 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:11:41.352 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:07.912310+0000","modified":"2024-04-18T21:05:09.941505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/2660214547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2660214547},{"type":"v1","addr":"172.21.15.96:6803","nonce":2660214547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:11:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-18T21:11:41.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:11:41.656 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T21:11:41.657 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":89,"fsid":"ce5e2bf2-36af-4d40-a378-74a7158189ef","created":"2024-04-18T21:04:46.921896+0000","modified":"2024-04-18T21:10:25.915815+0000","last_up_change":"2024-04-18T21:10:15.841427+0000","last_in_change":"2024-04-18T21:04:47.830213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:55.643422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:05:02.119174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:06.266829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:06.888450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e255a90f-ab37-44af-9793-7ea323c63959","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":81,"up_thru":88,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6801","nonce":274608909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6803","nonce":274608909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6807","nonce":274608909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":274608909},{"type":"v1","addr":"172.21.15.111:6805","nonce":274608909}]},"public_addr":"172.21.15.111:6801/274608909","cluster_addr":"172.21.15.111:6803/274608909","heartbeat_back_addr":"172.21.15.111:6807/274608909","heartbeat_front_addr":"172.21.15.111:6805/274608909","state":["exists","up"]},{"osd":1,"uuid":"2d189848-7fef-4eed-a1e7-524937587a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6801","nonce":2586340961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6803","nonce":2586340961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6807","nonce":2586340961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2586340961},{"type":"v1","addr":"172.21.15.134:6805","nonce":2586340961}]},"public_addr":"172.21.15.134:6801/2586340961","cluster_addr":"172.21.15.134:6803/2586340961","heartbeat_back_addr":"172.21.15.134:6807/2586340961","heartbeat_front_addr":"172.21.15.134:6805/2586340961","state":["exists","up"]},{"osd":2,"uuid":"2de50865-b6ec-4639-a544-dd366b440c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6801","nonce":2001406304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6803","nonce":2001406304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6807","nonce":2001406304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2001406304},{"type":"v1","addr":"172.21.15.194:6805","nonce":2001406304}]},"public_addr":"172.21.15.194:6801/2001406304","cluster_addr":"172.21.15.194:6803/2001406304","heartbeat_back_addr":"172.21.15.194:6807/2001406304","heartbeat_front_addr":"172.21.15.194:6805/2001406304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.192780+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.132213+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:53.152319+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3","osds":[1,2]},{"pgid":"4.7","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:11:41.675 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-18T21:11:41.987 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-18T21:11:42.009 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-18T21:11:42.047 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-18T21:11:43.012 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-18T21:11:44.011 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-04-18T21:11:44.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-18T21:11:45.014 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-04-18T21:11:45.039 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-18T21:11:45.039 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T21:11:45.039 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:45.051 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T21:11:45.051 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-18T21:11:45.051 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T21:11:45.051 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:45.127 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T21:11:45.127 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T21:11:45.127 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:46.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-18T21:11:51.230 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T21:11:51.230 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T21:11:51.230 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:51.294 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T21:11:51.294 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-18T21:11:51.294 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T21:11:51.294 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:51.322 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T21:11:51.322 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T21:11:51.322 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:51.395 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T21:11:51.395 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-18T21:11:51.396 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T21:11:51.396 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:51.454 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T21:11:51.455 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T21:11:51.455 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:51.517 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T21:11:51.517 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T21:11:51.517 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:51.573 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T21:11:51.573 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-18T21:11:51.573 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-18T21:11:51.631 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:11:51.631 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-18T21:11:51.749 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T21:11:51.749 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-18T21:11:51.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-18T21:11:51.888 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-18T21:11:51.889 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-18T21:11:51.983 INFO:tasks.ceph:Archiving mon data... 2024-04-18T21:11:51.984 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/data/mon.a.tgz 2024-04-18T21:11:51.985 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T21:11:51.990 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.LfoMz88EV5 2024-04-18T21:11:51.990 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LfoMz88EV5 2024-04-18T21:11:52.133 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.LfoMz88EV5 2024-04-18T21:11:52.196 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.LfoMz88EV5 is 385KB 2024-04-18T21:11:52.265 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.LfoMz88EV5 2024-04-18T21:11:52.271 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/data/mon.b.tgz 2024-04-18T21:11:52.271 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T21:11:52.319 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.6668K1buqf 2024-04-18T21:11:52.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6668K1buqf 2024-04-18T21:11:52.489 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.6668K1buqf 2024-04-18T21:11:52.559 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.6668K1buqf is 535KB 2024-04-18T21:11:52.630 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.6668K1buqf 2024-04-18T21:11:52.638 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/data/mon.c.tgz 2024-04-18T21:11:52.638 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T21:11:52.687 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.cnKhuhDFIK 2024-04-18T21:11:52.687 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.cnKhuhDFIK 2024-04-18T21:11:52.868 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.cnKhuhDFIK 2024-04-18T21:11:52.931 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.cnKhuhDFIK is 535KB 2024-04-18T21:11:53.036 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.cnKhuhDFIK 2024-04-18T21:11:53.043 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-18T21:11:53.043 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:53.088 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:53.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:53.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:53.242 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:53.260 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:53.267 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:53.273 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:53.274 INFO:tasks.ceph:Archiving crash dumps... 2024-04-18T21:11:53.275 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi096/crash 2024-04-18T21:11:53.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:53.304 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi111/crash 2024-04-18T21:11:53.305 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:53.329 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi134/crash 2024-04-18T21:11:53.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:53.344 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi194/crash 2024-04-18T21:11:53.344 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:53.358 INFO:tasks.ceph:Compressing logs... 2024-04-18T21:11:53.358 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:53.363 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:53.377 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:53.389 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.744.log 2024-04-18T21:11:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-18T21:11:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.744.log.gz 2024-04-18T21:11:53.391 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27061.log 2024-04-18T21:11:53.398 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23797.log 2024-04-18T21:11:53.398 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21096.log 2024-04-18T21:11:53.398 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27061.log.gz 2024-04-18T21:11:53.399 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21820.log 2024-04-18T21:11:53.399 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23797.log.gz 2024-04-18T21:11:53.399 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21096.log.gz 2024-04-18T21:11:53.399 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23432.log 2024-04-18T21:11:53.399 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21820.log.gz 2024-04-18T21:11:53.399 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23906.log 2024-04-18T21:11:53.431 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26386.log 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23432.log.gz 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23906.log.gz 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25348.log 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23686.log 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26386.log.gz 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25348.log.gz 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22280.log 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23686.log.gz 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21526.log 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22280.log.gz 2024-04-18T21:11:53.432 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28378.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24476.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21526.log.gz 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28378.log.gz 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21897.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27469.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24476.log.gz 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26105.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21897.log.gz 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27469.log.gz 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27807.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25768.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26105.log.gz 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27308.log 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27807.log.gz 2024-04-18T21:11:53.433 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21630.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25768.log.gz 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26329.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27308.log.gz 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24906.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21630.log.gz 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26329.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26329.log.gz -5 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.20652.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26879.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24906.log.gz 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.20652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25378.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20652.log.gz 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24616.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26879.log.gz 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27729.log 2024-04-18T21:11:53.434 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25378.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24616.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23656.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28015.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27729.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26271.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23656.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24082.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28015.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27010.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26271.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21742.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24082.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26026.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27010.log.gz 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27225.log 2024-04-18T21:11:53.435 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21742.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28501.log 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26026.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27495.log 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27225.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26552.log 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28501.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27495.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23154.log 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.26552.log: /var/log/ceph/ceph-client.admin.24306.log 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26552.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27781.log 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23154.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24052.log 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24306.log.gz 2024-04-18T21:11:53.436 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27781.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22911.log 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24052.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26303.log 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22358.log 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22911.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27632.log 0.0% 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26303.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20868.log 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22358.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24078.log 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27632.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.20868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20868.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27521.log 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24078.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.21249.log -- replaced with /var/log/ceph/ceph-client.admin.24078.log.gz 2024-04-18T21:11:53.437 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28067.log 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27521.log.gz 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22072.log 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21249.log.gz 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24275.log 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28067.log.gz 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22072.log.gz 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21740.log 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25435.log 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24275.log.gz 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21740.log.gz 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23073.log 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25435.log.gz 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22410.log 2024-04-18T21:11:53.438 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26772.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23073.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21409.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.22410.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26772.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26469.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24450.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21409.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26957.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26469.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24450.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21275.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27989.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26957.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23294.log 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21275.log.gz 2024-04-18T21:11:53.439 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22542.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27989.log.gz 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23294.log.gz 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26666.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22542.log.gz 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23458.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26666.log.gz 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21125.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23350.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23458.log.gz 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21125.log.gz 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21171.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24673.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23350.log.gz 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27833.log 2024-04-18T21:11:53.440 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21171.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24673.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22872.log 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26906.log 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27833.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25549.log 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.22872.log: /var/log/ceph/ceph-client.admin.26906.log: 33.7% -- replaced with /var/log/ceph/ceph-client.0.22872.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26906.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26693.log 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27154.log 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25549.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26693.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27859.log 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23325.log 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27154.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27859.log.gz 2024-04-18T21:11:53.441 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24590.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26984.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23325.log.gz 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24590.log.gz 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26773.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27911.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26984.log.gz 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26773.log.gz 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22490.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27911.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27911.log.gz -5 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24393.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22490.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.22490.log.gz 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr: /var/log/ceph/ceph-client.admin.26717.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28041.log 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24393.log.gz 2024-04-18T21:11:53.442 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24367.log 2024-04-18T21:11:53.443 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26717.log.gz 2024-04-18T21:11:53.477 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-18T21:11:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28041.log.gz 2024-04-18T21:11:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23682.log 2024-04-18T21:11:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27185.log 2024-04-18T21:11:53.498 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24367.log.gz 2024-04-18T21:11:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23682.log.gz 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24875.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23548.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27185.log.gz 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24875.log.gz 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22516.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21353.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23548.log.gz 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22516.log.gzgzip 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23963.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21353.log.gz 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21042.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27365.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23963.log.gz 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27555.log 2024-04-18T21:11:53.499 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21042.log.gz 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25264.log 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27365.log.gz 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27555.log.gz 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23740.log 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22228.log 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25264.log.gz 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23740.log.gz 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28145.log 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22150.log 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22228.log.gz 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28145.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28145.log.gz -5 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25491.log 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26640.log 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22150.log.gz 2024-04-18T21:11:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25491.log.gz 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26932.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22332.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26640.log.gz 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26932.log.gz 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23854.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25723.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22332.log.gz 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23854.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.23854.log.gz -- 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr: /var/log/ceph/ceph-client.admin.28300.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25466.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25723.log.gz 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28300.log.gz 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24989.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25146.log 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25466.log.gz 2024-04-18T21:11:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24989.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.24989.log.gz 2024-04-18T21:11:53.502 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24161.log 2024-04-18T21:11:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23605.log 2024-04-18T21:11:53.502 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25146.log.gz 2024-04-18T21:11:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24161.log.gz 2024-04-18T21:11:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23246.log 2024-04-18T21:11:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21301.log 2024-04-18T21:11:53.514 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23605.log.gz 2024-04-18T21:11:53.514 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23246.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23246.log.gz 2024-04-18T21:11:53.514 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22384.log 2024-04-18T21:11:53.514 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26360.log 2024-04-18T21:11:53.514 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21301.log.gz 2024-04-18T21:11:53.514 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22384.log.gz 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27036.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28171.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26360.log.gz 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27036.log.gz 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23878.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21682.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28171.log.gz 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23878.log.gz 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22046.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:gzip/var/log/ceph/ceph-client.admin.21682.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27097.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21682.log.gz 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22046.log.gz 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23022.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr:gzip/var/log/ceph/ceph-client.admin.27097.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.21812.log 2024-04-18T21:11:53.515 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27097.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23022.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28404.log 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:gzip/var/log/ceph/ceph-client.admin.21812.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22612.log 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21812.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28119.log 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28404.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25959.log 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22612.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24135.log 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28119.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25959.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22991.log 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.24135.log: /var/log/ceph/ceph-client.admin.21552.log 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24135.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22991.log.gz 2024-04-18T21:11:53.516 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21470.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23382.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21552.log.gz 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21470.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.21470.log.gz /var/log/ceph/ceph-client.admin.26214.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26819.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23382.log.gz 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26214.log.gz 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26189.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.26819.log: -- /var/log/ceph/ceph-client.admin.22254.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26819.log.gz 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25855.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26189.log.gz 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28093.log 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22254.log.gz 2024-04-18T21:11:53.517 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25855.log.gz 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:gzip/var/log/ceph/ceph-client.admin.28093.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22098.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28093.log.gz 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28430.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24218.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22098.log.gz 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25523.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28430.log.gz 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24218.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24218.log.gz 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22650.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25523.log.gz 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21223.log 2024-04-18T21:11:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22650.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23574.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23122.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21223.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23242.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23574.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24021.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23122.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24533.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23242.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21197.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24021.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27633.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24533.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27755.log 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21197.log.gz 2024-04-18T21:11:53.519 INFO:teuthology.orchestra.run.smithi096.stderr: 94.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21578.log 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27633.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21496.log 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27755.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25020.log 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21578.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21496.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21496.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28475.log 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26079.log 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25020.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28475.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24332.log 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25207.log 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26079.log.gz 2024-04-18T21:11:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24332.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21327.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24729.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25207.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21327.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27282.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24564.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24729.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27282.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24818.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21708.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24564.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24818.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24963.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24765.log 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21708.log.gz 2024-04-18T21:11:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24963.log.gz 2024-04-18T21:11:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-18T21:11:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24647.log 2024-04-18T21:11:53.522 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24765.log.gz 2024-04-18T21:11:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23765.log 2024-04-18T21:11:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24647.log.gz 2024-04-18T21:11:53.530 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-04-18T21:11:53.530 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27339.log 2024-04-18T21:11:53.530 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23765.log.gz 2024-04-18T21:11:53.530 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28223.log 2024-04-18T21:11:53.530 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-04-18T21:11:53.530 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23989.log 2024-04-18T21:11:53.530 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27339.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26417.log 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28223.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22572.log 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23989.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23462.log 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26417.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25816.log 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22572.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26519.log 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23462.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22611.log 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25816.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27553.log 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26519.log.gz 2024-04-18T21:11:53.531 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21890.log 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22611.log.gz 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25990.log 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27553.log.gz 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27417.log 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21890.log.gz 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20987.log 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25990.log.gz 2024-04-18T21:11:53.532 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25409.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27417.log.gz 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.20987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23211.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20987.log.gz 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21994.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25409.log.gz 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24761.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23211.log.gz 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21994.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.21994.log.gz -- 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr: /var/log/ceph/ceph.audit.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25019.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24761.log.gz 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26495.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25019.log.gz 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24500.log 2024-04-18T21:11:53.533 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24243.log 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26495.log.gz 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24931.log 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24500.log.gz 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27391.log 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24243.log.gz 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23408.log 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24931.log.gz 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27391.log.gz 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25180.log 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22773.log 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23408.log.gz 2024-04-18T21:11:53.534 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23048.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25180.log.gz 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22124.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22773.log.gz 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22202.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23048.log.gz 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20845.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22124.log.gz 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25289.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22202.log.gz 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.20845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21656.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20845.log.gz 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23517.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25289.log.gz 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22610.log 2024-04-18T21:11:53.535 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21656.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25603.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23517.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22610.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22714.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22942.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25603.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21381.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22714.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21898.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22942.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26156.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21381.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23609.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21898.log.gz 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23937.log 2024-04-18T21:11:53.536 INFO:teuthology.orchestra.run.smithi096.stderr: 92.0% 0.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26156.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24407.log 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23609.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24849.log 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23937.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21444.log 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24407.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22306.log 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24849.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21444.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24187.log 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26246.log 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22306.log.gz 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24187.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20450.log 2024-04-18T21:11:53.537 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24187.log.gz 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27256.log 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26246.log.gz 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.tmp-client.admin.20450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27937.log 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20450.log.gz 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25685.log 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27256.log.gz 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26129.log 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27937.log.gz 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21604.log 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25685.log.gz 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26129.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26129.log.gz 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21604.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.21604.log.gz --verbose 2024-04-18T21:11:53.538 INFO:teuthology.orchestra.run.smithi096.stderr: -- /var/log/ceph/ceph-client.admin.27554.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27963.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.27554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25238.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27554.log.gz 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27625.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27963.log.gz 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27443.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25238.log.gz 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27625.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27625.log.gz -5 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.26585.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26443.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27443.log.gz 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22464.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26585.log.gz 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27121.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26443.log.gz 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21741.log 2024-04-18T21:11:53.539 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22464.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28352.log 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27121.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27703.log 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21741.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23828.log 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28352.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27703.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26613.log 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21968.log/var/log/ceph/ceph-client.admin.23828.log: 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr: 92.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23828.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21819.log 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26613.log.gz 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21968.log.gzgzip 2024-04-18T21:11:53.540 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21070.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28250.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21819.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.21070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21070.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26022.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28250.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28276.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26852.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26022.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23097.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28276.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.26852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26852.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22176.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23178.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23097.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25897.log 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22176.log.gz 2024-04-18T21:11:53.541 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.23178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23178.log.gz 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28326.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25897.log.gzgzip 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.25575.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25321.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28326.log.gz 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25575.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.25575.log.gz -- 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr: /var/log/ceph/ceph-client.admin.25638.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27885.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25321.log.gz 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25638.log.gz 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24704.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22020.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27885.log.gz 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28197.log 2024-04-18T21:11:53.542 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24704.log.gz 2024-04-18T21:11:53.543 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.22020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22020.log.gz 2024-04-18T21:11:53.543 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28197.log.gz 2024-04-18T21:11:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21663.log 2024-04-18T21:11:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-18T21:11:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21711.log 2024-04-18T21:11:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.21663.log: /var/log/ceph/ceph-osd.2.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21663.log.gz 2024-04-18T21:11:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21687.log 2024-04-18T21:11:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.21711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21711.log.gz 2024-04-18T21:11:53.560 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.21687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21687.log.gz 2024-04-18T21:11:53.596 INFO:teuthology.orchestra.run.smithi096.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-18T21:11:53.638 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-18T21:11:53.722 INFO:teuthology.orchestra.run.smithi096.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-18T21:11:53.722 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-04-18T21:11:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m0.358s 2024-04-18T21:11:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m0.858s 2024-04-18T21:11:53.723 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.104s 2024-04-18T21:11:55.586 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.0.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-18T21:11:55.587 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-18T21:11:55.587 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m2.209s 2024-04-18T21:11:55.587 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m2.110s 2024-04-18T21:11:55.587 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m0.078s 2024-04-18T21:11:57.181 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-18T21:11:57.182 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-04-18T21:11:57.182 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m3.772s 2024-04-18T21:11:57.182 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m3.490s 2024-04-18T21:11:57.183 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m0.158s 2024-04-18T21:11:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.1.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-18T21:11:58.109 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-18T21:11:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m4.717s 2024-04-18T21:11:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m4.467s 2024-04-18T21:11:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.188s 2024-04-18T21:11:58.111 INFO:tasks.ceph:Archiving logs... 2024-04-18T21:11:58.111 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi096/log 2024-04-18T21:11:58.112 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:11:58.489 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi111/log 2024-04-18T21:11:58.490 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:11:58.796 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi134/log 2024-04-18T21:11:58.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:11:59.524 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi194/log 2024-04-18T21:11:59.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:12:00.145 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-18T21:12:00.157 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-18T21:12:00.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:12:00.160 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:12:00.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:12:00.167 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:12:00.260 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-18T21:12:00.272 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-18T21:12:00.273 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:12:00.287 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:12:00.293 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:12:00.293 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-18T21:12:00.293 INFO:teuthology.orchestra.run.smithi096.stdout:*hv01.front.sepi 67.205.162.81 3 u 37 64 377 0.094 -1.405 1.515 2024-04-18T21:12:00.293 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 63.231.80.2 3 u 31 64 377 0.091 -0.170 1.988 2024-04-18T21:12:00.293 INFO:teuthology.orchestra.run.smithi096.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.109 -0.986 1.933 2024-04-18T21:12:00.293 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T21:12:00.294 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:12:00.299 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:12:00.309 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:12:00.309 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-18T21:12:00.309 INFO:teuthology.orchestra.run.smithi134.stdout:*hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.090 -1.472 1.079 2024-04-18T21:12:00.309 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 63.231.80.2 3 u 35 64 377 0.080 -2.219 1.399 2024-04-18T21:12:00.309 INFO:teuthology.orchestra.run.smithi134.stdout:+hv03.front.sepi 74.6.168.72 3 u 28 64 377 0.082 -1.559 0.962 2024-04-18T21:12:00.309 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T21:12:00.311 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:12:00.311 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-04-18T21:12:00.311 INFO:teuthology.orchestra.run.smithi194.stdout:*hv01.front.sepi 67.205.162.81 3 u 32 64 377 0.092 -0.341 2.079 2024-04-18T21:12:00.311 INFO:teuthology.orchestra.run.smithi194.stdout:+hv02.front.sepi 63.231.80.2 3 u 34 64 377 0.089 +0.303 2.134 2024-04-18T21:12:00.311 INFO:teuthology.orchestra.run.smithi194.stdout:+hv03.front.sepi 74.6.168.72 3 u 31 64 377 0.090 -1.483 1.360 2024-04-18T21:12:00.311 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T21:12:00.319 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:12:00.319 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-04-18T21:12:00.319 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi 67.205.162.81 3 u 51 64 3 0.097 -270.46 0.642 2024-04-18T21:12:00.319 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi 63.231.80.2 3 u 55 64 3 0.118 -269.84 0.612 2024-04-18T21:12:00.319 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi 74.6.168.72 3 u 49 64 3 0.128 -270.42 0.576 2024-04-18T21:12:00.319 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T21:12:00.320 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-18T21:12:00.347 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-18T21:12:00.347 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-18T21:12:00.365 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-18T21:12:00.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-18T21:12:00.411 INFO:teuthology.task.internal:Duration was 1242.612479 seconds 2024-04-18T21:12:00.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-18T21:12:00.424 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-18T21:12:00.425 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:12:00.427 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:12:00.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:12:00.432 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:12:00.470 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-18T21:12:00.470 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T21:12:00.471 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:12:00.512 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-04-18T21:12:00.512 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:12:00.522 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T21:12:00.523 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:12:00.534 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-04-18T21:12:00.534 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:12:00.543 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-18T21:12:00.544 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:12:00.556 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:12:00.568 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:12:00.579 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:12:00.648 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-18T21:12:00.648 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:12:00.651 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:12:00.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:12:00.655 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:12:00.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-18T21:12:00.765 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-18T21:12:00.766 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:12:00.780 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:12:00.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:12:00.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:12:00.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-18T21:12:00.833 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:00.836 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:00.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:00.845 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-04-18T21:12:00.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:00.874 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-04-18T21:12:00.874 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-04-18T21:12:00.881 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-04-18T21:12:01.174 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:01.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:12:01.180 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:01.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:12:01.185 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:01.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:12:01.191 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:12:01.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:12:01.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-18T21:12:01.207 INFO:teuthology.task.internal:Transferring archived files... 2024-04-18T21:12:01.208 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi096 2024-04-18T21:12:01.209 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:12:01.252 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi111 2024-04-18T21:12:01.252 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:12:01.276 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi134 2024-04-18T21:12:01.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:12:01.303 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662444/remote/smithi194 2024-04-18T21:12:01.304 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:12:01.328 INFO:teuthology.task.internal:Removing archive directory... 2024-04-18T21:12:01.328 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:12:01.331 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:12:01.333 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:12:01.343 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:12:01.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-18T21:12:01.383 INFO:teuthology.task.internal:Not uploading archives. 2024-04-18T21:12:01.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-18T21:12:01.399 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-18T21:12:01.399 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:12:01.402 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:12:01.404 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:12:01.406 INFO:teuthology.orchestra.run.smithi096.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:12 /home/ubuntu/cephtest 2024-04-18T21:12:01.407 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:12:01.408 INFO:teuthology.orchestra.run.smithi111.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:12 /home/ubuntu/cephtest 2024-04-18T21:12:01.410 INFO:teuthology.orchestra.run.smithi134.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:12 /home/ubuntu/cephtest 2024-04-18T21:12:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: 655429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:12 /home/ubuntu/cephtest 2024-04-18T21:12:01.419 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T21:12:01.431 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T21:12:01.459 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1242.6124792099 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-18T21:12:01.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T21:12:01.542 INFO:teuthology.run:pass